-- Logs begin at Fri 2021-10-29 00:34:28 UTC, end at Fri 2021-10-29 01:46:33 UTC. -- Oct 29 01:09:53.801711 dv-cinder-813984-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 29 01:09:53.810517 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 29 01:09:53.812608 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 29 01:09:53 2021] *** Oct 29 01:09:53.812608 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 01:09:53.812608 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 01:09:53.812608 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: nodename: dv-cinder-813984-5-iscsi Oct 29 01:09:53.812608 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: machine: x86_64 Oct 29 01:09:53.812608 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: clock source: unix Oct 29 01:09:53.812608 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: pcre jit disabled Oct 29 01:09:53.812608 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: detected number of CPU cores: 4 Oct 29 01:09:53.812608 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: current working directory: / Oct 29 01:09:53.812608 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: detected binary path: /usr/bin/uwsgi-core Oct 29 01:09:53.812608 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: your processes number limit is 47680 Oct 29 01:09:53.813194 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: your memory page size is 4096 bytes Oct 29 01:09:53.813194 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: detected max file descriptor number: 2048 Oct 29 01:09:53.813194 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: lock engine: pthread robust mutexes Oct 29 01:09:53.813194 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: thunder lock: enabled Oct 29 01:09:53.813194 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 29 01:09:53.813194 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 29 01:09:53.859567 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: Python main interpreter initialized at 0x559f837f39c0 Oct 29 01:09:53.859567 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: python threads support enabled Oct 29 01:09:53.859567 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: your server socket listen backlog is limited to 100 connections Oct 29 01:09:53.859567 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: your mercy for graceful operations on workers is 90 seconds Oct 29 01:09:53.860003 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 01:09:53.860079 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: *** Operational MODE: preforking *** Oct 29 01:09:53.860315 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: *** uWSGI is running in multiple interpreter mode *** Oct 29 01:09:53.860315 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: spawned uWSGI master process (pid: 79693) Oct 29 01:09:53.860526 dv-cinder-813984-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 29 01:09:53.861112 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: spawned uWSGI worker 1 (pid: 79703, cores: 1) Oct 29 01:09:53.862219 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: spawned uWSGI worker 2 (pid: 79704, cores: 1) Oct 29 01:09:53.862219 dv-cinder-813984-5-iscsi devstack@keystone.service[79693]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 01:09:59.022060 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:09:59.022060 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: from cryptography.utils import int_from_bytes Oct 29 01:09:59.022857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:09:59.022857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: from cryptography.utils import int_from_bytes Oct 29 01:09:59.022976 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:09:59.022976 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: from cryptography.utils import int_from_bytes Oct 29 01:09:59.023388 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:09:59.023388 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: from cryptography.utils import int_from_bytes Oct 29 01:09:59.071951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 01:09:59.072155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 01:09:59.072254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 01:09:59.072352 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] command line args: [] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 01:09:59.072515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 01:09:59.072600 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] command line args: [] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 01:09:59.072677 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 01:09:59.072760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ================================================================================ {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 01:09:59.072832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 01:09:59.073014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ================================================================================ {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 01:09:59.073132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] admin_token = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.073262 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] config_dir = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.073342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] admin_token = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.073497 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.073573 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] config_dir = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.073649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] config_source = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.073726 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.073802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] debug = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.073873 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] config_source = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.073951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.074252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] debug = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.074252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.074390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.074458 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.074523 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.074612 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.074749 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.074858 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.074989 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.075107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.075210 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] list_limit = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.075311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] list_limit = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.075419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] log_config_append = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.075515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] log_config_append = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.075616 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.075720 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.075846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] log_dir = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.075988 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] log_dir = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.076109 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] log_file = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.076212 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] log_file = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.076319 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.076400 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.076521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.076597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.076716 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.076798 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.076924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.077008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.077126 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.077208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.077330 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.077413 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.077540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.077623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.077744 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.077821 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.077937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.078093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.078216 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.078292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.078412 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.078493 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.078608 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.078694 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.078782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.078904 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.078979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.079098 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.079217 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.079331 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.079701 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.87/identity {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.079799 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.87/identity {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.079924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] publish_errors = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.080010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] publish_errors = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.080126 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.080244 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.080325 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.080405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.080525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.080601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.080713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.081329 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.081503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.081589 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.081743 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] standard_threads = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.081827 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] standard_threads = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.081976 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.082093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.082226 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.082365 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.082449 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.082546 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.082630 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] use_journal = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.082710 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] use_journal = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.082782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] use_json = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.082886 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] use_json = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.082965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] use_stderr = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.083041 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] use_syslog = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.083163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] use_stderr = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.083291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] use_syslog = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.083404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.083521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:09:59.083669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.083817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.083940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.084063 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.084184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.084303 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.084416 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.084534 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.084647 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.084767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.084880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.084999 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.085119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.085217 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.085320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.085429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.085527 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.085633 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.085737 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.085844 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.085943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.086039 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.086134 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.086257 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.086372 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.086485 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.086612 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.086730 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.086854 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.086969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.087087 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.087207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.087322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.087434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.087558 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.087678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.087816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.087931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.088050 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.088169 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.088357 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.088480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.088599 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.088725 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.088840 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.088958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.089080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.089080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.089306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.089429 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.089542 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.089660 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.089782 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.089895 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.090013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.090013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.090224 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.090335 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.090455 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.090455 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.090667 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.090780 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.090898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.090898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.091121 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.091235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.091347 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.091347 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.091564 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.091564 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.091804 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.091804 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.092026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.092138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.092243 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.092363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.092488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.092615 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.092729 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.092842 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.092955 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.093067 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.093179 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.093303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.093418 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.093530 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.093644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.093644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.093868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.093868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.094103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.094220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.094333 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.094446 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.094558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.094680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.094800 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.094913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.095026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.095144 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.095258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.095381 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.095495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.095608 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.095722 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.095901 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.096016 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.096137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.096260 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.096374 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.096553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.097220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.097336 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.097459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.097574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.097574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.097793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.097793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.098017 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.098132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.098246 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.098359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.098478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.098592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.098714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.098837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.098952 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.099066 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.099187 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.099301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.099415 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.099536 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.099657 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.099785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.099901 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.100014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.100127 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.100252 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.100374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.100488 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.100601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.100714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.100833 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.100956 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.101070 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.101182 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.101296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.101408 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.101522 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.101651 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.101767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.101880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.101994 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.102107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.102220 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.102332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.102447 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.102560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.102673 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.102792 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.102906 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.103031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.103146 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.103259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.103373 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.103485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.103598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.103720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.103878 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.103991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.104105 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.104218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.104331 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.104456 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.104571 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.104692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.104806 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.104918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.105031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.105152 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.105275 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.105389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.105501 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.105621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.105735 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.105855 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] auth.external = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.105975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.106096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.106211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] auth.external = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.106324 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.106450 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.106564 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.106677 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.106797 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] auth.password = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.106916 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.107030 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] auth.token = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.107151 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] auth.password = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.107267 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.107380 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] auth.token = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.107493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.107606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.107719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.107934 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.108057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.108171 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.108284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.108399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.108511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.108632 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.108747 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.108860 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.108973 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] credential.caching = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.109085 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.109229 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.109354 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] credential.caching = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.109469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.109591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.109707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.109821 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.109935 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.110049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.110169 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.110292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.110408 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.110522 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.110635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.110749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.110862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.110987 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.111102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.111216 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.111329 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.111444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.111557 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.111684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.111817 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.111932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.112077 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.112197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.112311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.112437 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.112557 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.112732 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.112861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] federation.caching = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.112978 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.113093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.113216 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] federation.caching = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.113331 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.113445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.113560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.113674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.113789 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.113911 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.114026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.114141 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.114255 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.114369 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.114483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.114607 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.114722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.114837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.114959 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.115075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.115189 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.115312 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.115428 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.115542 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.115657 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity.caching = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.115798 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.115915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.116042 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity.caching = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.116159 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.116272 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.116386 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.116500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.116620 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.116745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.116861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.116975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.117090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.117204 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.117327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.117442 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.117556 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.117670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.117785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.117899 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.118021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.118136 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.118256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.118371 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.118485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.118600 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.118722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.118839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.118953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.119067 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.119182 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.119302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.119425 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.119540 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.119660 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.119797 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.119914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.120028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.120155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.120270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.120384 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.120498 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.120611 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.120725 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.120847 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.120964 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.121078 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.121192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.121306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.121420 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.121541 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.121660 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.121774 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.121896 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.122012 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.122134 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.122257 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.122378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.122499 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.122614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.122728 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.122842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.122964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.123079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.123233 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.123358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.123472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.123586 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.123821 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.123941 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.124058 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.124172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.124286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.124401 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.124524 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.124639 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.124753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.124867 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.124981 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.125102 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.125228 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.125344 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.125458 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.125572 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.125686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.125801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.125923 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.126039 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.126155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.126155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.126368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.126368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.126589 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.126704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.126818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.126931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.127044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.127044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.127267 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.127389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.127504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.127618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.127763 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.127882 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.128009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.128009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.128232 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.128347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.128467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.128582 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.128705 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.128820 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.128935 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.129049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.129162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.129286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.129401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.129515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.129629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.129743 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.129865 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.129989 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.130104 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.130219 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.130333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.130448 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.130561 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.130683 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.130798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.130913 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.131026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.131140 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.131253 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.131385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.131501 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.131618 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.131795 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.131913 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.132027 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.132154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.132269 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.132384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.132498 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.132612 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.132726 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.132852 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.132967 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.133081 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.133195 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.133309 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.133429 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.133553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.133668 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.133782 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.133896 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.134010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.134123 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.134245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.134366 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.134366 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.134583 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.134583 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.134797 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.134797 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.135020 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.135134 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.135247 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.135361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.135475 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.135598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.135713 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.135846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.135959 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.136073 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.136186 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.136312 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] resource.caching = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.136428 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.136541 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.136656 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.136770 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.136883 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] resource.caching = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.137005 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.137120 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.137233 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.137347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.137461 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.137573 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.137697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.137812 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.137926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.138039 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.138153 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.138265 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.138387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.138502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.138615 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] role.caching = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.138729 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.138843 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] role.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.138956 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.139077 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.139192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] role.caching = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.139306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.139419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] role.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.139532 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.139646 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.139786 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.139910 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.140024 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.140138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.140253 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.140366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.140488 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.140603 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.140722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.140838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.140951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.141072 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.141187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.141301 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.141415 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.141528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.141646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.141768 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.141884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.141998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.142112 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.142225 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.142225 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.142448 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.142563 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.142677 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.142677 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.142891 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.143004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.143125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.143240 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.143891 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.144010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.144124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.144238 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.144364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.144480 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.144595 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.144710 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.144830 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.144945 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.145069 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.145184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.145298 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.145413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.145527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.145646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.145770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.145885 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.145998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.146113 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.146227 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.146415 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.146533 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.146647 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.146762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.146876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.146990 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.147112 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.147228 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.147341 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] token.caching = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.147455 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.147569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.147682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.147824 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.147940 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] token.caching = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.148055 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.148170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.148284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.148399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.148525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.148640 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.148754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.148868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.148982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.149096 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.149219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.149334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.149448 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.149562 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.149675 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.149789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.149911 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.150026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.150141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.150256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.150370 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.150484 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.150606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.150721 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.150835 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.150949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.151064 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.151178 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.151301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.151416 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.151530 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.connection = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.151644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.151774 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.151891 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.152016 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.152136 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.connection = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.152250 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.152366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.152479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.152593 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.152714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.152829 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.152943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.153056 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.153170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.153283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.153406 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.153520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.153635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.153748 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.153862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.153976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.154098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.154229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.154360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.154478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.154591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.154705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.154827 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.154950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.155065 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.155188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.155303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.155417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.155531 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.155645 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.155799 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.155799 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 01:09:59.156035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.156035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.156035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:09:59.156035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 01:09:59.185693 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.185923 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.186153 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.186239 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.186394 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.186623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.194942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.195356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.224297 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.224525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.225040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.225279 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.279360 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.279560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.421052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.421224 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.422033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.422270 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.486488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.486653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.486787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.486870 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.486964 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.487215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.487298 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.487439 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.487581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.487674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.487903 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.488043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.512907 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.513145 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.513255 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.513374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.513457 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.513603 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.513685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.513826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.513912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.514046 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.514129 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.514262 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.514345 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.514482 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.525530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.525635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.538783 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.539019 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.539242 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.539327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.539465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.539548 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.539684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.539807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.539926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.540011 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.540140 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.540224 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.540386 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.540604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 01:09:59.557801 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.558011 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 01:09:59.558211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.558345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.558510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 01:09:59.558591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 01:09:59.558739 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.558823 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.558939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 01:09:59.559049 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.559208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.559292 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.559468 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.559550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.559745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.560006 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.571103 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.571375 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.571464 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.571639 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.571747 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.571939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.572026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.572263 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.579783 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.580176 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.583582 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.583888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.584084 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.584168 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.584362 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.584459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.584642 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.584734 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.584923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.585007 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.585189 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.585284 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.585449 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.585532 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.585714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.585822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.585983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.586096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.586362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.586444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.586631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.586898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.611866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.612587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.613656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.613932 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.614153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.614429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.619151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.619428 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.619685 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.619799 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.619986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.620266 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.626757 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.627038 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.627294 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.627578 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.632089 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.632370 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.632557 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.632656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.632843 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.632928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.633126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.633281 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.633450 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.633552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.633794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.633884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.634057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.634139 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.634327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.634594 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.653284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.653559 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.653809 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.654086 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.658119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.658677 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.661970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.662264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.662513 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.662816 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.667154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.667753 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.670797 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.671422 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.674329 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.674678 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.674962 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.675050 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.675352 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.675446 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.675635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.675720 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.675947 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.676082 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.676391 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.676679 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.695300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.695580 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.695919 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.696127 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.696263 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.696546 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.696816 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.697087 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.704537 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.704930 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.706829 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.707099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.707223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.707497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.710101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.710380 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.710514 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.710657 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.710817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.710939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.711055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.711216 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.711342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.711619 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.725120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.725398 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.725678 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.725964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.726239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.726516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.726786 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.727623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.727929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.728210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.728490 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.728770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.729044 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.729327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.744761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.747440 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.749296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.752057 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.752528 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.754744 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.756235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.756355 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.756630 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.756906 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.757813 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.759408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.759687 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.760001 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.764044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.765582 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.767256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.769280 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.769456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.769589 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.769831 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.770102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.772625 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.772921 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.773206 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.773489 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.778882 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.779168 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.779443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.782347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.782634 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.782913 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.787422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.787702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.788005 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.788276 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.788555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.788831 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.789104 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.789366 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.789643 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.789914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.790190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.790447 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.790707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.790790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 01:09:59.790971 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.791054 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.791257 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.791529 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.791823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.792099 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.792378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.792650 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.792917 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.793186 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.793466 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.793724 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.793985 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.794258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 01:09:59.828766 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559f837f39c0 pid: 79704 (default app) Oct 29 01:09:59.832575 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535993b-3d11-4c4a-a5a3-f80c82d9ddf2 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:09:59.832787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559f837f39c0 pid: 79703 (default app) Oct 29 01:09:59.832878 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535993b-3d11-4c4a-a5a3-f80c82d9ddf2 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:09:59.833118 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535993b-3d11-4c4a-a5a3-f80c82d9ddf2 None None] PATH_INFO: `/v3` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:09:59.837482 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1/1] 10.222.0.87 () {50 vars in 791 bytes} [Fri Oct 29 01:09:59 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:08.485884 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daeb8d-18ce-477e-aaf2-11019be81960 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:08.486434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daeb8d-18ce-477e-aaf2-11019be81960 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:08.486434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daeb8d-18ce-477e-aaf2-11019be81960 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:08.491583 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1/2] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:08 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:10:08.497973 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4871-b88b-40c7-8e2a-1a033a3ba107 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:08.498387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4871-b88b-40c7-8e2a-1a033a3ba107 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:08.498528 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4871-b88b-40c7-8e2a-1a033a3ba107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:08.530031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG oslo_db.sqlalchemy.engines [None req-681b4871-b88b-40c7-8e2a-1a033a3ba107 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79704) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:10:08.725940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG passlib.handlers.bcrypt [None req-681b4871-b88b-40c7-8e2a-1a033a3ba107 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79704) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 29 01:10:08.726363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG passlib.handlers.bcrypt [None req-681b4871-b88b-40c7-8e2a-1a033a3ba107 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79704) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 29 01:10:08.782302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-681b4871-b88b-40c7-8e2a-1a033a3ba107 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:08.784524 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-681b4871-b88b-40c7-8e2a-1a033a3ba107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:08.921695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 2/3] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:09.067385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daeb8d-18ce-477e-aaf2-11019be81960 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:09.105946 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG oslo_db.sqlalchemy.engines [None req-08daeb8d-18ce-477e-aaf2-11019be81960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79703) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:10:09.239663 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daeb8d-18ce-477e-aaf2-11019be81960 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:09.243950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a261c1e-df83-43f5-b959-14e20f4c4633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:09.244605 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a261c1e-df83-43f5-b959-14e20f4c4633 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:09.244889 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a261c1e-df83-43f5-b959-14e20f4c4633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:09.245165 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a261c1e-df83-43f5-b959-14e20f4c4633 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:09.253922 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a261c1e-df83-43f5-b959-14e20f4c4633 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:09.303178 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9a261c1e-df83-43f5-b959-14e20f4c4633 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 29 01:10:09.309623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a261c1e-df83-43f5-b959-14e20f4c4633 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:09.313197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 2/4] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:09.322212 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b4871-b88b-40c7-8e2a-1a033a3ba107 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:09.338663 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b4871-b88b-40c7-8e2a-1a033a3ba107 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:09.343327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d83c5-ed2d-4ecf-ba05-de1399af8d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:09.344671 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d83c5-ed2d-4ecf-ba05-de1399af8d29 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:09.344970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d83c5-ed2d-4ecf-ba05-de1399af8d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:09.345259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d83c5-ed2d-4ecf-ba05-de1399af8d29 admin admin] PATH_INFO: `/v3/projects/2ac3fe6c70e94b5294a05c397d1a0fce` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:09.347314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d83c5-ed2d-4ecf-ba05-de1399af8d29 admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac3fe6c70e94b5294a05c397d1a0fce)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:09.404670 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d70d83c5-ed2d-4ecf-ba05-de1399af8d29 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 29 01:10:09.405036 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d83c5-ed2d-4ecf-ba05-de1399af8d29 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:09.410619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 3/5] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:09 2021] GET /identity/v3/projects/2ac3fe6c70e94b5294a05c397d1a0fce => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:11.672434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94553-1e45-4d65-ae9e-311649bf0d10 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:11.673007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94553-1e45-4d65-ae9e-311649bf0d10 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:11.673007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94553-1e45-4d65-ae9e-311649bf0d10 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:11.678353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 3/6] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:11 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:11.684752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d3e59-eac0-4567-acd3-ea2c4c31166d None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:11.685136 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d3e59-eac0-4567-acd3-ea2c4c31166d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:11.685315 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d3e59-eac0-4567-acd3-ea2c4c31166d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:11.704867 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-db4d3e59-eac0-4567-acd3-ea2c4c31166d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:11.707540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-db4d3e59-eac0-4567-acd3-ea2c4c31166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:11.715746 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 4/7] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:11.742194 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c94553-1e45-4d65-ae9e-311649bf0d10 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:11.755569 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c94553-1e45-4d65-ae9e-311649bf0d10 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:11.760437 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ece1fc-74a0-4509-9038-c280acfe5902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:11.761152 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ece1fc-74a0-4509-9038-c280acfe5902 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:11.761479 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ece1fc-74a0-4509-9038-c280acfe5902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:11.761801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ece1fc-74a0-4509-9038-c280acfe5902 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:11.770971 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ece1fc-74a0-4509-9038-c280acfe5902 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:11.772999 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ece1fc-74a0-4509-9038-c280acfe5902 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:11.782000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 4/8] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:11 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:11.788637 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d3e59-eac0-4567-acd3-ea2c4c31166d None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:11.797467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d3e59-eac0-4567-acd3-ea2c4c31166d None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:11.802468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96869573-0c96-408a-b79b-3e6ed87831fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:11.803310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96869573-0c96-408a-b79b-3e6ed87831fb admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:11.803593 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96869573-0c96-408a-b79b-3e6ed87831fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:11.803906 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96869573-0c96-408a-b79b-3e6ed87831fb admin admin] PATH_INFO: `/v3/users/5644d459227e4d61a1311eb719e23975` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:11.805311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96869573-0c96-408a-b79b-3e6ed87831fb admin admin] RBAC: Authorizing `identity:get_user(user_id=5644d459227e4d61a1311eb719e23975)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:11.807143 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96869573-0c96-408a-b79b-3e6ed87831fb admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:11.808739 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 5/9] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:11 2021] GET /identity/v3/users/5644d459227e4d61a1311eb719e23975 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:14.125207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b9886-d66f-46e2-9fa1-687c1d2b3b8d None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:14.125749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b9886-d66f-46e2-9fa1-687c1d2b3b8d None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:14.125749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b9886-d66f-46e2-9fa1-687c1d2b3b8d None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:14.127558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 5/10] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:14.134034 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abe90f-506e-4737-9ee0-501249e2ba2c None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:14.134480 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abe90f-506e-4737-9ee0-501249e2ba2c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:14.134571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abe90f-506e-4737-9ee0-501249e2ba2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:14.152403 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-75abe90f-506e-4737-9ee0-501249e2ba2c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:14.153578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-75abe90f-506e-4737-9ee0-501249e2ba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:14.161592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 6/11] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:14.171857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaefd7-8612-4286-8e36-f5a23565c97b None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:14.172144 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaefd7-8612-4286-8e36-f5a23565c97b None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:14.172442 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaefd7-8612-4286-8e36-f5a23565c97b None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:14.174794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 6/12] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:14.181096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d589c6-b9a8-4f1f-86f0-9797572bcf06 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:14.181379 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d589c6-b9a8-4f1f-86f0-9797572bcf06 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:14.181650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d589c6-b9a8-4f1f-86f0-9797572bcf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:14.186058 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaefd7-8612-4286-8e36-f5a23565c97b None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:14.198762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaefd7-8612-4286-8e36-f5a23565c97b None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:14.200090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-a3d589c6-b9a8-4f1f-86f0-9797572bcf06 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:14.201263 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a3d589c6-b9a8-4f1f-86f0-9797572bcf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:14.203030 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86bf63-dd08-4ab5-b14d-49ee783d7e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:14.203837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86bf63-dd08-4ab5-b14d-49ee783d7e4b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:14.204116 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86bf63-dd08-4ab5-b14d-49ee783d7e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:14.204388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86bf63-dd08-4ab5-b14d-49ee783d7e4b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:14.208825 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 7/13] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:14.220092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86bf63-dd08-4ab5-b14d-49ee783d7e4b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:14.227072 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-ab86bf63-dd08-4ab5-b14d-49ee783d7e4b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:10:14.228394 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 7/14] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:10:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:10:14.231985 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d589c6-b9a8-4f1f-86f0-9797572bcf06 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:14.234584 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86bf63-dd08-4ab5-b14d-49ee783d7e4b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:14.242320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d589c6-b9a8-4f1f-86f0-9797572bcf06 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:14.246895 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00537a5-399a-4650-be4a-2aaf6600737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:14.247531 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00537a5-399a-4650-be4a-2aaf6600737b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:14.247834 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00537a5-399a-4650-be4a-2aaf6600737b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:14.248107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00537a5-399a-4650-be4a-2aaf6600737b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:14.248193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86bf63-dd08-4ab5-b14d-49ee783d7e4b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:14.253641 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a525a-bf43-41d5-b7ee-5253b66b34e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:14.254292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a525a-bf43-41d5-b7ee-5253b66b34e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:14.254584 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a525a-bf43-41d5-b7ee-5253b66b34e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:14.254860 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a525a-bf43-41d5-b7ee-5253b66b34e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:14.255631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a525a-bf43-41d5-b7ee-5253b66b34e0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:14.255965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a525a-bf43-41d5-b7ee-5253b66b34e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:14.256631 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00537a5-399a-4650-be4a-2aaf6600737b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:14.257717 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-868a525a-bf43-41d5-b7ee-5253b66b34e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:14.257717 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:10:14.257717 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:10:14.258389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00537a5-399a-4650-be4a-2aaf6600737b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:14.258619 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a525a-bf43-41d5-b7ee-5253b66b34e0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:14.267163 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 8/15] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:14.273493 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 8/16] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:14.273713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00537a5-399a-4650-be4a-2aaf6600737b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:14.279539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a525a-bf43-41d5-b7ee-5253b66b34e0 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:14.282423 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00537a5-399a-4650-be4a-2aaf6600737b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:14.287118 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b7f96-4159-47c5-b9c6-e803341245b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:14.287935 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b7f96-4159-47c5-b9c6-e803341245b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:14.288311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b7f96-4159-47c5-b9c6-e803341245b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:14.288586 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b7f96-4159-47c5-b9c6-e803341245b9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:14.289705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a525a-bf43-41d5-b7ee-5253b66b34e0 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:14.289801 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b7f96-4159-47c5-b9c6-e803341245b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:14.291495 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b7f96-4159-47c5-b9c6-e803341245b9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:14.293131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 9/17] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:14.294564 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2593ce-7a96-4f6f-9c37-12e159c211ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:14.295412 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2593ce-7a96-4f6f-9c37-12e159c211ba admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:14.295737 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2593ce-7a96-4f6f-9c37-12e159c211ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:14.296009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2593ce-7a96-4f6f-9c37-12e159c211ba admin admin] PATH_INFO: `/v3/users/5644d459227e4d61a1311eb719e23975` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:14.297830 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2593ce-7a96-4f6f-9c37-12e159c211ba admin admin] RBAC: Authorizing `identity:get_user(user_id=5644d459227e4d61a1311eb719e23975)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:14.301019 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2593ce-7a96-4f6f-9c37-12e159c211ba admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:14.302804 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 9/18] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:14 2021] GET /identity/v3/users/5644d459227e4d61a1311eb719e23975 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:14.309170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b7f96-4159-47c5-b9c6-e803341245b9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:14.321284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b7f96-4159-47c5-b9c6-e803341245b9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:14.326230 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9530bde-a6dd-45ac-80f0-ead5a6f5a71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:14.327102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9530bde-a6dd-45ac-80f0-ead5a6f5a71d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:14.327388 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9530bde-a6dd-45ac-80f0-ead5a6f5a71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:14.327667 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9530bde-a6dd-45ac-80f0-ead5a6f5a71d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:14.328982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9530bde-a6dd-45ac-80f0-ead5a6f5a71d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:14.331394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9530bde-a6dd-45ac-80f0-ead5a6f5a71d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:14.333217 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 10/19] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:14.340800 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2593ce-7a96-4f6f-9c37-12e159c211ba admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:14.355018 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2593ce-7a96-4f6f-9c37-12e159c211ba admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:14.359825 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e637f24-9fd3-4f1f-a795-06d34be2755a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:14.360502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e637f24-9fd3-4f1f-a795-06d34be2755a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:14.360786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e637f24-9fd3-4f1f-a795-06d34be2755a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:14.361062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e637f24-9fd3-4f1f-a795-06d34be2755a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:14.362519 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e637f24-9fd3-4f1f-a795-06d34be2755a admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.domain.id=default, user.id=5644d459227e4d61a1311eb719e23975) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:14.362824 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e637f24-9fd3-4f1f-a795-06d34be2755a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:14.363862 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-1e637f24-9fd3-4f1f-a795-06d34be2755a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:14.363862 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:10:14.363862 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:10:14.365327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e637f24-9fd3-4f1f-a795-06d34be2755a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:14.375163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 10/20] 10.222.0.87 () {56 vars in 1343 bytes} [Fri Oct 29 01:10:14 2021] GET /identity/v3/role_assignments?user.id=5644d459227e4d61a1311eb719e23975&scope.domain.id=default&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 233 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:17.068891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bda058-540d-4375-b033-6206afde2fcf None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.069648 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bda058-540d-4375-b033-6206afde2fcf None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.069722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bda058-540d-4375-b033-6206afde2fcf None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.071713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 11/21] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:17.079772 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7864217-a3cc-4942-a4a2-a04bb7e61f6a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.081198 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7864217-a3cc-4942-a4a2-a04bb7e61f6a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.081617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7864217-a3cc-4942-a4a2-a04bb7e61f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.118227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a5bf2-ab5f-490c-99f1-4c87c8521c4a None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.118861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a5bf2-ab5f-490c-99f1-4c87c8521c4a None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.119416 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a5bf2-ab5f-490c-99f1-4c87c8521c4a None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.121436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 12/22] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:17.130845 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG passlib.handlers.bcrypt [None req-d7864217-a3cc-4942-a4a2-a04bb7e61f6a None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79703) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 29 01:10:17.131274 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG passlib.handlers.bcrypt [None req-d7864217-a3cc-4942-a4a2-a04bb7e61f6a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79703) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 29 01:10:17.137603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ba788-f7f9-4b0f-a7bf-86dce7239427 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.138123 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ba788-f7f9-4b0f-a7bf-86dce7239427 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.138605 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ba788-f7f9-4b0f-a7bf-86dce7239427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.176770 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8c9ba788-f7f9-4b0f-a7bf-86dce7239427 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:17.178321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8c9ba788-f7f9-4b0f-a7bf-86dce7239427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:17.194751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d7864217-a3cc-4942-a4a2-a04bb7e61f6a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:17.196503 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d7864217-a3cc-4942-a4a2-a04bb7e61f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:17.196696 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 13/23] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:17.237353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ba788-f7f9-4b0f-a7bf-86dce7239427 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:17.243492 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 11/24] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 29 01:10:17.251759 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ba788-f7f9-4b0f-a7bf-86dce7239427 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:17.269322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad1e9d-a49c-42ad-af7d-8b537aa00310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:17.270148 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad1e9d-a49c-42ad-af7d-8b537aa00310 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.270423 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad1e9d-a49c-42ad-af7d-8b537aa00310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.270704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad1e9d-a49c-42ad-af7d-8b537aa00310 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.290976 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad1e9d-a49c-42ad-af7d-8b537aa00310 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:17.291471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7864217-a3cc-4942-a4a2-a04bb7e61f6a None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:17.298083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-25ad1e9d-a49c-42ad-af7d-8b537aa00310 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:10:17.305196 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7864217-a3cc-4942-a4a2-a04bb7e61f6a None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:17.313165 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 14/25] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:10:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:17.320376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad1e9d-a49c-42ad-af7d-8b537aa00310 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:17.320834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb024ac-52a0-425a-89ca-3f1d75580d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:17.321997 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb024ac-52a0-425a-89ca-3f1d75580d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.322283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb024ac-52a0-425a-89ca-3f1d75580d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.322560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb024ac-52a0-425a-89ca-3f1d75580d81 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.335288 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad1e9d-a49c-42ad-af7d-8b537aa00310 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:17.343537 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981637c0-e2c3-4ce8-8003-8dd893782f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:17.344261 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981637c0-e2c3-4ce8-8003-8dd893782f5e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.344547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981637c0-e2c3-4ce8-8003-8dd893782f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.344824 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981637c0-e2c3-4ce8-8003-8dd893782f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.346155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981637c0-e2c3-4ce8-8003-8dd893782f5e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:17.347169 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981637c0-e2c3-4ce8-8003-8dd893782f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:17.349054 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-981637c0-e2c3-4ce8-8003-8dd893782f5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:17.349054 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:10:17.349054 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:10:17.350340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981637c0-e2c3-4ce8-8003-8dd893782f5e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:17.363462 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb024ac-52a0-425a-89ca-3f1d75580d81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:17.365769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb024ac-52a0-425a-89ca-3f1d75580d81 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:17.380612 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 15/26] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:17.394202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981637c0-e2c3-4ce8-8003-8dd893782f5e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:17.399908 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-0eb024ac-52a0-425a-89ca-3f1d75580d81 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:10:17.401165 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 12/27] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:10:17.407702 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb024ac-52a0-425a-89ca-3f1d75580d81 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:17.418213 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981637c0-e2c3-4ce8-8003-8dd893782f5e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:17.428672 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c02a0d-cc6d-4222-b6d1-87821945f36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:17.429893 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c02a0d-cc6d-4222-b6d1-87821945f36a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.430174 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb024ac-52a0-425a-89ca-3f1d75580d81 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:17.430621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c02a0d-cc6d-4222-b6d1-87821945f36a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.431152 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c02a0d-cc6d-4222-b6d1-87821945f36a admin admin] PATH_INFO: `/v3/users/5644d459227e4d61a1311eb719e23975` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.432638 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c02a0d-cc6d-4222-b6d1-87821945f36a admin admin] RBAC: Authorizing `identity:get_user(user_id=5644d459227e4d61a1311eb719e23975)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:17.434692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c02a0d-cc6d-4222-b6d1-87821945f36a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:17.441235 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 16/28] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:17 2021] GET /identity/v3/users/5644d459227e4d61a1311eb719e23975 => generated 247 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:17.447972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c02a0d-cc6d-4222-b6d1-87821945f36a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:17.448110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f9287-c866-4421-a0fe-c5907fa22745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:17.448765 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f9287-c866-4421-a0fe-c5907fa22745 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.449049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f9287-c866-4421-a0fe-c5907fa22745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.449325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f9287-c866-4421-a0fe-c5907fa22745 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.455751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f9287-c866-4421-a0fe-c5907fa22745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:17.455751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f9287-c866-4421-a0fe-c5907fa22745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:17.455751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-0d1f9287-c866-4421-a0fe-c5907fa22745 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:17.455751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:10:17.455751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:10:17.455751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f9287-c866-4421-a0fe-c5907fa22745 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:17.465635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c02a0d-cc6d-4222-b6d1-87821945f36a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:17.475905 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac3297-df46-47bd-8005-ea5c9057c5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:17.477066 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac3297-df46-47bd-8005-ea5c9057c5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.477556 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac3297-df46-47bd-8005-ea5c9057c5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.478057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac3297-df46-47bd-8005-ea5c9057c5e6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.479467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac3297-df46-47bd-8005-ea5c9057c5e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:17.481433 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac3297-df46-47bd-8005-ea5c9057c5e6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:17.483274 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 17/29] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:17.488004 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 13/30] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:10:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:17.493713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac3297-df46-47bd-8005-ea5c9057c5e6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:17.495683 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f9287-c866-4421-a0fe-c5907fa22745 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:17.509901 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac3297-df46-47bd-8005-ea5c9057c5e6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:17.513863 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f9287-c866-4421-a0fe-c5907fa22745 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:17.518875 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4d69-c1d7-4f7b-8d18-2b6c95e9b810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:17.519852 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4d69-c1d7-4f7b-8d18-2b6c95e9b810 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.520339 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4d69-c1d7-4f7b-8d18-2b6c95e9b810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.520812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4d69-c1d7-4f7b-8d18-2b6c95e9b810 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.521754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f4d69-c1d7-4f7b-8d18-2b6c95e9b810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:17.522958 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-eb9f4d69-c1d7-4f7b-8d18-2b6c95e9b810 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:17.522958 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:10:17.522958 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:10:17.524679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f4d69-c1d7-4f7b-8d18-2b6c95e9b810 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:17.524914 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c166648-d537-45ef-beaa-38d92493fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:17.525816 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c166648-d537-45ef-beaa-38d92493fc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.526094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c166648-d537-45ef-beaa-38d92493fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.526366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c166648-d537-45ef-beaa-38d92493fc55 admin admin] PATH_INFO: `/v3/domains/default/users/5644d459227e4d61a1311eb719e23975/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.534465 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c166648-d537-45ef-beaa-38d92493fc55 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5644d459227e4d61a1311eb719e23975, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:17.535477 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-2c166648-d537-45ef-beaa-38d92493fc55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:17.535477 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:10:17.535477 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:10:17.537749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c166648-d537-45ef-beaa-38d92493fc55 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:17.762216 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 14/31] 10.222.0.87 () {58 vars in 1382 bytes} [Fri Oct 29 01:10:17 2021] PUT /identity/v3/domains/default/users/5644d459227e4d61a1311eb719e23975/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:10:17.763969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2a1a3-0ad6-4de0-9a83-d86086b96503 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.764263 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2a1a3-0ad6-4de0-9a83-d86086b96503 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.764572 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2a1a3-0ad6-4de0-9a83-d86086b96503 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.770892 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 15/32] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:17 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:17.772684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76673a08-d557-4820-8d0b-7ba769c7ecfd None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.773126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76673a08-d557-4820-8d0b-7ba769c7ecfd None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.773542 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76673a08-d557-4820-8d0b-7ba769c7ecfd None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.775942 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 16/33] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:17.777444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bb428-3b03-46ab-985b-e1f7e10dafa7 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.777961 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bb428-3b03-46ab-985b-e1f7e10dafa7 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.778428 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bb428-3b03-46ab-985b-e1f7e10dafa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.800631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-0b0bb428-3b03-46ab-985b-e1f7e10dafa7 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:17.802521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-0b0bb428-3b03-46ab-985b-e1f7e10dafa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:17.824075 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 18/34] 10.222.0.87 () {60 vars in 1162 bytes} [Fri Oct 29 01:10:17 2021] POST /identity/v3/projects => generated 301 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:10:17.826133 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a8a1a-baf8-40d5-acf5-994125468bdd None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.826669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a8a1a-baf8-40d5-acf5-994125468bdd None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.827152 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a8a1a-baf8-40d5-acf5-994125468bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.848880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-7f9a8a1a-baf8-40d5-acf5-994125468bdd None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:17.850936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7f9a8a1a-baf8-40d5-acf5-994125468bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:17.919272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 19/35] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:17.937729 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 17/36] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:17.962190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a8a1a-baf8-40d5-acf5-994125468bdd None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:17.972836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a8a1a-baf8-40d5-acf5-994125468bdd None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:17.980484 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bb428-3b03-46ab-985b-e1f7e10dafa7 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:17.990861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99606e7c-6b62-40c9-b0e9-72fea9ce01f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:17.993039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99606e7c-6b62-40c9-b0e9-72fea9ce01f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:17.994182 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99606e7c-6b62-40c9-b0e9-72fea9ce01f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:17.994665 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99606e7c-6b62-40c9-b0e9-72fea9ce01f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:17.996410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99606e7c-6b62-40c9-b0e9-72fea9ce01f2 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:17.998084 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-99606e7c-6b62-40c9-b0e9-72fea9ce01f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:17.998084 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:10:17.998084 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:10:18.000690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bb428-3b03-46ab-985b-e1f7e10dafa7 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:18.002205 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99606e7c-6b62-40c9-b0e9-72fea9ce01f2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:18.016046 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782082b-754d-4e29-97ba-10741f6e6d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:18.017125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782082b-754d-4e29-97ba-10741f6e6d8b admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:18.018242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782082b-754d-4e29-97ba-10741f6e6d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:18.018717 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782082b-754d-4e29-97ba-10741f6e6d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:18.019776 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782082b-754d-4e29-97ba-10741f6e6d8b admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:18.021327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-a782082b-754d-4e29-97ba-10741f6e6d8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:18.021327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:10:18.021327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:10:18.022690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782082b-754d-4e29-97ba-10741f6e6d8b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:18.109930 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 20/37] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:10:17 2021] POST /identity/v3/roles => generated 225 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:10:18.145064 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 18/38] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:10:17 2021] POST /identity/v3/roles => generated 219 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:10:18.590932 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d630c52-7d3d-4677-bc3f-96e9c1bd0f07 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:18.591609 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d630c52-7d3d-4677-bc3f-96e9c1bd0f07 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:18.592278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d630c52-7d3d-4677-bc3f-96e9c1bd0f07 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:18.594421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 21/39] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:18.601674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53786db0-85c1-4df3-b48c-d5ebda546dfb None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:18.601957 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53786db0-85c1-4df3-b48c-d5ebda546dfb None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:18.602424 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53786db0-85c1-4df3-b48c-d5ebda546dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:18.622967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-53786db0-85c1-4df3-b48c-d5ebda546dfb None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:18.624179 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-53786db0-85c1-4df3-b48c-d5ebda546dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:18.632360 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 19/40] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:18.656868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d630c52-7d3d-4677-bc3f-96e9c1bd0f07 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:18.668982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d630c52-7d3d-4677-bc3f-96e9c1bd0f07 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:18.673268 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8cef9-c242-40c6-a019-8cea5d38ff75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:18.674512 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8cef9-c242-40c6-a019-8cea5d38ff75 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:18.675013 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8cef9-c242-40c6-a019-8cea5d38ff75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:18.675503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8cef9-c242-40c6-a019-8cea5d38ff75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:18.676406 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8cef9-c242-40c6-a019-8cea5d38ff75 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:18.678041 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8cef9-c242-40c6-a019-8cea5d38ff75 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:18.749188 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 22/41] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:10:18 2021] POST /identity/v3/roles => generated 223 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:10:18.958067 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a7c0d-119e-4564-b8ea-eec1762ccba4 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:18.958407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a7c0d-119e-4564-b8ea-eec1762ccba4 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:18.958627 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a7c0d-119e-4564-b8ea-eec1762ccba4 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:18.960438 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 20/42] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:10:18.966681 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c74d3-9bed-4ee2-8849-bdf11501eba8 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:18.966980 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c74d3-9bed-4ee2-8849-bdf11501eba8 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:18.967266 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c74d3-9bed-4ee2-8849-bdf11501eba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:18.985158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-2a2c74d3-9bed-4ee2-8849-bdf11501eba8 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:18.986395 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-2a2c74d3-9bed-4ee2-8849-bdf11501eba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:18.994390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 23/43] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:19.019425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a7c0d-119e-4564-b8ea-eec1762ccba4 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:19.031852 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a7c0d-119e-4564-b8ea-eec1762ccba4 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:19.036549 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dfae7-0d9f-4e47-9fee-52d065c1365f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:19.037324 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dfae7-0d9f-4e47-9fee-52d065c1365f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:19.037603 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dfae7-0d9f-4e47-9fee-52d065c1365f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:19.037875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dfae7-0d9f-4e47-9fee-52d065c1365f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:19.039057 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dfae7-0d9f-4e47-9fee-52d065c1365f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:19.040788 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dfae7-0d9f-4e47-9fee-52d065c1365f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:19.042367 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 21/44] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:19.048608 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c74d3-9bed-4ee2-8849-bdf11501eba8 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:19.057869 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c74d3-9bed-4ee2-8849-bdf11501eba8 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:19.062368 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940daf3-e5bf-43e6-8d22-5edf757b784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:19.063026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940daf3-e5bf-43e6-8d22-5edf757b784c admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:19.063312 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940daf3-e5bf-43e6-8d22-5edf757b784c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:19.063591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940daf3-e5bf-43e6-8d22-5edf757b784c admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:19.064903 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940daf3-e5bf-43e6-8d22-5edf757b784c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:19.066926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940daf3-e5bf-43e6-8d22-5edf757b784c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:19.145412 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 24/45] 10.222.0.87 () {60 vars in 1162 bytes} [Fri Oct 29 01:10:19 2021] POST /identity/v3/projects => generated 312 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:10:20.235992 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a98aa1-d6d7-4941-9af1-cc807809c636 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:20.236488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a98aa1-d6d7-4941-9af1-cc807809c636 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:20.236488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a98aa1-d6d7-4941-9af1-cc807809c636 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:20.238419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 22/46] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:20.244562 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bbf61-2b28-44cd-a8c9-066e1ec3f3b6 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:20.244982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bbf61-2b28-44cd-a8c9-066e1ec3f3b6 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:20.245234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bbf61-2b28-44cd-a8c9-066e1ec3f3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:20.262894 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d02bbf61-2b28-44cd-a8c9-066e1ec3f3b6 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:20.264102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d02bbf61-2b28-44cd-a8c9-066e1ec3f3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:20.323487 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 25/47] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:20.348956 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a98aa1-d6d7-4941-9af1-cc807809c636 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:20.361162 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a98aa1-d6d7-4941-9af1-cc807809c636 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:20.365624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a3483-bbeb-4f92-ad1c-55d4217dab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:20.366408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a3483-bbeb-4f92-ad1c-55d4217dab63 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:20.366693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a3483-bbeb-4f92-ad1c-55d4217dab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:20.366970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a3483-bbeb-4f92-ad1c-55d4217dab63 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:20.378092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a3483-bbeb-4f92-ad1c-55d4217dab63 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:20.414065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-415a3483-bbeb-4f92-ad1c-55d4217dab63 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:10:20.414065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 23/48] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:10:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:20.414427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bbf61-2b28-44cd-a8c9-066e1ec3f3b6 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:20.414427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bbf61-2b28-44cd-a8c9-066e1ec3f3b6 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:20.414427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3420b-e5dc-478d-9939-f7b14f22d541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:20.414427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3420b-e5dc-478d-9939-f7b14f22d541 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:20.414816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3420b-e5dc-478d-9939-f7b14f22d541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:20.414816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3420b-e5dc-478d-9939-f7b14f22d541 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:20.414816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3420b-e5dc-478d-9939-f7b14f22d541 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:20.414816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3420b-e5dc-478d-9939-f7b14f22d541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:20.414816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3420b-e5dc-478d-9939-f7b14f22d541 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:20.420665 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 26/49] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:20.427939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a3483-bbeb-4f92-ad1c-55d4217dab63 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:20.441715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a3483-bbeb-4f92-ad1c-55d4217dab63 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:20.446904 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d99ba-ed7e-4c85-aadf-a1a5348a2282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:20.447928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d99ba-ed7e-4c85-aadf-a1a5348a2282 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:20.448215 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d99ba-ed7e-4c85-aadf-a1a5348a2282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:20.448495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d99ba-ed7e-4c85-aadf-a1a5348a2282 admin admin] PATH_INFO: `/v3/users/5644d459227e4d61a1311eb719e23975` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:20.449723 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d99ba-ed7e-4c85-aadf-a1a5348a2282 admin admin] RBAC: Authorizing `identity:get_user(user_id=5644d459227e4d61a1311eb719e23975)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:20.451694 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d99ba-ed7e-4c85-aadf-a1a5348a2282 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:20.453539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 24/50] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:20 2021] GET /identity/v3/users/5644d459227e4d61a1311eb719e23975 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:20.460516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3420b-e5dc-478d-9939-f7b14f22d541 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:20.470177 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3420b-e5dc-478d-9939-f7b14f22d541 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:20.474764 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3edc0b-d1b7-45d8-9b94-080b8f6baada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:20.475547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3edc0b-d1b7-45d8-9b94-080b8f6baada admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:20.475875 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3edc0b-d1b7-45d8-9b94-080b8f6baada admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:20.476159 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3edc0b-d1b7-45d8-9b94-080b8f6baada admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:20.477360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3edc0b-d1b7-45d8-9b94-080b8f6baada admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:20.479068 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3edc0b-d1b7-45d8-9b94-080b8f6baada admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:20.480698 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 27/51] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:20.491807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d99ba-ed7e-4c85-aadf-a1a5348a2282 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:20.497597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d99ba-ed7e-4c85-aadf-a1a5348a2282 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:20.503073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35d157-b4ab-4417-bd93-7b97107edf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:20.503721 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35d157-b4ab-4417-bd93-7b97107edf94 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:20.504028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35d157-b4ab-4417-bd93-7b97107edf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:20.504303 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35d157-b4ab-4417-bd93-7b97107edf94 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:20.505149 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35d157-b4ab-4417-bd93-7b97107edf94 admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.domain.id=default, user.id=5644d459227e4d61a1311eb719e23975) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:20.505462 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35d157-b4ab-4417-bd93-7b97107edf94 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:20.507365 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35d157-b4ab-4417-bd93-7b97107edf94 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:20.513530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 25/52] 10.222.0.87 () {56 vars in 1343 bytes} [Fri Oct 29 01:10:20 2021] GET /identity/v3/role_assignments?user.id=5644d459227e4d61a1311eb719e23975&scope.domain.id=default&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:21.427357 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64cf1d-99b6-4d62-8b33-3db031d475fe None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:21.427980 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64cf1d-99b6-4d62-8b33-3db031d475fe None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:21.427980 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64cf1d-99b6-4d62-8b33-3db031d475fe None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:21.429731 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 28/53] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:21.435352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90879f5d-a346-4e34-88ba-6d3f119c478d None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:21.435786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90879f5d-a346-4e34-88ba-6d3f119c478d None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:21.435932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90879f5d-a346-4e34-88ba-6d3f119c478d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:21.456287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-90879f5d-a346-4e34-88ba-6d3f119c478d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:21.457523 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-90879f5d-a346-4e34-88ba-6d3f119c478d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:21.465137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 26/54] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:21.489567 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64cf1d-99b6-4d62-8b33-3db031d475fe None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:21.501427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64cf1d-99b6-4d62-8b33-3db031d475fe None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:21.505707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f12bb3-4013-4ade-84d2-2511e5aac043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:21.506475 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f12bb3-4013-4ade-84d2-2511e5aac043 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:21.506759 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f12bb3-4013-4ade-84d2-2511e5aac043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:21.507037 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f12bb3-4013-4ade-84d2-2511e5aac043 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:21.508248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f12bb3-4013-4ade-84d2-2511e5aac043 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:21.509927 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f12bb3-4013-4ade-84d2-2511e5aac043 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:21.511479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 29/55] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:21.517703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90879f5d-a346-4e34-88ba-6d3f119c478d None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:21.527981 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90879f5d-a346-4e34-88ba-6d3f119c478d None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:21.534434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2733f-5fbd-4fdf-ac7c-1219c661e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:21.535092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2733f-5fbd-4fdf-ac7c-1219c661e6db admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:21.535538 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2733f-5fbd-4fdf-ac7c-1219c661e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:21.536106 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2733f-5fbd-4fdf-ac7c-1219c661e6db admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:21.536852 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2733f-5fbd-4fdf-ac7c-1219c661e6db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:21.537864 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-74b2733f-5fbd-4fdf-ac7c-1219c661e6db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:21.537864 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:10:21.537864 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:10:21.539142 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2733f-5fbd-4fdf-ac7c-1219c661e6db admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:21.612192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 27/56] 10.222.0.87 () {60 vars in 1161 bytes} [Fri Oct 29 01:10:21 2021] POST /identity/v3/projects => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:10:23.867097 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293c33f-1e26-465b-bfd7-c8c0bdbc152e None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:23.867651 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293c33f-1e26-465b-bfd7-c8c0bdbc152e None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:23.867651 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293c33f-1e26-465b-bfd7-c8c0bdbc152e None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:23.870885 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 30/57] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:23.875324 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4eba9b-d58f-4455-b92b-1385749f7a80 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:23.875784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4eba9b-d58f-4455-b92b-1385749f7a80 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:23.875924 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4eba9b-d58f-4455-b92b-1385749f7a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:23.895429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ab4eba9b-d58f-4455-b92b-1385749f7a80 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:23.897092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ab4eba9b-d58f-4455-b92b-1385749f7a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:23.955166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 28/58] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:23.980764 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293c33f-1e26-465b-bfd7-c8c0bdbc152e None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:23.992763 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293c33f-1e26-465b-bfd7-c8c0bdbc152e None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:23.996902 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed90a3f-dfcd-46f6-ac36-94fda8406e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:23.997670 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed90a3f-dfcd-46f6-ac36-94fda8406e42 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:23.997948 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed90a3f-dfcd-46f6-ac36-94fda8406e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:23.998217 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed90a3f-dfcd-46f6-ac36-94fda8406e42 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:23.999383 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed90a3f-dfcd-46f6-ac36-94fda8406e42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:24.001093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed90a3f-dfcd-46f6-ac36-94fda8406e42 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:24.002887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 31/59] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:24.008789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4eba9b-d58f-4455-b92b-1385749f7a80 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:24.018667 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4eba9b-d58f-4455-b92b-1385749f7a80 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:24.023159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd074807-1627-42d0-937e-e87f0deb143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:24.023850 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd074807-1627-42d0-937e-e87f0deb143e admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:24.024140 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd074807-1627-42d0-937e-e87f0deb143e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:24.024419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd074807-1627-42d0-937e-e87f0deb143e admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:24.025141 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd074807-1627-42d0-937e-e87f0deb143e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:24.026166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-fd074807-1627-42d0-937e-e87f0deb143e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:24.026166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:10:24.026166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:10:24.027409 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd074807-1627-42d0-937e-e87f0deb143e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:24.125613 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 29/60] 10.222.0.87 () {60 vars in 1153 bytes} [Fri Oct 29 01:10:24 2021] POST /identity/v3/users => generated 275 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:10:27.570001 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93fd7c-0841-434f-9967-29215284eee4 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.570817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c2139-0958-4f3d-8ab4-265af9d39856 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.571233 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93fd7c-0841-434f-9967-29215284eee4 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.571442 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93fd7c-0841-434f-9967-29215284eee4 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.571968 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c2139-0958-4f3d-8ab4-265af9d39856 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.572445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c2139-0958-4f3d-8ab4-265af9d39856 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.573651 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 32/61] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:27.574528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 30/62] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:27.581194 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f809b71-86f2-4eb4-8d17-6c7ae759b1e2 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.581809 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f809b71-86f2-4eb4-8d17-6c7ae759b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.582306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f809b71-86f2-4eb4-8d17-6c7ae759b1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.585352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d3eda-8485-47e2-a342-e292a96762c6 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.585866 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d3eda-8485-47e2-a342-e292a96762c6 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.586347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d3eda-8485-47e2-a342-e292a96762c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.604254 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-4f809b71-86f2-4eb4-8d17-6c7ae759b1e2 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:27.605464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4f809b71-86f2-4eb4-8d17-6c7ae759b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:27.611974 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-943d3eda-8485-47e2-a342-e292a96762c6 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:27.613163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-943d3eda-8485-47e2-a342-e292a96762c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:27.622118 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 33/63] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:27.632226 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 31/64] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:27.674877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f809b71-86f2-4eb4-8d17-6c7ae759b1e2 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:27.681082 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d3eda-8485-47e2-a342-e292a96762c6 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:27.686947 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f809b71-86f2-4eb4-8d17-6c7ae759b1e2 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:27.695241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d3eda-8485-47e2-a342-e292a96762c6 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:27.697910 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b49be-e418-4cdb-a7b0-e6e41306b50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:27.698727 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b49be-e418-4cdb-a7b0-e6e41306b50c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.699008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b49be-e418-4cdb-a7b0-e6e41306b50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.699282 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b49be-e418-4cdb-a7b0-e6e41306b50c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.708122 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ffcd2-0ce3-42b5-8f45-d349f713caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:27.708933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ffcd2-0ce3-42b5-8f45-d349f713caf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.709217 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ffcd2-0ce3-42b5-8f45-d349f713caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.709488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ffcd2-0ce3-42b5-8f45-d349f713caf9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.721531 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b49be-e418-4cdb-a7b0-e6e41306b50c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:27.728442 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-9e3b49be-e418-4cdb-a7b0-e6e41306b50c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:27.729683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 34/65] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:27.736843 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b49be-e418-4cdb-a7b0-e6e41306b50c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:27.744431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ffcd2-0ce3-42b5-8f45-d349f713caf9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:27.756139 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-011ffcd2-0ce3-42b5-8f45-d349f713caf9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:10:27.758939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b49be-e418-4cdb-a7b0-e6e41306b50c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:27.761056 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 32/66] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:10:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:27.768947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ffcd2-0ce3-42b5-8f45-d349f713caf9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:27.774328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196aa204-fa7c-4665-9d32-263a81f5538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:27.775011 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196aa204-fa7c-4665-9d32-263a81f5538f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.775296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196aa204-fa7c-4665-9d32-263a81f5538f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.775573 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196aa204-fa7c-4665-9d32-263a81f5538f admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.776368 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196aa204-fa7c-4665-9d32-263a81f5538f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:27.776836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196aa204-fa7c-4665-9d32-263a81f5538f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:27.778631 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196aa204-fa7c-4665-9d32-263a81f5538f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:27.780452 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ffcd2-0ce3-42b5-8f45-d349f713caf9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:27.788522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 35/67] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:27.794803 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ffab1-79ce-4deb-98bd-9f3e00a56915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:27.794965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196aa204-fa7c-4665-9d32-263a81f5538f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:27.795860 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ffab1-79ce-4deb-98bd-9f3e00a56915 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.796313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ffab1-79ce-4deb-98bd-9f3e00a56915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.796831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ffab1-79ce-4deb-98bd-9f3e00a56915 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.797859 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ffab1-79ce-4deb-98bd-9f3e00a56915 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:27.798926 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ffab1-79ce-4deb-98bd-9f3e00a56915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:27.800754 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ffab1-79ce-4deb-98bd-9f3e00a56915 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:27.810206 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 33/68] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:27.815374 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196aa204-fa7c-4665-9d32-263a81f5538f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:27.817245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ffab1-79ce-4deb-98bd-9f3e00a56915 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:27.828153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ffab1-79ce-4deb-98bd-9f3e00a56915 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:27.829867 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f262578-bfd1-410b-bc9b-e8ad858371e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:27.830850 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262578-bfd1-410b-bc9b-e8ad858371e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.831220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262578-bfd1-410b-bc9b-e8ad858371e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.831500 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262578-bfd1-410b-bc9b-e8ad858371e3 admin admin] PATH_INFO: `/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.834045 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a2ca-04aa-4189-b664-c3a9a18ce20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:27.835126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a2ca-04aa-4189-b664-c3a9a18ce20d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.835585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a2ca-04aa-4189-b664-c3a9a18ce20d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.836061 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a2ca-04aa-4189-b664-c3a9a18ce20d admin admin] PATH_INFO: `/v3/users/5644d459227e4d61a1311eb719e23975` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.837798 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a2ca-04aa-4189-b664-c3a9a18ce20d admin admin] RBAC: Authorizing `identity:get_user(user_id=5644d459227e4d61a1311eb719e23975)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:27.839923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a2ca-04aa-4189-b664-c3a9a18ce20d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:27.841908 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 34/69] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:27 2021] GET /identity/v3/users/5644d459227e4d61a1311eb719e23975 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:27.843413 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c942f-09b2-41fc-8e35-a56da0200755 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.843929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c942f-09b2-41fc-8e35-a56da0200755 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.844372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c942f-09b2-41fc-8e35-a56da0200755 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.847214 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 35/70] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:27.852746 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c942f-09b2-41fc-8e35-a56da0200755 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:27.856285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f262578-bfd1-410b-bc9b-e8ad858371e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ed740fcfd474bcb94f1482aedaeb9bd)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:27.858787 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f262578-bfd1-410b-bc9b-e8ad858371e3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:27.861591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 36/71] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:27 2021] GET /identity/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd => generated 275 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:27.866439 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c942f-09b2-41fc-8e35-a56da0200755 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:27.867939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6c59b-3ad7-48a9-b0e1-326d4f40b94d None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.868510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6c59b-3ad7-48a9-b0e1-326d4f40b94d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.869360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6c59b-3ad7-48a9-b0e1-326d4f40b94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.877934 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9f52b-e025-4cb4-84c0-ca0ea75f5024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:27.878607 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9f52b-e025-4cb4-84c0-ca0ea75f5024 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.878891 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9f52b-e025-4cb4-84c0-ca0ea75f5024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.879170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9f52b-e025-4cb4-84c0-ca0ea75f5024 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.887794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9f52b-e025-4cb4-84c0-ca0ea75f5024 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:27.889855 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9f52b-e025-4cb4-84c0-ca0ea75f5024 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:27.893856 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-97f6c59b-3ad7-48a9-b0e1-326d4f40b94d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:27.895174 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-97f6c59b-3ad7-48a9-b0e1-326d4f40b94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:27.900218 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 36/72] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:27.901230 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9f52b-e025-4cb4-84c0-ca0ea75f5024 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:27.909793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 37/73] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:27.910873 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6c59b-3ad7-48a9-b0e1-326d4f40b94d None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:27.920436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9f52b-e025-4cb4-84c0-ca0ea75f5024 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:27.920629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6c59b-3ad7-48a9-b0e1-326d4f40b94d None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:27.927919 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef31fa-38db-4497-a3b3-d958c27854ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:27.929408 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef31fa-38db-4497-a3b3-d958c27854ba admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.929558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc78b40-2726-492a-a443-0c33ef6cc550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:27.930008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef31fa-38db-4497-a3b3-d958c27854ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.930483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef31fa-38db-4497-a3b3-d958c27854ba admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.930674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc78b40-2726-492a-a443-0c33ef6cc550 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.931251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc78b40-2726-492a-a443-0c33ef6cc550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.931787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc78b40-2726-492a-a443-0c33ef6cc550 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.932238 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef31fa-38db-4497-a3b3-d958c27854ba admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:27.935756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef31fa-38db-4497-a3b3-d958c27854ba admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:27.936473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 38/74] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:27 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:27.949947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc78b40-2726-492a-a443-0c33ef6cc550 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:27.950255 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef31fa-38db-4497-a3b3-d958c27854ba admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:27.951780 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc78b40-2726-492a-a443-0c33ef6cc550 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:27.961520 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef31fa-38db-4497-a3b3-d958c27854ba admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:27.961830 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 37/75] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:27.962796 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc78b40-2726-492a-a443-0c33ef6cc550 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:27.973528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc78b40-2726-492a-a443-0c33ef6cc550 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:27.973690 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a7a09-4c4c-4717-b4c8-81445eeacaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:27.974733 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a7a09-4c4c-4717-b4c8-81445eeacaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.975122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a7a09-4c4c-4717-b4c8-81445eeacaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.975498 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a7a09-4c4c-4717-b4c8-81445eeacaf2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.979056 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234f09a-e41e-4140-9e48-3a20a2c4d544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:27.979911 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234f09a-e41e-4140-9e48-3a20a2c4d544 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:27.980350 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234f09a-e41e-4140-9e48-3a20a2c4d544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:27.980767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234f09a-e41e-4140-9e48-3a20a2c4d544 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:27.981777 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234f09a-e41e-4140-9e48-3a20a2c4d544 admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=3f445e69c8094e37889545aefb002e28, user.id=5644d459227e4d61a1311eb719e23975) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:27.982307 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234f09a-e41e-4140-9e48-3a20a2c4d544 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:27.984443 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234f09a-e41e-4140-9e48-3a20a2c4d544 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:27.987588 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a7a09-4c4c-4717-b4c8-81445eeacaf2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:27.990779 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 38/76] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:10:27 2021] GET /identity/v3/role_assignments?user.id=5644d459227e4d61a1311eb719e23975&scope.project.id=3f445e69c8094e37889545aefb002e28&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:27.996572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-573a7a09-4c4c-4717-b4c8-81445eeacaf2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 01:10:27.996929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234f09a-e41e-4140-9e48-3a20a2c4d544 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.003760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 39/77] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:10:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:28.005405 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a7a09-4c4c-4717-b4c8-81445eeacaf2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.013860 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234f09a-e41e-4140-9e48-3a20a2c4d544 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.017322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a7a09-4c4c-4717-b4c8-81445eeacaf2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.018928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705862e-2f82-4a77-8474-dca90c29b6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.019906 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705862e-2f82-4a77-8474-dca90c29b6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.020131 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705862e-2f82-4a77-8474-dca90c29b6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.020558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705862e-2f82-4a77-8474-dca90c29b6f8 admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.021802 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705862e-2f82-4a77-8474-dca90c29b6f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:28.022612 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b49a-a1cf-4ad3-9374-62edbe726a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.023398 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b49a-a1cf-4ad3-9374-62edbe726a27 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.023841 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b49a-a1cf-4ad3-9374-62edbe726a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.023944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705862e-2f82-4a77-8474-dca90c29b6f8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:28.024285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b49a-a1cf-4ad3-9374-62edbe726a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.025364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2b49a-a1cf-4ad3-9374-62edbe726a27 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:28.025861 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 39/78] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:27 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:28.025973 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2b49a-a1cf-4ad3-9374-62edbe726a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:28.026951 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980aba-a2ae-4ed8-ae76-040eead776c3 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.027317 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980aba-a2ae-4ed8-ae76-040eead776c3 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.027414 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2b49a-a1cf-4ad3-9374-62edbe726a27 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:28.027596 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980aba-a2ae-4ed8-ae76-040eead776c3 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.036147 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 40/79] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:28 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:28.037119 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16980aba-a2ae-4ed8-ae76-040eead776c3 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.044689 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 40/80] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:10:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:28.049190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c7884-2761-46f8-b409-f9366437b916 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.049491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c7884-2761-46f8-b409-f9366437b916 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.049840 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c7884-2761-46f8-b409-f9366437b916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.057325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16980aba-a2ae-4ed8-ae76-040eead776c3 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.062163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b1f3d-73bd-41cf-bb47-2748b9b6357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.062825 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b1f3d-73bd-41cf-bb47-2748b9b6357c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.063107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b1f3d-73bd-41cf-bb47-2748b9b6357c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.063384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b1f3d-73bd-41cf-bb47-2748b9b6357c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.064804 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b1f3d-73bd-41cf-bb47-2748b9b6357c admin admin] RBAC: Adding query filter params (role.id=999d570f97da49269327a60c1acf21d2, scope.project.id=3f445e69c8094e37889545aefb002e28, user.id=3ed740fcfd474bcb94f1482aedaeb9bd) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:28.065118 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b1f3d-73bd-41cf-bb47-2748b9b6357c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:28.067032 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b1f3d-73bd-41cf-bb47-2748b9b6357c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:28.071313 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-191c7884-2761-46f8-b409-f9366437b916 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:28.072686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-191c7884-2761-46f8-b409-f9366437b916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:28.073779 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 41/81] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:10:28 2021] GET /identity/v3/role_assignments?user.id=3ed740fcfd474bcb94f1482aedaeb9bd&scope.project.id=3f445e69c8094e37889545aefb002e28&role.id=999d570f97da49269327a60c1acf21d2 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:28.074640 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b1f3d-73bd-41cf-bb47-2748b9b6357c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.085384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b1f3d-73bd-41cf-bb47-2748b9b6357c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.090204 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4d061-3c91-42a7-8d66-2a2a31e90e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.091081 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4d061-3c91-42a7-8d66-2a2a31e90e6e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.091366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4d061-3c91-42a7-8d66-2a2a31e90e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.091639 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4d061-3c91-42a7-8d66-2a2a31e90e6e admin admin] PATH_INFO: `/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.097573 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 41/82] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:28.097882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4d061-3c91-42a7-8d66-2a2a31e90e6e admin admin] RBAC: Authorizing `identity:get_user(user_id=3ed740fcfd474bcb94f1482aedaeb9bd)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:28.108582 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4d061-3c91-42a7-8d66-2a2a31e90e6e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:28.110721 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 42/83] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:28 2021] GET /identity/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:28.117430 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c7884-2761-46f8-b409-f9366437b916 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.129262 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4d061-3c91-42a7-8d66-2a2a31e90e6e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.133786 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c7884-2761-46f8-b409-f9366437b916 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.140004 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4d061-3c91-42a7-8d66-2a2a31e90e6e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.145641 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419406d-cc9d-437c-a3ad-67ed40bf6e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.145955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869cd09-9de1-4faa-a143-7ba6326305a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.146311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869cd09-9de1-4faa-a143-7ba6326305a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.146473 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419406d-cc9d-437c-a3ad-67ed40bf6e57 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.146618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869cd09-9de1-4faa-a143-7ba6326305a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.146758 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419406d-cc9d-437c-a3ad-67ed40bf6e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.146912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869cd09-9de1-4faa-a143-7ba6326305a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.147071 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419406d-cc9d-437c-a3ad-67ed40bf6e57 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.148317 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419406d-cc9d-437c-a3ad-67ed40bf6e57 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:28.150115 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419406d-cc9d-437c-a3ad-67ed40bf6e57 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:28.152224 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 43/84] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:28.158734 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869cd09-9de1-4faa-a143-7ba6326305a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:28.159705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419406d-cc9d-437c-a3ad-67ed40bf6e57 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.168963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869cd09-9de1-4faa-a143-7ba6326305a1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:28.170217 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419406d-cc9d-437c-a3ad-67ed40bf6e57 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.180933 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 42/85] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:28.182777 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ec4d4-5199-403d-be43-6a443472ad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.183505 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ec4d4-5199-403d-be43-6a443472ad6f admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.183834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ec4d4-5199-403d-be43-6a443472ad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.184114 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ec4d4-5199-403d-be43-6a443472ad6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.184859 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ec4d4-5199-403d-be43-6a443472ad6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:28.186918 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ec4d4-5199-403d-be43-6a443472ad6f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:28.187268 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869cd09-9de1-4faa-a143-7ba6326305a1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.197744 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869cd09-9de1-4faa-a143-7ba6326305a1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.202417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec3d8f-cac5-495e-8995-e68e14d4f1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.203289 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3d8f-cac5-495e-8995-e68e14d4f1bf admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.203572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3d8f-cac5-495e-8995-e68e14d4f1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.203886 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3d8f-cac5-495e-8995-e68e14d4f1bf admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.205673 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec3d8f-cac5-495e-8995-e68e14d4f1bf admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:28.208218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec3d8f-cac5-495e-8995-e68e14d4f1bf admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:28.210596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 43/86] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:28 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:28.217205 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec3d8f-cac5-495e-8995-e68e14d4f1bf admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.227831 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec3d8f-cac5-495e-8995-e68e14d4f1bf admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.232717 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035e37a-54d3-4046-9742-3366505c748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.233401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035e37a-54d3-4046-9742-3366505c748c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.233688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035e37a-54d3-4046-9742-3366505c748c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.233970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035e37a-54d3-4046-9742-3366505c748c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.234899 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035e37a-54d3-4046-9742-3366505c748c admin admin] RBAC: Adding query filter params (role.id=4891c5dc7fab4407b20b35b4e6da58a8, scope.project.id=3f445e69c8094e37889545aefb002e28, user.id=3ed740fcfd474bcb94f1482aedaeb9bd) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:28.235216 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035e37a-54d3-4046-9742-3366505c748c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:28.237090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-a035e37a-54d3-4046-9742-3366505c748c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:28.237090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:10:28.237090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:10:28.238172 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035e37a-54d3-4046-9742-3366505c748c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:28.247930 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 44/87] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:10:28 2021] GET /identity/v3/role_assignments?user.id=3ed740fcfd474bcb94f1482aedaeb9bd&scope.project.id=3f445e69c8094e37889545aefb002e28&role.id=4891c5dc7fab4407b20b35b4e6da58a8 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:28.429341 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae366e8c-1622-4d01-bd69-c83f490812c6 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.429644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae366e8c-1622-4d01-bd69-c83f490812c6 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.429918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae366e8c-1622-4d01-bd69-c83f490812c6 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.431951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 45/88] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:10:28.435442 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 44/89] 10.222.0.87 () {60 vars in 1162 bytes} [Fri Oct 29 01:10:28 2021] POST /identity/v3/projects => generated 302 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:10:28.445506 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774ff04-b1cc-43ba-a611-94925bd91e6b None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.445833 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774ff04-b1cc-43ba-a611-94925bd91e6b None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.446054 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774ff04-b1cc-43ba-a611-94925bd91e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.466516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-6774ff04-b1cc-43ba-a611-94925bd91e6b None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:28.467768 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6774ff04-b1cc-43ba-a611-94925bd91e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:28.542310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 46/90] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:28.569503 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ec4d4-5199-403d-be43-6a443472ad6f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.585839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ec4d4-5199-403d-be43-6a443472ad6f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.601384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a07be9-f53c-49a5-a6aa-72ae0ec2e96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.602225 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a07be9-f53c-49a5-a6aa-72ae0ec2e96e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.602511 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a07be9-f53c-49a5-a6aa-72ae0ec2e96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.602789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a07be9-f53c-49a5-a6aa-72ae0ec2e96e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.633569 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a07be9-f53c-49a5-a6aa-72ae0ec2e96e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:28.648046 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-f5a07be9-f53c-49a5-a6aa-72ae0ec2e96e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:28.650244 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 45/91] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:28.656846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774ff04-b1cc-43ba-a611-94925bd91e6b None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.671422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774ff04-b1cc-43ba-a611-94925bd91e6b None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.679935 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c6d85-84f2-48aa-a880-e6f8c8d1d177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.680603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6d85-84f2-48aa-a880-e6f8c8d1d177 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.680890 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6d85-84f2-48aa-a880-e6f8c8d1d177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.681171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6d85-84f2-48aa-a880-e6f8c8d1d177 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.681968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c6d85-84f2-48aa-a880-e6f8c8d1d177 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:28.682278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c6d85-84f2-48aa-a880-e6f8c8d1d177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:28.684009 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c6d85-84f2-48aa-a880-e6f8c8d1d177 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:28.694562 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 47/92] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:28.700848 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a07be9-f53c-49a5-a6aa-72ae0ec2e96e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.713289 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a07be9-f53c-49a5-a6aa-72ae0ec2e96e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.718111 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae4753-898b-4bda-bdd7-8e89aa5afc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.719192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae4753-898b-4bda-bdd7-8e89aa5afc5d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.719701 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae4753-898b-4bda-bdd7-8e89aa5afc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.720242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae4753-898b-4bda-bdd7-8e89aa5afc5d admin admin] PATH_INFO: `/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.722334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae4753-898b-4bda-bdd7-8e89aa5afc5d admin admin] RBAC: Authorizing `identity:get_user(user_id=3ed740fcfd474bcb94f1482aedaeb9bd)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:28.724740 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae4753-898b-4bda-bdd7-8e89aa5afc5d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:28.726587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 46/93] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:28 2021] GET /identity/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:28.732727 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c6d85-84f2-48aa-a880-e6f8c8d1d177 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.744320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c6d85-84f2-48aa-a880-e6f8c8d1d177 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.749358 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ea739-6a88-4fb1-b088-3aa3a66ca0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.750307 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ea739-6a88-4fb1-b088-3aa3a66ca0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.750819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ea739-6a88-4fb1-b088-3aa3a66ca0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.751876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ea739-6a88-4fb1-b088-3aa3a66ca0f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.762441 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ea739-6a88-4fb1-b088-3aa3a66ca0f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:28.764648 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ea739-6a88-4fb1-b088-3aa3a66ca0f7 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:28.776827 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 48/94] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:10:28.783767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae4753-898b-4bda-bdd7-8e89aa5afc5d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.794958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae4753-898b-4bda-bdd7-8e89aa5afc5d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.800965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096d59b-dce8-4c04-87e3-001116c66362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.802110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096d59b-dce8-4c04-87e3-001116c66362 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.802594 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096d59b-dce8-4c04-87e3-001116c66362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.803139 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096d59b-dce8-4c04-87e3-001116c66362 admin admin] PATH_INFO: `/v3/projects/7c7e49aee6344a67a4231a44e2583090` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.804642 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096d59b-dce8-4c04-87e3-001116c66362 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c7e49aee6344a67a4231a44e2583090)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:28.806960 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096d59b-dce8-4c04-87e3-001116c66362 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:28.809037 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 47/95] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:28 2021] GET /identity/v3/projects/7c7e49aee6344a67a4231a44e2583090 => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:28.818124 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ea739-6a88-4fb1-b088-3aa3a66ca0f7 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:28.827888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ea739-6a88-4fb1-b088-3aa3a66ca0f7 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:28.832991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b9705-85f0-494f-a789-373d8da02468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:28.833704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b9705-85f0-494f-a789-373d8da02468 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:28.834037 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b9705-85f0-494f-a789-373d8da02468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:28.834406 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b9705-85f0-494f-a789-373d8da02468 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:28.835254 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b9705-85f0-494f-a789-373d8da02468 admin admin] RBAC: Adding query filter params (role.id=999d570f97da49269327a60c1acf21d2, scope.project.id=7c7e49aee6344a67a4231a44e2583090, user.id=3ed740fcfd474bcb94f1482aedaeb9bd) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:28.835616 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b9705-85f0-494f-a789-373d8da02468 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:28.837576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b9705-85f0-494f-a789-373d8da02468 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:28.844103 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 49/96] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:10:28 2021] GET /identity/v3/role_assignments?user.id=3ed740fcfd474bcb94f1482aedaeb9bd&scope.project.id=7c7e49aee6344a67a4231a44e2583090&role.id=999d570f97da49269327a60c1acf21d2 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:30.794548 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5f705-79fa-4c91-9d63-73c09483e50c None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:30.795568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5f705-79fa-4c91-9d63-73c09483e50c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:30.796094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5f705-79fa-4c91-9d63-73c09483e50c None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:30.798660 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 48/97] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:30.805967 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395702e-6115-4c5a-b860-28ac3ea622f2 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:30.806479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395702e-6115-4c5a-b860-28ac3ea622f2 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:30.806555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395702e-6115-4c5a-b860-28ac3ea622f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:30.825708 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-5395702e-6115-4c5a-b860-28ac3ea622f2 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:30.826914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-5395702e-6115-4c5a-b860-28ac3ea622f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:30.843182 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 50/98] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:30.884287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5f705-79fa-4c91-9d63-73c09483e50c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:30.902044 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5f705-79fa-4c91-9d63-73c09483e50c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:30.906719 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e539af5-b13f-4b03-9dbe-a76717fe2500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:30.908331 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e539af5-b13f-4b03-9dbe-a76717fe2500 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:30.908838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e539af5-b13f-4b03-9dbe-a76717fe2500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:30.909287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e539af5-b13f-4b03-9dbe-a76717fe2500 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:30.925851 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e539af5-b13f-4b03-9dbe-a76717fe2500 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:30.929422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695df44-e53d-4e0d-a109-4b8d3ed5e94e None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:30.929915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695df44-e53d-4e0d-a109-4b8d3ed5e94e None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:30.930391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695df44-e53d-4e0d-a109-4b8d3ed5e94e None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:30.932398 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 51/99] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:10:30.938394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ab305-e7f8-4cf9-aa44-817305bbc7d8 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:30.939399 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ab305-e7f8-4cf9-aa44-817305bbc7d8 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:30.939883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ab305-e7f8-4cf9-aa44-817305bbc7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:30.949435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-5e539af5-b13f-4b03-9dbe-a76717fe2500 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:10:30.953127 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 49/100] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:10:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:30.960355 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e539af5-b13f-4b03-9dbe-a76717fe2500 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:30.961051 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d77ab305-e7f8-4cf9-aa44-817305bbc7d8 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:30.962457 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d77ab305-e7f8-4cf9-aa44-817305bbc7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:30.971113 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e539af5-b13f-4b03-9dbe-a76717fe2500 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:30.979945 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 52/101] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:30.981485 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29941c8-2523-4f66-994d-8be016f2f5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:30.982161 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29941c8-2523-4f66-994d-8be016f2f5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:30.982445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29941c8-2523-4f66-994d-8be016f2f5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:30.982722 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29941c8-2523-4f66-994d-8be016f2f5e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:30.983506 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29941c8-2523-4f66-994d-8be016f2f5e7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:30.983852 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29941c8-2523-4f66-994d-8be016f2f5e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:30.985457 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29941c8-2523-4f66-994d-8be016f2f5e7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:30.996320 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 50/102] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:31.003171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ab305-e7f8-4cf9-aa44-817305bbc7d8 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.013087 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ab305-e7f8-4cf9-aa44-817305bbc7d8 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.015087 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29941c8-2523-4f66-994d-8be016f2f5e7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.025198 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e239a-7509-4818-a684-6c272c97301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.026130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e239a-7509-4818-a684-6c272c97301f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.026415 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e239a-7509-4818-a684-6c272c97301f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.026695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e239a-7509-4818-a684-6c272c97301f admin admin] PATH_INFO: `/v3/users/5644d459227e4d61a1311eb719e23975` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.031408 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e239a-7509-4818-a684-6c272c97301f admin admin] RBAC: Authorizing `identity:get_user(user_id=5644d459227e4d61a1311eb719e23975)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.036601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29941c8-2523-4f66-994d-8be016f2f5e7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.037469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e239a-7509-4818-a684-6c272c97301f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.039342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 53/103] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/users/5644d459227e4d61a1311eb719e23975 => generated 247 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:31.045889 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e239a-7509-4818-a684-6c272c97301f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.050217 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cbe28-ec45-4bdc-a6a5-04eeb488383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.051040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cbe28-ec45-4bdc-a6a5-04eeb488383e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.051334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cbe28-ec45-4bdc-a6a5-04eeb488383e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.051617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cbe28-ec45-4bdc-a6a5-04eeb488383e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.066975 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e239a-7509-4818-a684-6c272c97301f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.081427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cbe28-ec45-4bdc-a6a5-04eeb488383e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:31.082498 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7318b-9706-4dd7-8b06-27d541c76ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.083373 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7318b-9706-4dd7-8b06-27d541c76ebe admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.083663 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7318b-9706-4dd7-8b06-27d541c76ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.083969 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7318b-9706-4dd7-8b06-27d541c76ebe admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.085197 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7318b-9706-4dd7-8b06-27d541c76ebe admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.087299 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7318b-9706-4dd7-8b06-27d541c76ebe admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.089023 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 54/104] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:31.090202 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-5f2cbe28-ec45-4bdc-a6a5-04eeb488383e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:31.091625 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 51/105] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:31.100187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7318b-9706-4dd7-8b06-27d541c76ebe admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.102426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cbe28-ec45-4bdc-a6a5-04eeb488383e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.113268 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cbe28-ec45-4bdc-a6a5-04eeb488383e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.113540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7318b-9706-4dd7-8b06-27d541c76ebe admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.120236 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ef91f-4807-45f5-b1c5-35e7b8a89f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.121155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef91f-4807-45f5-b1c5-35e7b8a89f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.121445 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef91f-4807-45f5-b1c5-35e7b8a89f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.121721 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef91f-4807-45f5-b1c5-35e7b8a89f76 admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28/users/5644d459227e4d61a1311eb719e23975/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.124188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa593845-0d17-4d2c-a4b3-3df93a0b294d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.124807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa593845-0d17-4d2c-a4b3-3df93a0b294d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.125089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa593845-0d17-4d2c-a4b3-3df93a0b294d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.125365 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa593845-0d17-4d2c-a4b3-3df93a0b294d admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.126185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa593845-0d17-4d2c-a4b3-3df93a0b294d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:31.126506 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa593845-0d17-4d2c-a4b3-3df93a0b294d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.128271 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa593845-0d17-4d2c-a4b3-3df93a0b294d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.128633 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ef91f-4807-45f5-b1c5-35e7b8a89f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f445e69c8094e37889545aefb002e28, user_id=5644d459227e4d61a1311eb719e23975, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.129671 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-9c3ef91f-4807-45f5-b1c5-35e7b8a89f76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:31.129671 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:10:31.129671 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:10:31.131618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ef91f-4807-45f5-b1c5-35e7b8a89f76 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.138396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 52/106] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:31.145944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa593845-0d17-4d2c-a4b3-3df93a0b294d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.156871 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa593845-0d17-4d2c-a4b3-3df93a0b294d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.163104 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4deeba-8e0e-4edb-b57b-6398db5c2928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.164352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4deeba-8e0e-4edb-b57b-6398db5c2928 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.164846 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4deeba-8e0e-4edb-b57b-6398db5c2928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.165323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4deeba-8e0e-4edb-b57b-6398db5c2928 admin admin] PATH_INFO: `/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.166823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4deeba-8e0e-4edb-b57b-6398db5c2928 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ed740fcfd474bcb94f1482aedaeb9bd)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.169222 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4deeba-8e0e-4edb-b57b-6398db5c2928 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.171440 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 53/107] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:31.179037 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4deeba-8e0e-4edb-b57b-6398db5c2928 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.189999 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4deeba-8e0e-4edb-b57b-6398db5c2928 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.194820 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d51d9e-abc4-42c6-8c6c-0210c5bde325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.195686 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d51d9e-abc4-42c6-8c6c-0210c5bde325 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.196004 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d51d9e-abc4-42c6-8c6c-0210c5bde325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.196284 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d51d9e-abc4-42c6-8c6c-0210c5bde325 admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.197561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d51d9e-abc4-42c6-8c6c-0210c5bde325 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.199653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d51d9e-abc4-42c6-8c6c-0210c5bde325 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.201368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 54/108] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:31.202548 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d8afa-0b18-4d06-82a4-e903e39e0c92 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.202833 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d8afa-0b18-4d06-82a4-e903e39e0c92 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.203122 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d8afa-0b18-4d06-82a4-e903e39e0c92 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.205730 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 55/109] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:31.211810 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f530a52-a62f-4234-acb8-3a72d53e5373 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.212107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f530a52-a62f-4234-acb8-3a72d53e5373 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.212391 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f530a52-a62f-4234-acb8-3a72d53e5373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.224644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 55/110] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:10:31 2021] PUT /identity/v3/projects/3f445e69c8094e37889545aefb002e28/users/5644d459227e4d61a1311eb719e23975/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:10:31.225771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ef91f-4807-45f5-b1c5-35e7b8a89f76 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.245869 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-7f530a52-a62f-4234-acb8-3a72d53e5373 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:31.249748 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-7f530a52-a62f-4234-acb8-3a72d53e5373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:31.372526 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 56/111] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:31.378238 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ef91f-4807-45f5-b1c5-35e7b8a89f76 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.383174 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bd6ec-843a-4d4a-a33b-00c41a377b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.384353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bd6ec-843a-4d4a-a33b-00c41a377b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.384845 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bd6ec-843a-4d4a-a33b-00c41a377b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.385319 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bd6ec-843a-4d4a-a33b-00c41a377b0c admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28/users/3ed740fcfd474bcb94f1482aedaeb9bd/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.387888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bd6ec-843a-4d4a-a33b-00c41a377b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f445e69c8094e37889545aefb002e28, user_id=3ed740fcfd474bcb94f1482aedaeb9bd, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.391022 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bd6ec-843a-4d4a-a33b-00c41a377b0c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.410229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f530a52-a62f-4234-acb8-3a72d53e5373 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.420202 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f530a52-a62f-4234-acb8-3a72d53e5373 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.426219 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e4d5e-fef4-4a56-a3a0-1f841c8ca0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.427144 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e4d5e-fef4-4a56-a3a0-1f841c8ca0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.427427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e4d5e-fef4-4a56-a3a0-1f841c8ca0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.427842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e4d5e-fef4-4a56-a3a0-1f841c8ca0f7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.441204 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e4d5e-fef4-4a56-a3a0-1f841c8ca0f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:31.449387 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-563e4d5e-fef4-4a56-a3a0-1f841c8ca0f7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 01:10:31.450823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 57/112] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:10:31.458876 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e4d5e-fef4-4a56-a3a0-1f841c8ca0f7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.469950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e4d5e-fef4-4a56-a3a0-1f841c8ca0f7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.478788 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54912859-0602-4d89-8793-644745e055a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.479480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54912859-0602-4d89-8793-644745e055a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.479841 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54912859-0602-4d89-8793-644745e055a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.480124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54912859-0602-4d89-8793-644745e055a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.481038 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54912859-0602-4d89-8793-644745e055a9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:31.481354 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54912859-0602-4d89-8793-644745e055a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.483166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54912859-0602-4d89-8793-644745e055a9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.494714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 58/113] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:31.501216 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54912859-0602-4d89-8793-644745e055a9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.512223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54912859-0602-4d89-8793-644745e055a9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.517984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb597e16-d891-4f71-84a5-7ab51569a667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.519042 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb597e16-d891-4f71-84a5-7ab51569a667 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.519327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb597e16-d891-4f71-84a5-7ab51569a667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.519604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb597e16-d891-4f71-84a5-7ab51569a667 admin admin] PATH_INFO: `/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.520898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb597e16-d891-4f71-84a5-7ab51569a667 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ed740fcfd474bcb94f1482aedaeb9bd)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.523140 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb597e16-d891-4f71-84a5-7ab51569a667 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.524899 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 59/114] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:31.531276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb597e16-d891-4f71-84a5-7ab51569a667 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.540344 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 56/115] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:10:31 2021] PUT /identity/v3/projects/3f445e69c8094e37889545aefb002e28/users/3ed740fcfd474bcb94f1482aedaeb9bd/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:10:31.546195 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb597e16-d891-4f71-84a5-7ab51569a667 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.614925 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e756b1-0599-4407-b326-db0321b26143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.615909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e756b1-0599-4407-b326-db0321b26143 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.616249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e756b1-0599-4407-b326-db0321b26143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.616532 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e756b1-0599-4407-b326-db0321b26143 admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.617903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e756b1-0599-4407-b326-db0321b26143 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.620138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e756b1-0599-4407-b326-db0321b26143 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.622085 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 60/116] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:31.626850 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733a8c4-063a-4fd7-a6a4-7b85404a9661 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.627403 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733a8c4-063a-4fd7-a6a4-7b85404a9661 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.628006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733a8c4-063a-4fd7-a6a4-7b85404a9661 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.629918 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e756b1-0599-4407-b326-db0321b26143 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.630203 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 57/117] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:31.637519 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aa744-443e-47fd-b8aa-021a012a7732 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.638420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aa744-443e-47fd-b8aa-021a012a7732 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.638891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aa744-443e-47fd-b8aa-021a012a7732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.640687 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e756b1-0599-4407-b326-db0321b26143 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.651756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c088b-423a-41d9-b6e2-2aa1c6fe866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.651756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c088b-423a-41d9-b6e2-2aa1c6fe866f admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.651756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c088b-423a-41d9-b6e2-2aa1c6fe866f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.651756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c088b-423a-41d9-b6e2-2aa1c6fe866f admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28/users/3ed740fcfd474bcb94f1482aedaeb9bd/roles/4891c5dc7fab4407b20b35b4e6da58a8` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.658059 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c088b-423a-41d9-b6e2-2aa1c6fe866f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f445e69c8094e37889545aefb002e28, user_id=3ed740fcfd474bcb94f1482aedaeb9bd, role_id=4891c5dc7fab4407b20b35b4e6da58a8)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.662581 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c088b-423a-41d9-b6e2-2aa1c6fe866f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.676033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-331aa744-443e-47fd-b8aa-021a012a7732 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:31.677376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-331aa744-443e-47fd-b8aa-021a012a7732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:31.686072 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 58/118] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:31.691898 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d20891-5ffb-4ddf-8d70-611703631dc7 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.692313 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d20891-5ffb-4ddf-8d70-611703631dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.692662 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d20891-5ffb-4ddf-8d70-611703631dc7 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.695419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 59/119] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:31.712606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d20891-5ffb-4ddf-8d70-611703631dc7 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.728019 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d20891-5ffb-4ddf-8d70-611703631dc7 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.733044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac65352-fee5-42b0-8dc9-3565e1216a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.734034 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac65352-fee5-42b0-8dc9-3565e1216a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.734473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac65352-fee5-42b0-8dc9-3565e1216a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.734853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac65352-fee5-42b0-8dc9-3565e1216a00 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.755428 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 61/120] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:10:31 2021] PUT /identity/v3/projects/3f445e69c8094e37889545aefb002e28/users/3ed740fcfd474bcb94f1482aedaeb9bd/roles/4891c5dc7fab4407b20b35b4e6da58a8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:10:31.756188 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac65352-fee5-42b0-8dc9-3565e1216a00 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:31.764060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-9ac65352-fee5-42b0-8dc9-3565e1216a00 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:31.764558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c51a3-1933-4c8a-8711-3ab318457ebe None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.765004 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c51a3-1933-4c8a-8711-3ab318457ebe None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.765386 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c51a3-1933-4c8a-8711-3ab318457ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.766169 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 60/121] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:31.773293 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac65352-fee5-42b0-8dc9-3565e1216a00 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.787098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac65352-fee5-42b0-8dc9-3565e1216a00 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.800873 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-243c51a3-1933-4c8a-8711-3ab318457ebe None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:31.802288 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-243c51a3-1933-4c8a-8711-3ab318457ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:31.883440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc678e-c8e3-4497-b1cc-bdd8ab5a961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.884884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc678e-c8e3-4497-b1cc-bdd8ab5a961c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.885321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc678e-c8e3-4497-b1cc-bdd8ab5a961c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.885748 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc678e-c8e3-4497-b1cc-bdd8ab5a961c admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.886757 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc678e-c8e3-4497-b1cc-bdd8ab5a961c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:31.887275 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc678e-c8e3-4497-b1cc-bdd8ab5a961c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.889123 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc678e-c8e3-4497-b1cc-bdd8ab5a961c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.893072 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 62/122] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:31.899721 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 61/123] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:31.907915 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c51a3-1933-4c8a-8711-3ab318457ebe None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.917408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c51a3-1933-4c8a-8711-3ab318457ebe None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.922430 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc678e-c8e3-4497-b1cc-bdd8ab5a961c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.924080 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dbba7-0fe1-42d7-a36a-4de342c80a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.924976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dbba7-0fe1-42d7-a36a-4de342c80a64 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.925302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dbba7-0fe1-42d7-a36a-4de342c80a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.925578 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dbba7-0fe1-42d7-a36a-4de342c80a64 admin admin] PATH_INFO: `/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.926956 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37dbba7-0fe1-42d7-a36a-4de342c80a64 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ed740fcfd474bcb94f1482aedaeb9bd)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.929231 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37dbba7-0fe1-42d7-a36a-4de342c80a64 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.931136 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 63/124] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:31.935691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc678e-c8e3-4497-b1cc-bdd8ab5a961c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.938618 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dbba7-0fe1-42d7-a36a-4de342c80a64 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.943252 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2dc7f-40df-4f01-96b7-54428000f8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.944921 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2dc7f-40df-4f01-96b7-54428000f8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.945403 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2dc7f-40df-4f01-96b7-54428000f8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.945858 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2dc7f-40df-4f01-96b7-54428000f8d3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.948515 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2dc7f-40df-4f01-96b7-54428000f8d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.950481 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2dc7f-40df-4f01-96b7-54428000f8d3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.950588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dbba7-0fe1-42d7-a36a-4de342c80a64 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.952628 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 62/125] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:31.959853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254108f-1c62-41b3-9e20-45a5055e1da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.959853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254108f-1c62-41b3-9e20-45a5055e1da1 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.959853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254108f-1c62-41b3-9e20-45a5055e1da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.959853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254108f-1c62-41b3-9e20-45a5055e1da1 admin admin] PATH_INFO: `/v3/projects/7c7e49aee6344a67a4231a44e2583090` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.960993 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2dc7f-40df-4f01-96b7-54428000f8d3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.961244 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254108f-1c62-41b3-9e20-45a5055e1da1 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c7e49aee6344a67a4231a44e2583090)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:31.963883 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254108f-1c62-41b3-9e20-45a5055e1da1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:31.965903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 64/126] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:31 2021] GET /identity/v3/projects/7c7e49aee6344a67a4231a44e2583090 => generated 312 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:31.973041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254108f-1c62-41b3-9e20-45a5055e1da1 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:31.978780 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2dc7f-40df-4f01-96b7-54428000f8d3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.992546 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3809c-a01e-43c4-92f9-2e56de69d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:31.993621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3809c-a01e-43c4-92f9-2e56de69d7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:31.995162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3809c-a01e-43c4-92f9-2e56de69d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:31.995656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3809c-a01e-43c4-92f9-2e56de69d7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:31.997171 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254108f-1c62-41b3-9e20-45a5055e1da1 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:31.998211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3809c-a01e-43c4-92f9-2e56de69d7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:32.000004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-e8a3809c-a01e-43c4-92f9-2e56de69d7a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:32.000004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:10:32.000004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:10:32.003329 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3809c-a01e-43c4-92f9-2e56de69d7a1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:32.007131 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a964c6-b085-4442-baa2-61e8611f683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:32.010996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a964c6-b085-4442-baa2-61e8611f683b admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:32.011515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a964c6-b085-4442-baa2-61e8611f683b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:32.011994 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a964c6-b085-4442-baa2-61e8611f683b admin admin] PATH_INFO: `/v3/projects/7c7e49aee6344a67a4231a44e2583090/users/3ed740fcfd474bcb94f1482aedaeb9bd/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:32.016129 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a964c6-b085-4442-baa2-61e8611f683b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7e49aee6344a67a4231a44e2583090, user_id=3ed740fcfd474bcb94f1482aedaeb9bd, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:32.020133 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a964c6-b085-4442-baa2-61e8611f683b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:32.103547 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 65/127] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:10:31 2021] PUT /identity/v3/projects/7c7e49aee6344a67a4231a44e2583090/users/3ed740fcfd474bcb94f1482aedaeb9bd/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:10:32.132537 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 63/128] 10.222.0.87 () {60 vars in 1153 bytes} [Fri Oct 29 01:10:31 2021] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:10:33.863339 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db43bc2-ba4f-44f3-b13d-6163e31cd696 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:33.863871 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db43bc2-ba4f-44f3-b13d-6163e31cd696 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:33.863944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db43bc2-ba4f-44f3-b13d-6163e31cd696 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:33.876920 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 66/129] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:33.878772 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728bbdd-bd8d-4ab7-a628-adb8c9098e0f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:33.879521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728bbdd-bd8d-4ab7-a628-adb8c9098e0f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:33.879961 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728bbdd-bd8d-4ab7-a628-adb8c9098e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:33.901333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-7728bbdd-bd8d-4ab7-a628-adb8c9098e0f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:33.902823 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7728bbdd-bd8d-4ab7-a628-adb8c9098e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:33.978443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 64/130] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:34.029247 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db43bc2-ba4f-44f3-b13d-6163e31cd696 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:34.044787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db43bc2-ba4f-44f3-b13d-6163e31cd696 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:34.052874 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a56a2-ad1d-4081-880c-b4963d22d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:34.053898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a56a2-ad1d-4081-880c-b4963d22d74e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.054323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a56a2-ad1d-4081-880c-b4963d22d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.054738 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a56a2-ad1d-4081-880c-b4963d22d74e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.072831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a56a2-ad1d-4081-880c-b4963d22d74e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:34.080280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-4a6a56a2-ad1d-4081-880c-b4963d22d74e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:10:34.081742 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 67/131] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:10:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:34.088167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728bbdd-bd8d-4ab7-a628-adb8c9098e0f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:34.098596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728bbdd-bd8d-4ab7-a628-adb8c9098e0f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:34.104849 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae212dc-bea5-4613-beda-0da41b902d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:34.105721 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae212dc-bea5-4613-beda-0da41b902d38 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.106148 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae212dc-bea5-4613-beda-0da41b902d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.106566 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae212dc-bea5-4613-beda-0da41b902d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.107483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae212dc-bea5-4613-beda-0da41b902d38 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:34.107967 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae212dc-bea5-4613-beda-0da41b902d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:34.109740 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae212dc-bea5-4613-beda-0da41b902d38 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:34.120549 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 65/132] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:34.127568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a56a2-ad1d-4081-880c-b4963d22d74e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:34.141381 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a56a2-ad1d-4081-880c-b4963d22d74e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:34.149258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29ffdf-affc-495b-b0de-20199ed79800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:34.150338 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29ffdf-affc-495b-b0de-20199ed79800 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.150766 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29ffdf-affc-495b-b0de-20199ed79800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.151180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29ffdf-affc-495b-b0de-20199ed79800 admin admin] PATH_INFO: `/v3/users/5644d459227e4d61a1311eb719e23975` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.152588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29ffdf-affc-495b-b0de-20199ed79800 admin admin] RBAC: Authorizing `identity:get_user(user_id=5644d459227e4d61a1311eb719e23975)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:34.154563 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29ffdf-affc-495b-b0de-20199ed79800 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:34.156424 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 68/133] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:34 2021] GET /identity/v3/users/5644d459227e4d61a1311eb719e23975 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:34.162666 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae212dc-bea5-4613-beda-0da41b902d38 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:34.172919 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae212dc-bea5-4613-beda-0da41b902d38 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:34.178731 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04d7a-8d51-4a89-bef1-6677010ea57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:34.179582 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04d7a-8d51-4a89-bef1-6677010ea57e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.180028 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04d7a-8d51-4a89-bef1-6677010ea57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.180461 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04d7a-8d51-4a89-bef1-6677010ea57e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.192116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed04d7a-8d51-4a89-bef1-6677010ea57e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:34.194368 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed04d7a-8d51-4a89-bef1-6677010ea57e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:34.208656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 66/134] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:34.215028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29ffdf-affc-495b-b0de-20199ed79800 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:34.228802 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29ffdf-affc-495b-b0de-20199ed79800 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:34.233698 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12822a24-4ad1-4410-bd17-a6009e2d84d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:34.234714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12822a24-4ad1-4410-bd17-a6009e2d84d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.235169 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12822a24-4ad1-4410-bd17-a6009e2d84d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.236327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12822a24-4ad1-4410-bd17-a6009e2d84d1 admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.237750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12822a24-4ad1-4410-bd17-a6009e2d84d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:34.239999 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12822a24-4ad1-4410-bd17-a6009e2d84d1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:34.243857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 69/135] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:34 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:34.248322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04d7a-8d51-4a89-bef1-6677010ea57e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:34.260040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04d7a-8d51-4a89-bef1-6677010ea57e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:34.266647 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b094d3-49e6-4323-b40f-911505765c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:34.267582 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b094d3-49e6-4323-b40f-911505765c37 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.268053 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b094d3-49e6-4323-b40f-911505765c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.268474 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b094d3-49e6-4323-b40f-911505765c37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.269468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b094d3-49e6-4323-b40f-911505765c37 admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=3f445e69c8094e37889545aefb002e28, user.id=5644d459227e4d61a1311eb719e23975) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:34.269925 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b094d3-49e6-4323-b40f-911505765c37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:34.272026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b094d3-49e6-4323-b40f-911505765c37 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:34.280713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 67/136] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:10:34 2021] GET /identity/v3/role_assignments?user.id=5644d459227e4d61a1311eb719e23975&scope.project.id=3f445e69c8094e37889545aefb002e28&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:34.580030 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06556a5d-f8d8-42e0-90e8-b1b8ad630206 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.580427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06556a5d-f8d8-42e0-90e8-b1b8ad630206 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.580708 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06556a5d-f8d8-42e0-90e8-b1b8ad630206 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.582513 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 70/137] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:34.589343 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c313a2-bda4-4b67-a1ff-d809940de692 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.589959 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c313a2-bda4-4b67-a1ff-d809940de692 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.590436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c313a2-bda4-4b67-a1ff-d809940de692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.613249 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-c9c313a2-bda4-4b67-a1ff-d809940de692 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:34.614815 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c9c313a2-bda4-4b67-a1ff-d809940de692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:34.623651 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 68/138] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:34.674503 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06556a5d-f8d8-42e0-90e8-b1b8ad630206 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:34.689828 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06556a5d-f8d8-42e0-90e8-b1b8ad630206 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:34.698219 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebac7c-03d7-4e0a-a8ca-1c076f756bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:34.699379 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebac7c-03d7-4e0a-a8ca-1c076f756bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.699952 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebac7c-03d7-4e0a-a8ca-1c076f756bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.700426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebac7c-03d7-4e0a-a8ca-1c076f756bc7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.724855 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebac7c-03d7-4e0a-a8ca-1c076f756bc7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:34.732295 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-50ebac7c-03d7-4e0a-a8ca-1c076f756bc7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:34.733847 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 71/139] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:10:34.741752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c313a2-bda4-4b67-a1ff-d809940de692 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:34.753836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c313a2-bda4-4b67-a1ff-d809940de692 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:34.760812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea833e-0162-4af9-83be-44f021f87bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:34.761717 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea833e-0162-4af9-83be-44f021f87bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.762196 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea833e-0162-4af9-83be-44f021f87bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.762688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea833e-0162-4af9-83be-44f021f87bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.763673 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea833e-0162-4af9-83be-44f021f87bf8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:34.764929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea833e-0162-4af9-83be-44f021f87bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:34.766710 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea833e-0162-4af9-83be-44f021f87bf8 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:34.776885 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 69/140] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:34.784569 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebac7c-03d7-4e0a-a8ca-1c076f756bc7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:34.795162 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebac7c-03d7-4e0a-a8ca-1c076f756bc7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:34.800969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a8d1d-7b79-489a-a7b8-2df2bf4ecf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:34.802154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a8d1d-7b79-489a-a7b8-2df2bf4ecf01 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.802624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a8d1d-7b79-489a-a7b8-2df2bf4ecf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.803064 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a8d1d-7b79-489a-a7b8-2df2bf4ecf01 admin admin] PATH_INFO: `/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.804694 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a8d1d-7b79-489a-a7b8-2df2bf4ecf01 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ed740fcfd474bcb94f1482aedaeb9bd)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:34.807173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a8d1d-7b79-489a-a7b8-2df2bf4ecf01 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:34.814365 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 72/141] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:34 2021] GET /identity/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:34.816032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea833e-0162-4af9-83be-44f021f87bf8 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:34.826982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea833e-0162-4af9-83be-44f021f87bf8 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:34.832262 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b73101-09ae-4520-9485-1ddad2908607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:34.833187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b73101-09ae-4520-9485-1ddad2908607 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.833613 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b73101-09ae-4520-9485-1ddad2908607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.834080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b73101-09ae-4520-9485-1ddad2908607 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.843669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b73101-09ae-4520-9485-1ddad2908607 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:34.846691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b73101-09ae-4520-9485-1ddad2908607 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:34.857769 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 70/142] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:34.875293 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a8d1d-7b79-489a-a7b8-2df2bf4ecf01 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:34.889373 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a8d1d-7b79-489a-a7b8-2df2bf4ecf01 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:34.894397 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab941d-8cad-416f-8660-b8d0d1e3a26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:34.895485 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab941d-8cad-416f-8660-b8d0d1e3a26c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.895957 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab941d-8cad-416f-8660-b8d0d1e3a26c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.896448 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab941d-8cad-416f-8660-b8d0d1e3a26c admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.897864 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab941d-8cad-416f-8660-b8d0d1e3a26c admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:34.900322 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab941d-8cad-416f-8660-b8d0d1e3a26c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:34.902220 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 73/143] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:34 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:34.909854 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b73101-09ae-4520-9485-1ddad2908607 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:34.919958 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b73101-09ae-4520-9485-1ddad2908607 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:34.926130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4b513-811d-4df1-807b-2d50bc187e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:34.926979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4b513-811d-4df1-807b-2d50bc187e6a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.927459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4b513-811d-4df1-807b-2d50bc187e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.927940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4b513-811d-4df1-807b-2d50bc187e6a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.928973 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4b513-811d-4df1-807b-2d50bc187e6a admin admin] RBAC: Adding query filter params (role.id=999d570f97da49269327a60c1acf21d2, scope.project.id=3f445e69c8094e37889545aefb002e28, user.id=3ed740fcfd474bcb94f1482aedaeb9bd) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:34.929430 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4b513-811d-4df1-807b-2d50bc187e6a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:34.931534 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4b513-811d-4df1-807b-2d50bc187e6a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:34.938603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 71/144] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:10:34 2021] GET /identity/v3/role_assignments?user.id=3ed740fcfd474bcb94f1482aedaeb9bd&scope.project.id=3f445e69c8094e37889545aefb002e28&role.id=999d570f97da49269327a60c1acf21d2 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:34.956412 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ba461-6967-45f2-97d1-d23e1f2c4ac4 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.956927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ba461-6967-45f2-97d1-d23e1f2c4ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.957399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ba461-6967-45f2-97d1-d23e1f2c4ac4 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:34.959609 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 74/145] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:34.965657 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1de0b8-4498-484a-baa5-46e0b7a496bc None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:34.966196 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1de0b8-4498-484a-baa5-46e0b7a496bc None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:34.966614 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1de0b8-4498-484a-baa5-46e0b7a496bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:35.004915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-db1de0b8-4498-484a-baa5-46e0b7a496bc None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:35.006489 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-db1de0b8-4498-484a-baa5-46e0b7a496bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:35.014603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 72/146] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:35.064535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ba461-6967-45f2-97d1-d23e1f2c4ac4 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:35.078613 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ba461-6967-45f2-97d1-d23e1f2c4ac4 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:35.087650 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f031d39-bc16-4cab-9586-0d808b66ae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:35.088755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f031d39-bc16-4cab-9586-0d808b66ae77 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:35.089185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f031d39-bc16-4cab-9586-0d808b66ae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:35.089713 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f031d39-bc16-4cab-9586-0d808b66ae77 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:35.102943 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f031d39-bc16-4cab-9586-0d808b66ae77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:35.111514 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-6f031d39-bc16-4cab-9586-0d808b66ae77 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 01:10:35.113083 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 75/147] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:10:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:35.119846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1de0b8-4498-484a-baa5-46e0b7a496bc None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:35.130307 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1de0b8-4498-484a-baa5-46e0b7a496bc None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:35.135259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb67cad-0190-4977-acb4-169be06e72ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:35.136161 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb67cad-0190-4977-acb4-169be06e72ba admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:35.136590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb67cad-0190-4977-acb4-169be06e72ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:35.137010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb67cad-0190-4977-acb4-169be06e72ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:35.138001 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb67cad-0190-4977-acb4-169be06e72ba admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:35.138453 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb67cad-0190-4977-acb4-169be06e72ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:35.140230 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb67cad-0190-4977-acb4-169be06e72ba admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:35.151307 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 73/148] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:10:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:35.158085 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f031d39-bc16-4cab-9586-0d808b66ae77 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:35.169308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f031d39-bc16-4cab-9586-0d808b66ae77 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:35.177759 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87f4b-456f-4109-b908-49064ae39202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:35.178949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87f4b-456f-4109-b908-49064ae39202 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:35.179380 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87f4b-456f-4109-b908-49064ae39202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:35.179860 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87f4b-456f-4109-b908-49064ae39202 admin admin] PATH_INFO: `/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:35.181580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c87f4b-456f-4109-b908-49064ae39202 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ed740fcfd474bcb94f1482aedaeb9bd)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:35.183999 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c87f4b-456f-4109-b908-49064ae39202 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:35.185934 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 76/149] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:35 2021] GET /identity/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:35.192923 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb67cad-0190-4977-acb4-169be06e72ba admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:35.204369 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb67cad-0190-4977-acb4-169be06e72ba admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:35.211164 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d0b1-0dd5-4819-a26a-ac8ad941f1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:35.212158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d0b1-0dd5-4819-a26a-ac8ad941f1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:35.212589 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d0b1-0dd5-4819-a26a-ac8ad941f1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:35.213010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d0b1-0dd5-4819-a26a-ac8ad941f1d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:35.228420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4d0b1-0dd5-4819-a26a-ac8ad941f1d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:35.230628 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4d0b1-0dd5-4819-a26a-ac8ad941f1d4 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:35.246119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 74/150] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:35.253632 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87f4b-456f-4109-b908-49064ae39202 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:35.265500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87f4b-456f-4109-b908-49064ae39202 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:35.274882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027308d-ac1e-45c5-bf10-43fdc150354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:35.275792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027308d-ac1e-45c5-bf10-43fdc150354f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:35.276143 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027308d-ac1e-45c5-bf10-43fdc150354f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:35.276421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027308d-ac1e-45c5-bf10-43fdc150354f admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:35.280670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027308d-ac1e-45c5-bf10-43fdc150354f admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:35.283021 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027308d-ac1e-45c5-bf10-43fdc150354f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:35.285995 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 77/151] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:35 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:35.292465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d0b1-0dd5-4819-a26a-ac8ad941f1d4 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:35.304247 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d0b1-0dd5-4819-a26a-ac8ad941f1d4 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:35.316064 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5702956-b25e-4db2-a198-38a89591aa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:35.317008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702956-b25e-4db2-a198-38a89591aa2d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:35.317435 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702956-b25e-4db2-a198-38a89591aa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:35.317856 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702956-b25e-4db2-a198-38a89591aa2d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:35.318848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5702956-b25e-4db2-a198-38a89591aa2d admin admin] RBAC: Adding query filter params (role.id=4891c5dc7fab4407b20b35b4e6da58a8, scope.project.id=3f445e69c8094e37889545aefb002e28, user.id=3ed740fcfd474bcb94f1482aedaeb9bd) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:35.319551 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5702956-b25e-4db2-a198-38a89591aa2d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:35.321597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5702956-b25e-4db2-a198-38a89591aa2d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:35.336593 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 75/152] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:10:35 2021] GET /identity/v3/role_assignments?user.id=3ed740fcfd474bcb94f1482aedaeb9bd&scope.project.id=3f445e69c8094e37889545aefb002e28&role.id=4891c5dc7fab4407b20b35b4e6da58a8 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:35.623296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da072a8-cc35-4652-8576-f6119cd0d118 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:35.623591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da072a8-cc35-4652-8576-f6119cd0d118 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:35.623897 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da072a8-cc35-4652-8576-f6119cd0d118 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:35.625895 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 78/153] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:35.633478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d94817-3aca-42a7-96ae-ec94053fd5d2 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:35.633986 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d94817-3aca-42a7-96ae-ec94053fd5d2 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:35.634500 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d94817-3aca-42a7-96ae-ec94053fd5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:35.664913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-b3d94817-3aca-42a7-96ae-ec94053fd5d2 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:35.666404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b3d94817-3aca-42a7-96ae-ec94053fd5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:35.675002 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 76/154] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:35.715897 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da072a8-cc35-4652-8576-f6119cd0d118 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:35.734711 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da072a8-cc35-4652-8576-f6119cd0d118 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:35.739958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39568748-0976-4a61-b107-2ca5a86da4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:35.740755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39568748-0976-4a61-b107-2ca5a86da4ac admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:35.741032 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39568748-0976-4a61-b107-2ca5a86da4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:35.741300 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39568748-0976-4a61-b107-2ca5a86da4ac admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:35.761223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39568748-0976-4a61-b107-2ca5a86da4ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:35.768662 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-39568748-0976-4a61-b107-2ca5a86da4ac admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:35.770215 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 79/155] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:35.776596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d94817-3aca-42a7-96ae-ec94053fd5d2 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:35.794001 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d94817-3aca-42a7-96ae-ec94053fd5d2 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:35.803448 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec5f77-2151-41ed-9d1a-194407c17f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:35.804397 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec5f77-2151-41ed-9d1a-194407c17f6d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:35.804850 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec5f77-2151-41ed-9d1a-194407c17f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:35.805272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec5f77-2151-41ed-9d1a-194407c17f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:35.806203 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec5f77-2151-41ed-9d1a-194407c17f6d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:35.806655 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec5f77-2151-41ed-9d1a-194407c17f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:35.812720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec5f77-2151-41ed-9d1a-194407c17f6d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:35.822954 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 77/156] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:35.830680 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39568748-0976-4a61-b107-2ca5a86da4ac admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:35.845848 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39568748-0976-4a61-b107-2ca5a86da4ac admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:35.854969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138bbc5-0606-4b48-aafe-767370138e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:35.964035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138bbc5-0606-4b48-aafe-767370138e87 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:35.964035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138bbc5-0606-4b48-aafe-767370138e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:35.964035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138bbc5-0606-4b48-aafe-767370138e87 admin admin] PATH_INFO: `/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:35.964035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138bbc5-0606-4b48-aafe-767370138e87 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ed740fcfd474bcb94f1482aedaeb9bd)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:35.964035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138bbc5-0606-4b48-aafe-767370138e87 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:35.964035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 80/157] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:35 2021] GET /identity/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:35.965462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec5f77-2151-41ed-9d1a-194407c17f6d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:35.965462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec5f77-2151-41ed-9d1a-194407c17f6d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:35.965462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d621d-cc56-4dc2-b488-463a628c380c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:35.965462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d621d-cc56-4dc2-b488-463a628c380c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:35.966048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d621d-cc56-4dc2-b488-463a628c380c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:35.966048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d621d-cc56-4dc2-b488-463a628c380c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:35.966048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d621d-cc56-4dc2-b488-463a628c380c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:35.966048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d621d-cc56-4dc2-b488-463a628c380c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:35.966048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 78/158] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:35.966392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138bbc5-0606-4b48-aafe-767370138e87 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:35.968813 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138bbc5-0606-4b48-aafe-767370138e87 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:35.973598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28308a5-0751-4ae7-adb6-ec037c9d120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:35.974440 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28308a5-0751-4ae7-adb6-ec037c9d120b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:35.974709 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28308a5-0751-4ae7-adb6-ec037c9d120b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:35.974980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28308a5-0751-4ae7-adb6-ec037c9d120b admin admin] PATH_INFO: `/v3/projects/7c7e49aee6344a67a4231a44e2583090` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:35.977708 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28308a5-0751-4ae7-adb6-ec037c9d120b admin admin] RBAC: Authorizing `identity:get_project(project_id=7c7e49aee6344a67a4231a44e2583090)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:35.979774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28308a5-0751-4ae7-adb6-ec037c9d120b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:35.981484 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 81/159] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:35 2021] GET /identity/v3/projects/7c7e49aee6344a67a4231a44e2583090 => generated 312 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:35.991753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d621d-cc56-4dc2-b488-463a628c380c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:36.001124 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d621d-cc56-4dc2-b488-463a628c380c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:36.007452 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29eaf1-adc1-4098-b429-e33cd87ce865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:36.008367 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29eaf1-adc1-4098-b429-e33cd87ce865 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:36.008807 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29eaf1-adc1-4098-b429-e33cd87ce865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:36.009234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29eaf1-adc1-4098-b429-e33cd87ce865 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:36.010251 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29eaf1-adc1-4098-b429-e33cd87ce865 admin admin] RBAC: Adding query filter params (role.id=999d570f97da49269327a60c1acf21d2, scope.project.id=7c7e49aee6344a67a4231a44e2583090, user.id=3ed740fcfd474bcb94f1482aedaeb9bd) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:36.010725 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29eaf1-adc1-4098-b429-e33cd87ce865 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:36.012847 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29eaf1-adc1-4098-b429-e33cd87ce865 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:36.025024 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 79/160] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:10:35 2021] GET /identity/v3/role_assignments?user.id=3ed740fcfd474bcb94f1482aedaeb9bd&scope.project.id=7c7e49aee6344a67a4231a44e2583090&role.id=999d570f97da49269327a60c1acf21d2 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:36.184543 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3037e-838f-42ab-a158-3ad64af9f8fb None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:36.184824 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3037e-838f-42ab-a158-3ad64af9f8fb None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:36.185103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3037e-838f-42ab-a158-3ad64af9f8fb None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:36.186982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 82/161] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:36.196138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a4bc0-a2c8-410b-a4a3-7ca48458b94a None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:36.196767 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a4bc0-a2c8-410b-a4a3-7ca48458b94a None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:36.197269 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a4bc0-a2c8-410b-a4a3-7ca48458b94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:36.216884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-935a4bc0-a2c8-410b-a4a3-7ca48458b94a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:36.218489 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-935a4bc0-a2c8-410b-a4a3-7ca48458b94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:36.227160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 80/162] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:36.270602 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3037e-838f-42ab-a158-3ad64af9f8fb None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:36.283648 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3037e-838f-42ab-a158-3ad64af9f8fb None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:36.288186 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80ad8b-e36a-4299-8f1a-f437984fc551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:36.288995 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80ad8b-e36a-4299-8f1a-f437984fc551 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:36.289359 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80ad8b-e36a-4299-8f1a-f437984fc551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:36.289536 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80ad8b-e36a-4299-8f1a-f437984fc551 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:36.302034 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80ad8b-e36a-4299-8f1a-f437984fc551 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:36.309184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-df80ad8b-e36a-4299-8f1a-f437984fc551 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:36.310687 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 83/163] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:10:36.320314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a4bc0-a2c8-410b-a4a3-7ca48458b94a None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:36.333516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a4bc0-a2c8-410b-a4a3-7ca48458b94a None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:36.338013 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ffccd-6f31-4a06-ae9f-235b67e4fd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:36.338689 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ffccd-6f31-4a06-ae9f-235b67e4fd40 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:36.338969 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ffccd-6f31-4a06-ae9f-235b67e4fd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:36.339242 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ffccd-6f31-4a06-ae9f-235b67e4fd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:36.340047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ffccd-6f31-4a06-ae9f-235b67e4fd40 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:36.340349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ffccd-6f31-4a06-ae9f-235b67e4fd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:36.341949 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ffccd-6f31-4a06-ae9f-235b67e4fd40 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:36.353922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 81/164] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:36 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:36.360824 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80ad8b-e36a-4299-8f1a-f437984fc551 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:36.377860 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80ad8b-e36a-4299-8f1a-f437984fc551 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:36.382411 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72eeac-eb44-4337-a70d-a375918ceb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:36.383277 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72eeac-eb44-4337-a70d-a375918ceb3d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:36.383556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72eeac-eb44-4337-a70d-a375918ceb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:36.383884 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72eeac-eb44-4337-a70d-a375918ceb3d admin admin] PATH_INFO: `/v3/users/e2664a2d309142219cd20e74e8066baa` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:36.412556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72eeac-eb44-4337-a70d-a375918ceb3d admin admin] RBAC: Authorizing `identity:get_user(user_id=e2664a2d309142219cd20e74e8066baa)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:36.414774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72eeac-eb44-4337-a70d-a375918ceb3d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:36.416693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 84/165] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:36 2021] GET /identity/v3/users/e2664a2d309142219cd20e74e8066baa => generated 283 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:36.426322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ffccd-6f31-4a06-ae9f-235b67e4fd40 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:36.441957 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ffccd-6f31-4a06-ae9f-235b67e4fd40 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:36.450333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec5f6a-d96a-43b9-92c0-4516fe1adc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:36.451001 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec5f6a-d96a-43b9-92c0-4516fe1adc19 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:36.451283 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec5f6a-d96a-43b9-92c0-4516fe1adc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:36.451558 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec5f6a-d96a-43b9-92c0-4516fe1adc19 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:36.463710 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec5f6a-d96a-43b9-92c0-4516fe1adc19 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:36.465503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec5f6a-d96a-43b9-92c0-4516fe1adc19 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:36.477623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 82/166] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:36.486718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72eeac-eb44-4337-a70d-a375918ceb3d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:36.499035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72eeac-eb44-4337-a70d-a375918ceb3d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:36.508531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55576e73-af01-41ff-88e3-38e674344682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:36.509397 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55576e73-af01-41ff-88e3-38e674344682 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:36.509675 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55576e73-af01-41ff-88e3-38e674344682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:36.509976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55576e73-af01-41ff-88e3-38e674344682 admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:36.512543 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55576e73-af01-41ff-88e3-38e674344682 admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:36.514600 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55576e73-af01-41ff-88e3-38e674344682 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:36.516327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 85/167] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:36 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:36.523962 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec5f6a-d96a-43b9-92c0-4516fe1adc19 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:36.535754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec5f6a-d96a-43b9-92c0-4516fe1adc19 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:36.543116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0db2cc-49fd-465e-b4c2-3122b5ce0bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:36.543880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db2cc-49fd-465e-b4c2-3122b5ce0bbe admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:36.544197 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db2cc-49fd-465e-b4c2-3122b5ce0bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:36.544482 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db2cc-49fd-465e-b4c2-3122b5ce0bbe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:36.545423 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0db2cc-49fd-465e-b4c2-3122b5ce0bbe admin admin] RBAC: Adding query filter params (role.id=999d570f97da49269327a60c1acf21d2, scope.project.id=e704e7fbc18741659b80dd56204851de, user.id=e2664a2d309142219cd20e74e8066baa) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:36.545793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0db2cc-49fd-465e-b4c2-3122b5ce0bbe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:36.548341 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0db2cc-49fd-465e-b4c2-3122b5ce0bbe admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:36.559286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 83/168] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:10:36 2021] GET /identity/v3/role_assignments?user.id=e2664a2d309142219cd20e74e8066baa&scope.project.id=e704e7fbc18741659b80dd56204851de&role.id=999d570f97da49269327a60c1acf21d2 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:37.336556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c245ffe-3d56-4f96-b4f8-f17f48af7e99 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.337256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c245ffe-3d56-4f96-b4f8-f17f48af7e99 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.337256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c245ffe-3d56-4f96-b4f8-f17f48af7e99 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.339052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 86/169] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:37.347014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f7020-eec9-471a-b498-a27537bcd995 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.352937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f7020-eec9-471a-b498-a27537bcd995 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.352937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f7020-eec9-471a-b498-a27537bcd995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.368794 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-cf7f7020-eec9-471a-b498-a27537bcd995 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:37.370071 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-cf7f7020-eec9-471a-b498-a27537bcd995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:37.379181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 84/170] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:37.403340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c245ffe-3d56-4f96-b4f8-f17f48af7e99 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:37.416539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c245ffe-3d56-4f96-b4f8-f17f48af7e99 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:37.421461 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e0ffc-03e8-4b73-b854-7d5ff816e19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:37.422350 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0ffc-03e8-4b73-b854-7d5ff816e19f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.423191 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0ffc-03e8-4b73-b854-7d5ff816e19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.423628 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0ffc-03e8-4b73-b854-7d5ff816e19f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.436529 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e0ffc-03e8-4b73-b854-7d5ff816e19f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:37.444593 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-4e8e0ffc-03e8-4b73-b854-7d5ff816e19f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:10:37.445834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 87/171] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:10:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:37.452228 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f7020-eec9-471a-b498-a27537bcd995 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:37.462250 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f7020-eec9-471a-b498-a27537bcd995 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:37.466767 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444405d-1221-4b98-b5b2-7827c6494722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:37.467498 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444405d-1221-4b98-b5b2-7827c6494722 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.467812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444405d-1221-4b98-b5b2-7827c6494722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.468082 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444405d-1221-4b98-b5b2-7827c6494722 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.468849 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444405d-1221-4b98-b5b2-7827c6494722 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:37.469152 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444405d-1221-4b98-b5b2-7827c6494722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:37.471974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444405d-1221-4b98-b5b2-7827c6494722 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:37.481023 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 85/172] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:37.488630 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e0ffc-03e8-4b73-b854-7d5ff816e19f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:37.500284 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e0ffc-03e8-4b73-b854-7d5ff816e19f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:37.505906 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6667f8-eff4-4dbf-8d52-c2e94ea16a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:37.506765 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6667f8-eff4-4dbf-8d52-c2e94ea16a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.507042 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6667f8-eff4-4dbf-8d52-c2e94ea16a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.507415 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6667f8-eff4-4dbf-8d52-c2e94ea16a00 admin admin] PATH_INFO: `/v3/users/5644d459227e4d61a1311eb719e23975` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.508765 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6667f8-eff4-4dbf-8d52-c2e94ea16a00 admin admin] RBAC: Authorizing `identity:get_user(user_id=5644d459227e4d61a1311eb719e23975)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:37.508963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89138-c1ce-4cec-b558-48108aa0a4e4 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.509220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89138-c1ce-4cec-b558-48108aa0a4e4 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.509493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89138-c1ce-4cec-b558-48108aa0a4e4 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.510797 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6667f8-eff4-4dbf-8d52-c2e94ea16a00 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:37.511554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 86/173] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:10:37.513132 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 88/174] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:37 2021] GET /identity/v3/users/5644d459227e4d61a1311eb719e23975 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:37.518134 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb872518-0880-42b6-8a42-4b6325d86ae1 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.518415 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb872518-0880-42b6-8a42-4b6325d86ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.518695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb872518-0880-42b6-8a42-4b6325d86ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.519842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6667f8-eff4-4dbf-8d52-c2e94ea16a00 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:37.529831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6667f8-eff4-4dbf-8d52-c2e94ea16a00 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:37.536302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6ea09-428f-4b99-8678-1234945e4a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:37.537478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6ea09-428f-4b99-8678-1234945e4a75 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.537815 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6ea09-428f-4b99-8678-1234945e4a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.538059 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-fb872518-0880-42b6-8a42-4b6325d86ae1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:37.538429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6ea09-428f-4b99-8678-1234945e4a75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.539236 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-fb872518-0880-42b6-8a42-4b6325d86ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:37.547554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 87/175] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:37.549158 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6ea09-428f-4b99-8678-1234945e4a75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:37.550601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6ea09-428f-4b99-8678-1234945e4a75 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:37.561509 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 89/176] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:10:37.568258 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb872518-0880-42b6-8a42-4b6325d86ae1 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:37.573791 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6ea09-428f-4b99-8678-1234945e4a75 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:37.581685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb872518-0880-42b6-8a42-4b6325d86ae1 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:37.584307 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6ea09-428f-4b99-8678-1234945e4a75 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:37.586915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505fdf4-4d9e-4664-b9ee-ccf5f3f374fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:37.588132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505fdf4-4d9e-4664-b9ee-ccf5f3f374fe admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.588704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505fdf4-4d9e-4664-b9ee-ccf5f3f374fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.589265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505fdf4-4d9e-4664-b9ee-ccf5f3f374fe admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.589373 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90de099-2894-4324-a942-8f4d2bd7e647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:37.590257 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90de099-2894-4324-a942-8f4d2bd7e647 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.590603 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90de099-2894-4324-a942-8f4d2bd7e647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.590928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90de099-2894-4324-a942-8f4d2bd7e647 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.591572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505fdf4-4d9e-4664-b9ee-ccf5f3f374fe admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:37.594006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505fdf4-4d9e-4664-b9ee-ccf5f3f374fe admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:37.596649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 88/177] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:37 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:37.604600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505fdf4-4d9e-4664-b9ee-ccf5f3f374fe admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:37.610825 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90de099-2894-4324-a942-8f4d2bd7e647 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:37.616594 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505fdf4-4d9e-4664-b9ee-ccf5f3f374fe admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:37.621800 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a83efd-6d05-4a1f-b04d-56c83901d5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:37.622593 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-d90de099-2894-4324-a942-8f4d2bd7e647 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 01:10:37.623107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a83efd-6d05-4a1f-b04d-56c83901d5ae admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.623605 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a83efd-6d05-4a1f-b04d-56c83901d5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.624343 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 90/178] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:10:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:10:37.630597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a83efd-6d05-4a1f-b04d-56c83901d5ae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.630597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a83efd-6d05-4a1f-b04d-56c83901d5ae admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=e704e7fbc18741659b80dd56204851de, user.id=5644d459227e4d61a1311eb719e23975) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:37.630597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a83efd-6d05-4a1f-b04d-56c83901d5ae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:37.631824 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a83efd-6d05-4a1f-b04d-56c83901d5ae admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:37.633060 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90de099-2894-4324-a942-8f4d2bd7e647 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:37.640670 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 89/179] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:10:37 2021] GET /identity/v3/role_assignments?user.id=5644d459227e4d61a1311eb719e23975&scope.project.id=e704e7fbc18741659b80dd56204851de&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:37.646554 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90de099-2894-4324-a942-8f4d2bd7e647 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:37.652071 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e102b-166e-418d-ad4f-4d00e1895e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:37.653283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e102b-166e-418d-ad4f-4d00e1895e56 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.653771 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e102b-166e-418d-ad4f-4d00e1895e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.654298 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e102b-166e-418d-ad4f-4d00e1895e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.655421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e102b-166e-418d-ad4f-4d00e1895e56 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:37.656038 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e102b-166e-418d-ad4f-4d00e1895e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:37.658568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e102b-166e-418d-ad4f-4d00e1895e56 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:37.669500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 91/180] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:10:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:37.676413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a83efd-6d05-4a1f-b04d-56c83901d5ae admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:37.687535 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a83efd-6d05-4a1f-b04d-56c83901d5ae admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:37.693483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fbe84-11e3-4356-8f94-2d242204c11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:37.694977 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fbe84-11e3-4356-8f94-2d242204c11d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.695523 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fbe84-11e3-4356-8f94-2d242204c11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.696045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fbe84-11e3-4356-8f94-2d242204c11d admin admin] PATH_INFO: `/v3/users/e2664a2d309142219cd20e74e8066baa` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.697619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fbe84-11e3-4356-8f94-2d242204c11d admin admin] RBAC: Authorizing `identity:get_user(user_id=e2664a2d309142219cd20e74e8066baa)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:37.700264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fbe84-11e3-4356-8f94-2d242204c11d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:37.702309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 90/181] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:37 2021] GET /identity/v3/users/e2664a2d309142219cd20e74e8066baa => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:37.709113 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e102b-166e-418d-ad4f-4d00e1895e56 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:37.721616 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e102b-166e-418d-ad4f-4d00e1895e56 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:37.726881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfce67-5157-4e2b-987a-d59746c4681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:37.728023 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfce67-5157-4e2b-987a-d59746c4681a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.728604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfce67-5157-4e2b-987a-d59746c4681a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.729102 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfce67-5157-4e2b-987a-d59746c4681a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.739009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfce67-5157-4e2b-987a-d59746c4681a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:37.741254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfce67-5157-4e2b-987a-d59746c4681a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:37.752617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 92/182] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:37.759279 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fbe84-11e3-4356-8f94-2d242204c11d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:37.769829 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fbe84-11e3-4356-8f94-2d242204c11d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:37.774829 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a5027-8038-4fd3-8c94-c9ddeaa6a762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:37.776074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5027-8038-4fd3-8c94-c9ddeaa6a762 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.776895 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5027-8038-4fd3-8c94-c9ddeaa6a762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.777381 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5027-8038-4fd3-8c94-c9ddeaa6a762 admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.778211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a55e67-bdeb-43b1-8a3d-a56e32bc3783 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.778503 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a55e67-bdeb-43b1-8a3d-a56e32bc3783 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.778784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a55e67-bdeb-43b1-8a3d-a56e32bc3783 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.779607 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a5027-8038-4fd3-8c94-c9ddeaa6a762 admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:37.780676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 93/183] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:10:37.784997 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a5027-8038-4fd3-8c94-c9ddeaa6a762 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:37.784997 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 91/184] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:37 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:37.788364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04352271-991d-4586-a9ca-2ad0214c6a4c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.788869 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04352271-991d-4586-a9ca-2ad0214c6a4c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.789275 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04352271-991d-4586-a9ca-2ad0214c6a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.791430 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a5027-8038-4fd3-8c94-c9ddeaa6a762 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:37.801571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a5027-8038-4fd3-8c94-c9ddeaa6a762 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:37.806337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100195f9-1dbf-4f25-9523-f8bde5750159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:37.807135 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100195f9-1dbf-4f25-9523-f8bde5750159 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.807518 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100195f9-1dbf-4f25-9523-f8bde5750159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.807925 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100195f9-1dbf-4f25-9523-f8bde5750159 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.808900 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100195f9-1dbf-4f25-9523-f8bde5750159 admin admin] RBAC: Adding query filter params (role.id=4891c5dc7fab4407b20b35b4e6da58a8, scope.project.id=e704e7fbc18741659b80dd56204851de, user.id=e2664a2d309142219cd20e74e8066baa) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:37.809336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100195f9-1dbf-4f25-9523-f8bde5750159 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:37.810668 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-04352271-991d-4586-a9ca-2ad0214c6a4c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:37.811452 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100195f9-1dbf-4f25-9523-f8bde5750159 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:37.812258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-04352271-991d-4586-a9ca-2ad0214c6a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:37.819218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 92/185] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:10:37 2021] GET /identity/v3/role_assignments?user.id=e2664a2d309142219cd20e74e8066baa&scope.project.id=e704e7fbc18741659b80dd56204851de&role.id=4891c5dc7fab4407b20b35b4e6da58a8 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:37.830434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 94/186] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:37.858172 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100195f9-1dbf-4f25-9523-f8bde5750159 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:37.881214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100195f9-1dbf-4f25-9523-f8bde5750159 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:37.887287 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65a67f-8c3c-4a3c-9c2b-5a2a9ffcd95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:37.888519 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65a67f-8c3c-4a3c-9c2b-5a2a9ffcd95e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.889009 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65a67f-8c3c-4a3c-9c2b-5a2a9ffcd95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.889433 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65a67f-8c3c-4a3c-9c2b-5a2a9ffcd95e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.891131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65a67f-8c3c-4a3c-9c2b-5a2a9ffcd95e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:37.893377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65a67f-8c3c-4a3c-9c2b-5a2a9ffcd95e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:37.895419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 93/187] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:37 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:37.902402 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04352271-991d-4586-a9ca-2ad0214c6a4c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:37.913275 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04352271-991d-4586-a9ca-2ad0214c6a4c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:37.918349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da25d2-493d-4a8f-b15c-cadf53ee69e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:37.919395 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da25d2-493d-4a8f-b15c-cadf53ee69e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:37.919946 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da25d2-493d-4a8f-b15c-cadf53ee69e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:37.920425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da25d2-493d-4a8f-b15c-cadf53ee69e5 admin admin] PATH_INFO: `/v3/groups` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:37.921313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da25d2-493d-4a8f-b15c-cadf53ee69e5 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:37.922524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-84da25d2-493d-4a8f-b15c-cadf53ee69e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:37.922524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:10:37.922524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:10:37.924837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da25d2-493d-4a8f-b15c-cadf53ee69e5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:38.006590 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 95/188] 10.222.0.87 () {60 vars in 1155 bytes} [Fri Oct 29 01:10:37 2021] POST /identity/v3/groups => generated 229 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:10:39.030981 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02547-b1be-4ef9-a7e2-5b7e26a533f7 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:39.031855 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02547-b1be-4ef9-a7e2-5b7e26a533f7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:39.032844 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02547-b1be-4ef9-a7e2-5b7e26a533f7 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:39.035148 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 94/189] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:39.041732 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f25b6a-f944-4aa9-bb9d-b5d8af515f12 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:39.042556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f25b6a-f944-4aa9-bb9d-b5d8af515f12 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:39.042991 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f25b6a-f944-4aa9-bb9d-b5d8af515f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:39.063863 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-b9f25b6a-f944-4aa9-bb9d-b5d8af515f12 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:39.065365 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b9f25b6a-f944-4aa9-bb9d-b5d8af515f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:39.074118 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 96/190] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:39.101500 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc02547-b1be-4ef9-a7e2-5b7e26a533f7 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:39.115886 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc02547-b1be-4ef9-a7e2-5b7e26a533f7 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:39.120673 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42392e8b-af5f-4a90-85ae-c7ac908eeca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:39.121784 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42392e8b-af5f-4a90-85ae-c7ac908eeca4 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:39.122207 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42392e8b-af5f-4a90-85ae-c7ac908eeca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:39.122680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42392e8b-af5f-4a90-85ae-c7ac908eeca4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:39.135458 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42392e8b-af5f-4a90-85ae-c7ac908eeca4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:39.142691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-42392e8b-af5f-4a90-85ae-c7ac908eeca4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:39.144137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 95/191] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:39.150715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f25b6a-f944-4aa9-bb9d-b5d8af515f12 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:39.160857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f25b6a-f944-4aa9-bb9d-b5d8af515f12 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:39.165612 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31816245-f640-4a02-9c51-c45fa20380b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:39.166554 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31816245-f640-4a02-9c51-c45fa20380b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:39.166976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31816245-f640-4a02-9c51-c45fa20380b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:39.167385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31816245-f640-4a02-9c51-c45fa20380b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:39.168346 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31816245-f640-4a02-9c51-c45fa20380b8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:39.168802 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31816245-f640-4a02-9c51-c45fa20380b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:39.170571 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31816245-f640-4a02-9c51-c45fa20380b8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:39.180170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 97/192] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:39.186642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42392e8b-af5f-4a90-85ae-c7ac908eeca4 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:39.199643 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42392e8b-af5f-4a90-85ae-c7ac908eeca4 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:39.206116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08072c5-d6f1-4839-948a-9b5eba9905ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:39.207225 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08072c5-d6f1-4839-948a-9b5eba9905ab admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:39.207662 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08072c5-d6f1-4839-948a-9b5eba9905ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:39.208098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08072c5-d6f1-4839-948a-9b5eba9905ab admin admin] PATH_INFO: `/v3/users/e2664a2d309142219cd20e74e8066baa` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:39.209510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08072c5-d6f1-4839-948a-9b5eba9905ab admin admin] RBAC: Authorizing `identity:get_user(user_id=e2664a2d309142219cd20e74e8066baa)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:39.211823 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08072c5-d6f1-4839-948a-9b5eba9905ab admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:39.213632 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 96/193] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:39 2021] GET /identity/v3/users/e2664a2d309142219cd20e74e8066baa => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:39.220356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31816245-f640-4a02-9c51-c45fa20380b8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:39.230965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31816245-f640-4a02-9c51-c45fa20380b8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:39.236211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcf883-5884-4b53-a7d3-f9a16861345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:39.237237 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcf883-5884-4b53-a7d3-f9a16861345f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:39.237681 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcf883-5884-4b53-a7d3-f9a16861345f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:39.238087 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcf883-5884-4b53-a7d3-f9a16861345f admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:39.239455 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcf883-5884-4b53-a7d3-f9a16861345f admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:39.241671 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcf883-5884-4b53-a7d3-f9a16861345f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:39.243508 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 98/194] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:39 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:39.250117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08072c5-d6f1-4839-948a-9b5eba9905ab admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:39.260906 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08072c5-d6f1-4839-948a-9b5eba9905ab admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:39.265736 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff6596-9275-4fd6-ab98-801c745401ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:39.267527 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6596-9275-4fd6-ab98-801c745401ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:39.268003 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6596-9275-4fd6-ab98-801c745401ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:39.268428 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6596-9275-4fd6-ab98-801c745401ef admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de/users/e2664a2d309142219cd20e74e8066baa/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:39.270631 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff6596-9275-4fd6-ab98-801c745401ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e704e7fbc18741659b80dd56204851de, user_id=e2664a2d309142219cd20e74e8066baa, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:39.273510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff6596-9275-4fd6-ab98-801c745401ef admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:39.385353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 97/195] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:10:39 2021] PUT /identity/v3/projects/e704e7fbc18741659b80dd56204851de/users/e2664a2d309142219cd20e74e8066baa/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:10:40.053059 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f4ca-fdd2-467a-b8cb-ea646eb6a936 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.053587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f4ca-fdd2-467a-b8cb-ea646eb6a936 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.053587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f4ca-fdd2-467a-b8cb-ea646eb6a936 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.055641 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 99/196] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:40.062476 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd5245-a0af-4e1f-af95-f6d41493f789 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.064057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd5245-a0af-4e1f-af95-f6d41493f789 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.064551 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd5245-a0af-4e1f-af95-f6d41493f789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.084320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-dbcd5245-a0af-4e1f-af95-f6d41493f789 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:40.085898 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-dbcd5245-a0af-4e1f-af95-f6d41493f789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:40.152844 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 98/197] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:40.176667 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34f4ca-fdd2-467a-b8cb-ea646eb6a936 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:40.189978 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34f4ca-fdd2-467a-b8cb-ea646eb6a936 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:40.194703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38044b30-8153-45e9-8ea6-46aac948bf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:40.195492 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38044b30-8153-45e9-8ea6-46aac948bf48 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.195808 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38044b30-8153-45e9-8ea6-46aac948bf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.196088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38044b30-8153-45e9-8ea6-46aac948bf48 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.208188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38044b30-8153-45e9-8ea6-46aac948bf48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:40.212576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d934e-0e89-49ac-af3d-715792fd9fcf None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.212863 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d934e-0e89-49ac-af3d-715792fd9fcf None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.213139 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d934e-0e89-49ac-af3d-715792fd9fcf None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.215200 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 99/198] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:10:40.215317 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-38044b30-8153-45e9-8ea6-46aac948bf48 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:10:40.216767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 100/199] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:10:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:40.221114 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed58b30-ed0d-4021-944b-bd5535085db3 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.221395 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed58b30-ed0d-4021-944b-bd5535085db3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.221666 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed58b30-ed0d-4021-944b-bd5535085db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.223207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38044b30-8153-45e9-8ea6-46aac948bf48 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:40.235606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38044b30-8153-45e9-8ea6-46aac948bf48 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:40.240397 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc794ee-a6c1-4559-b2cb-2b3806d352bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:40.241052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc794ee-a6c1-4559-b2cb-2b3806d352bc admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.241322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8ed58b30-ed0d-4021-944b-bd5535085db3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:40.241420 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc794ee-a6c1-4559-b2cb-2b3806d352bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.241612 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc794ee-a6c1-4559-b2cb-2b3806d352bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.242367 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc794ee-a6c1-4559-b2cb-2b3806d352bc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:40.242542 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8ed58b30-ed0d-4021-944b-bd5535085db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:40.242711 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc794ee-a6c1-4559-b2cb-2b3806d352bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:40.244361 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc794ee-a6c1-4559-b2cb-2b3806d352bc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:40.251689 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 100/200] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:40.253698 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 101/201] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:40.260389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed58b30-ed0d-4021-944b-bd5535085db3 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:40.270771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed58b30-ed0d-4021-944b-bd5535085db3 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:40.275759 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcfb27-ef70-4812-b000-968dbbe765f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:40.276686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcfb27-ef70-4812-b000-968dbbe765f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.277149 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcfb27-ef70-4812-b000-968dbbe765f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.277599 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcfb27-ef70-4812-b000-968dbbe765f6 admin admin] PATH_INFO: `/v3/users/5644d459227e4d61a1311eb719e23975` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.278959 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc794ee-a6c1-4559-b2cb-2b3806d352bc admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:40.279798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcfb27-ef70-4812-b000-968dbbe765f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=5644d459227e4d61a1311eb719e23975)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:40.282311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcfb27-ef70-4812-b000-968dbbe765f6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:40.284415 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 101/202] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:40 2021] GET /identity/v3/users/5644d459227e4d61a1311eb719e23975 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:40.289977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc794ee-a6c1-4559-b2cb-2b3806d352bc admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:40.290859 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcfb27-ef70-4812-b000-968dbbe765f6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:40.294958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8edad1-316e-4e28-884f-3f8898e46bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:40.295789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8edad1-316e-4e28-884f-3f8898e46bba admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.296075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8edad1-316e-4e28-884f-3f8898e46bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.296572 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8edad1-316e-4e28-884f-3f8898e46bba admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.302216 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcfb27-ef70-4812-b000-968dbbe765f6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:40.306854 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6ef7b-b320-4d62-891b-7d299abfd227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:40.307694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6ef7b-b320-4d62-891b-7d299abfd227 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.316557 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6ef7b-b320-4d62-891b-7d299abfd227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.316557 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6ef7b-b320-4d62-891b-7d299abfd227 admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.316923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8edad1-316e-4e28-884f-3f8898e46bba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:40.317074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6ef7b-b320-4d62-891b-7d299abfd227 admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:40.317074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6ef7b-b320-4d62-891b-7d299abfd227 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:40.317074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 102/203] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:40 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:40.317486 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-7d8edad1-316e-4e28-884f-3f8898e46bba admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 01:10:40.318640 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 102/204] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:10:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:10:40.321409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6ef7b-b320-4d62-891b-7d299abfd227 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:40.325777 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8edad1-316e-4e28-884f-3f8898e46bba admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:40.333195 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6ef7b-b320-4d62-891b-7d299abfd227 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:40.338821 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8edad1-316e-4e28-884f-3f8898e46bba admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:40.339646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59344fc-6235-4ace-8084-44651f8997e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:40.342582 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59344fc-6235-4ace-8084-44651f8997e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.342851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59344fc-6235-4ace-8084-44651f8997e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.343085 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59344fc-6235-4ace-8084-44651f8997e3 admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de/users/5644d459227e4d61a1311eb719e23975/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.343808 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0b4b2-e3ab-4af2-8d50-77456397ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:40.344543 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0b4b2-e3ab-4af2-8d50-77456397ff90 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.344830 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0b4b2-e3ab-4af2-8d50-77456397ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.345160 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0b4b2-e3ab-4af2-8d50-77456397ff90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.345776 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59344fc-6235-4ace-8084-44651f8997e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e704e7fbc18741659b80dd56204851de, user_id=5644d459227e4d61a1311eb719e23975, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:40.346009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0b4b2-e3ab-4af2-8d50-77456397ff90 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:40.346308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0b4b2-e3ab-4af2-8d50-77456397ff90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:40.347944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0b4b2-e3ab-4af2-8d50-77456397ff90 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:40.348417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59344fc-6235-4ace-8084-44651f8997e3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:40.358891 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 103/205] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:10:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:40.365912 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0b4b2-e3ab-4af2-8d50-77456397ff90 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:40.375635 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0b4b2-e3ab-4af2-8d50-77456397ff90 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:40.380587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd64732-6262-49a5-b742-4c1fa0869bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:40.381435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd64732-6262-49a5-b742-4c1fa0869bba admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.381715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd64732-6262-49a5-b742-4c1fa0869bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.381988 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd64732-6262-49a5-b742-4c1fa0869bba admin admin] PATH_INFO: `/v3/users/e2664a2d309142219cd20e74e8066baa` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.383191 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd64732-6262-49a5-b742-4c1fa0869bba admin admin] RBAC: Authorizing `identity:get_user(user_id=e2664a2d309142219cd20e74e8066baa)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:40.385328 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd64732-6262-49a5-b742-4c1fa0869bba admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:40.386931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 104/206] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:40 2021] GET /identity/v3/users/e2664a2d309142219cd20e74e8066baa => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:40.394101 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd64732-6262-49a5-b742-4c1fa0869bba admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:40.403995 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd64732-6262-49a5-b742-4c1fa0869bba admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:40.408385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7e049-1376-456f-9eb1-01f94f4aeeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:40.409207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e049-1376-456f-9eb1-01f94f4aeeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.409488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e049-1376-456f-9eb1-01f94f4aeeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.413979 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e049-1376-456f-9eb1-01f94f4aeeb7 admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.413979 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7e049-1376-456f-9eb1-01f94f4aeeb7 admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:40.413979 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7e049-1376-456f-9eb1-01f94f4aeeb7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:40.414580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 105/207] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:40 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:40.420659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7e049-1376-456f-9eb1-01f94f4aeeb7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:40.431190 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7e049-1376-456f-9eb1-01f94f4aeeb7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:40.435782 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402ca4b-57ea-45c1-9639-8c0dffc708aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:40.436705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402ca4b-57ea-45c1-9639-8c0dffc708aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.437042 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402ca4b-57ea-45c1-9639-8c0dffc708aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.437319 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402ca4b-57ea-45c1-9639-8c0dffc708aa admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de/users/e2664a2d309142219cd20e74e8066baa/roles/4891c5dc7fab4407b20b35b4e6da58a8` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.440470 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402ca4b-57ea-45c1-9639-8c0dffc708aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e704e7fbc18741659b80dd56204851de, user_id=e2664a2d309142219cd20e74e8066baa, role_id=4891c5dc7fab4407b20b35b4e6da58a8)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:40.441363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 103/208] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:10:40 2021] PUT /identity/v3/projects/e704e7fbc18741659b80dd56204851de/users/5644d459227e4d61a1311eb719e23975/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:10:40.443542 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402ca4b-57ea-45c1-9639-8c0dffc708aa admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:40.489011 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8bcd5-afb8-4b00-972b-7ff19be9763b None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.489299 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8bcd5-afb8-4b00-972b-7ff19be9763b None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.489575 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8bcd5-afb8-4b00-972b-7ff19be9763b None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.491514 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 104/209] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:10:40.498024 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346510e-db78-4a12-96d6-7cda5b21ed8d None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.498532 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346510e-db78-4a12-96d6-7cda5b21ed8d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.498956 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346510e-db78-4a12-96d6-7cda5b21ed8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.522164 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-3346510e-db78-4a12-96d6-7cda5b21ed8d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:40.523696 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3346510e-db78-4a12-96d6-7cda5b21ed8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:40.539172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 106/210] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:10:40 2021] PUT /identity/v3/projects/e704e7fbc18741659b80dd56204851de/users/e2664a2d309142219cd20e74e8066baa/roles/4891c5dc7fab4407b20b35b4e6da58a8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:10:40.721386 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 105/211] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:40.747280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402ca4b-57ea-45c1-9639-8c0dffc708aa admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:40.813470 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402ca4b-57ea-45c1-9639-8c0dffc708aa admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:40.818214 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850d3a3-e1a9-48c1-91be-3cac9d096bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:40.819617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850d3a3-e1a9-48c1-91be-3cac9d096bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.820070 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850d3a3-e1a9-48c1-91be-3cac9d096bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.820480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850d3a3-e1a9-48c1-91be-3cac9d096bb2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.821946 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850d3a3-e1a9-48c1-91be-3cac9d096bb2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:40.823806 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850d3a3-e1a9-48c1-91be-3cac9d096bb2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:40.825572 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 107/212] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:40 2021] GET /identity/v3/domains/default => generated 199 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:40.831933 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346510e-db78-4a12-96d6-7cda5b21ed8d None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:40.841180 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346510e-db78-4a12-96d6-7cda5b21ed8d None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:40.846596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9c57e-8eb1-4075-9057-167ba31a2b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:40.847423 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9c57e-8eb1-4075-9057-167ba31a2b35 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:40.847890 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9c57e-8eb1-4075-9057-167ba31a2b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:40.848302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9c57e-8eb1-4075-9057-167ba31a2b35 admin admin] PATH_INFO: `/v3/groups` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:40.849166 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9c57e-8eb1-4075-9057-167ba31a2b35 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:40.850325 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-44f9c57e-8eb1-4075-9057-167ba31a2b35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:40.850325 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:10:40.850325 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:10:40.851775 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9c57e-8eb1-4075-9057-167ba31a2b35 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:40.983389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 106/213] 10.222.0.87 () {60 vars in 1155 bytes} [Fri Oct 29 01:10:40 2021] POST /identity/v3/groups => generated 226 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:10:41.817497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa00593-4503-450e-97c7-81e7afb4f2fe None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:41.817999 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa00593-4503-450e-97c7-81e7afb4f2fe None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:41.818094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa00593-4503-450e-97c7-81e7afb4f2fe None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:41.820254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 108/214] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:10:41.826494 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e17ae-1f12-4135-8fa5-e001abde96a9 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:41.826956 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e17ae-1f12-4135-8fa5-e001abde96a9 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:41.827031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e17ae-1f12-4135-8fa5-e001abde96a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:41.850360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-329e17ae-1f12-4135-8fa5-e001abde96a9 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:41.851599 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-329e17ae-1f12-4135-8fa5-e001abde96a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:41.862957 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 107/215] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:41.895513 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa00593-4503-450e-97c7-81e7afb4f2fe None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:41.910020 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa00593-4503-450e-97c7-81e7afb4f2fe None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:41.917269 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2a72f-1445-4dca-a62e-da7ed91b6641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:41.918078 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2a72f-1445-4dca-a62e-da7ed91b6641 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:41.918350 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2a72f-1445-4dca-a62e-da7ed91b6641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:41.918677 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2a72f-1445-4dca-a62e-da7ed91b6641 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:41.930928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2a72f-1445-4dca-a62e-da7ed91b6641 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:41.939510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-69f2a72f-1445-4dca-a62e-da7ed91b6641 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:41.941006 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 109/216] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:41.947849 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e17ae-1f12-4135-8fa5-e001abde96a9 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:41.960222 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e17ae-1f12-4135-8fa5-e001abde96a9 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:41.964816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f09e-ed75-41a8-a3f4-813b58bbf411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:41.965499 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f09e-ed75-41a8-a3f4-813b58bbf411 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:41.965782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f09e-ed75-41a8-a3f4-813b58bbf411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:41.966057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f09e-ed75-41a8-a3f4-813b58bbf411 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:41.966836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7f09e-ed75-41a8-a3f4-813b58bbf411 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:41.967141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7f09e-ed75-41a8-a3f4-813b58bbf411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:41.968765 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7f09e-ed75-41a8-a3f4-813b58bbf411 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:41.982242 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 108/217] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:41.989034 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2a72f-1445-4dca-a62e-da7ed91b6641 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:41.999009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2a72f-1445-4dca-a62e-da7ed91b6641 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:42.008090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d537bbd-c791-4079-b3b0-89e8a1a99a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:42.008964 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d537bbd-c791-4079-b3b0-89e8a1a99a1e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:42.009243 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d537bbd-c791-4079-b3b0-89e8a1a99a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:42.009515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d537bbd-c791-4079-b3b0-89e8a1a99a1e admin admin] PATH_INFO: `/v3/users/e2664a2d309142219cd20e74e8066baa` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:42.010739 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d537bbd-c791-4079-b3b0-89e8a1a99a1e admin admin] RBAC: Authorizing `identity:get_user(user_id=e2664a2d309142219cd20e74e8066baa)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:42.012888 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d537bbd-c791-4079-b3b0-89e8a1a99a1e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:42.014493 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 110/218] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:41 2021] GET /identity/v3/users/e2664a2d309142219cd20e74e8066baa => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:42.021336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f09e-ed75-41a8-a3f4-813b58bbf411 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:42.032914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f09e-ed75-41a8-a3f4-813b58bbf411 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:42.046371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146530dc-923f-4d6f-b38e-8fa813459685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:42.048118 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146530dc-923f-4d6f-b38e-8fa813459685 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:42.049318 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146530dc-923f-4d6f-b38e-8fa813459685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:42.049878 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146530dc-923f-4d6f-b38e-8fa813459685 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:42.066932 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146530dc-923f-4d6f-b38e-8fa813459685 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:42.069506 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146530dc-923f-4d6f-b38e-8fa813459685 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:42.084872 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 109/219] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:42 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:42.090707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d537bbd-c791-4079-b3b0-89e8a1a99a1e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:42.105062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d537bbd-c791-4079-b3b0-89e8a1a99a1e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:42.116070 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b1da8-0e38-4614-9d38-bf2c8fa817c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:42.116923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1da8-0e38-4614-9d38-bf2c8fa817c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:42.117201 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1da8-0e38-4614-9d38-bf2c8fa817c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:42.117471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1da8-0e38-4614-9d38-bf2c8fa817c5 admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:42.118670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b1da8-0e38-4614-9d38-bf2c8fa817c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:42.120752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b1da8-0e38-4614-9d38-bf2c8fa817c5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:42.122659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 111/220] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:42 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:42.129241 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146530dc-923f-4d6f-b38e-8fa813459685 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:42.138942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146530dc-923f-4d6f-b38e-8fa813459685 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:42.147515 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb385c8e-c2fd-49e2-bf20-e5716569f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:42.148606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385c8e-c2fd-49e2-bf20-e5716569f870 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:42.149097 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385c8e-c2fd-49e2-bf20-e5716569f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:42.149613 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385c8e-c2fd-49e2-bf20-e5716569f870 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:42.150699 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb385c8e-c2fd-49e2-bf20-e5716569f870 admin admin] RBAC: Adding query filter params (role.id=999d570f97da49269327a60c1acf21d2, scope.project.id=e704e7fbc18741659b80dd56204851de, user.id=e2664a2d309142219cd20e74e8066baa) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:42.151280 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb385c8e-c2fd-49e2-bf20-e5716569f870 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:42.153438 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb385c8e-c2fd-49e2-bf20-e5716569f870 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:42.165913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 110/221] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:10:42 2021] GET /identity/v3/role_assignments?user.id=e2664a2d309142219cd20e74e8066baa&scope.project.id=e704e7fbc18741659b80dd56204851de&role.id=999d570f97da49269327a60c1acf21d2 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:43.226181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773751f6-1b46-4885-92cd-35b220a775b2 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.226661 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773751f6-1b46-4885-92cd-35b220a775b2 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.226661 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773751f6-1b46-4885-92cd-35b220a775b2 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.228485 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 112/222] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:43.234701 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4727f-237e-449a-ae4c-01853a75f8c1 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.235767 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4727f-237e-449a-ae4c-01853a75f8c1 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.235998 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4727f-237e-449a-ae4c-01853a75f8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.256761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-b4a4727f-237e-449a-ae4c-01853a75f8c1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:43.257972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b4a4727f-237e-449a-ae4c-01853a75f8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:43.272393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 111/223] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:43.297553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451933da-a5b8-4ea1-b471-0f741d6a225c None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.298009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451933da-a5b8-4ea1-b471-0f741d6a225c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.298330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451933da-a5b8-4ea1-b471-0f741d6a225c None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.300500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 113/224] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:43.306393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366ab96-02dd-440f-938b-50b2e5d7881f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.318805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366ab96-02dd-440f-938b-50b2e5d7881f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.318805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366ab96-02dd-440f-938b-50b2e5d7881f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.319253 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451933da-a5b8-4ea1-b471-0f741d6a225c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:43.338956 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451933da-a5b8-4ea1-b471-0f741d6a225c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:43.347560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-7366ab96-02dd-440f-938b-50b2e5d7881f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:43.348781 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7366ab96-02dd-440f-938b-50b2e5d7881f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:43.350217 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5af4ce-7333-4f2a-9635-3dd883abaca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:43.351032 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5af4ce-7333-4f2a-9635-3dd883abaca0 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.351305 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5af4ce-7333-4f2a-9635-3dd883abaca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.351573 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5af4ce-7333-4f2a-9635-3dd883abaca0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.366183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 112/225] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:43.369204 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5af4ce-7333-4f2a-9635-3dd883abaca0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:43.381260 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-8b5af4ce-7333-4f2a-9635-3dd883abaca0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 01:10:43.382523 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 114/226] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:10:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:43.389111 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366ab96-02dd-440f-938b-50b2e5d7881f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:43.402943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366ab96-02dd-440f-938b-50b2e5d7881f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:43.405446 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5af4ce-7333-4f2a-9635-3dd883abaca0 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:43.413954 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede563b-3a20-4c64-a284-2f286570f685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:43.414639 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede563b-3a20-4c64-a284-2f286570f685 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.414914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede563b-3a20-4c64-a284-2f286570f685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.415185 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede563b-3a20-4c64-a284-2f286570f685 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.416002 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede563b-3a20-4c64-a284-2f286570f685 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:43.416306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede563b-3a20-4c64-a284-2f286570f685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:43.417895 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5af4ce-7333-4f2a-9635-3dd883abaca0 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:43.418105 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede563b-3a20-4c64-a284-2f286570f685 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:43.430045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 113/227] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:10:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:43.436781 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4075b13-fb00-4bcc-b7dd-e467f00af37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:43.437676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4075b13-fb00-4bcc-b7dd-e467f00af37b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.437958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4075b13-fb00-4bcc-b7dd-e467f00af37b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.438484 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4075b13-fb00-4bcc-b7dd-e467f00af37b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.444639 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede563b-3a20-4c64-a284-2f286570f685 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:43.464372 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede563b-3a20-4c64-a284-2f286570f685 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:43.466184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4075b13-fb00-4bcc-b7dd-e467f00af37b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:43.473450 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-e4075b13-fb00-4bcc-b7dd-e467f00af37b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:10:43.481592 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 115/228] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:10:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:10:43.484162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544a177-defb-41d1-89b5-46d5240066f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:43.485604 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544a177-defb-41d1-89b5-46d5240066f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.485880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544a177-defb-41d1-89b5-46d5240066f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.486155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544a177-defb-41d1-89b5-46d5240066f8 admin admin] PATH_INFO: `/v3/users/e2664a2d309142219cd20e74e8066baa` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.487644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4075b13-fb00-4bcc-b7dd-e467f00af37b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:43.488722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544a177-defb-41d1-89b5-46d5240066f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=e2664a2d309142219cd20e74e8066baa)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:43.490845 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544a177-defb-41d1-89b5-46d5240066f8 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:43.497032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 114/229] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:43 2021] GET /identity/v3/users/e2664a2d309142219cd20e74e8066baa => generated 283 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:43.504174 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544a177-defb-41d1-89b5-46d5240066f8 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:43.506388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4075b13-fb00-4bcc-b7dd-e467f00af37b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:43.516714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544a177-defb-41d1-89b5-46d5240066f8 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:43.525444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145618e-fcfb-46dc-b3c9-4e351dbe5f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:43.526151 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145618e-fcfb-46dc-b3c9-4e351dbe5f26 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.526427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145618e-fcfb-46dc-b3c9-4e351dbe5f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.526682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145618e-fcfb-46dc-b3c9-4e351dbe5f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.527460 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145618e-fcfb-46dc-b3c9-4e351dbe5f26 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:43.532528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145618e-fcfb-46dc-b3c9-4e351dbe5f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:43.534488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145618e-fcfb-46dc-b3c9-4e351dbe5f26 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:43.534859 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b3602-5fe7-4167-8491-789e201f5389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:43.535891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b3602-5fe7-4167-8491-789e201f5389 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.536391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b3602-5fe7-4167-8491-789e201f5389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.537015 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b3602-5fe7-4167-8491-789e201f5389 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.548052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 116/230] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:43.554165 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b3602-5fe7-4167-8491-789e201f5389 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:43.554673 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145618e-fcfb-46dc-b3c9-4e351dbe5f26 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:43.556803 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b3602-5fe7-4167-8491-789e201f5389 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:43.568444 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 115/231] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:10:43.582635 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145618e-fcfb-46dc-b3c9-4e351dbe5f26 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:43.583933 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b3602-5fe7-4167-8491-789e201f5389 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:43.591870 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276d391-3722-4959-96d3-ccfb77462594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:43.592727 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276d391-3722-4959-96d3-ccfb77462594 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.593001 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276d391-3722-4959-96d3-ccfb77462594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.593267 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276d391-3722-4959-96d3-ccfb77462594 admin admin] PATH_INFO: `/v3/users/5644d459227e4d61a1311eb719e23975` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.600148 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b3602-5fe7-4167-8491-789e201f5389 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:43.600671 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276d391-3722-4959-96d3-ccfb77462594 admin admin] RBAC: Authorizing `identity:get_user(user_id=5644d459227e4d61a1311eb719e23975)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:43.602508 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276d391-3722-4959-96d3-ccfb77462594 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:43.604599 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 117/232] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:10:43 2021] GET /identity/v3/users/5644d459227e4d61a1311eb719e23975 => generated 247 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:43.606565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cfb08-4d95-4cfa-8384-5b4fac5efaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:43.607722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cfb08-4d95-4cfa-8384-5b4fac5efaac admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.608228 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cfb08-4d95-4cfa-8384-5b4fac5efaac admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.608738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cfb08-4d95-4cfa-8384-5b4fac5efaac admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.610960 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cfb08-4d95-4cfa-8384-5b4fac5efaac admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:43.612435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276d391-3722-4959-96d3-ccfb77462594 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:43.613763 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cfb08-4d95-4cfa-8384-5b4fac5efaac admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:43.624191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 116/233] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:43 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:43.626157 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cfb08-4d95-4cfa-8384-5b4fac5efaac admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:43.634208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276d391-3722-4959-96d3-ccfb77462594 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:43.637414 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cfb08-4d95-4cfa-8384-5b4fac5efaac admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:43.648309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0974ca-62b1-426a-bed6-cb45b8d61676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:43.649356 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0974ca-62b1-426a-bed6-cb45b8d61676 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.649864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0974ca-62b1-426a-bed6-cb45b8d61676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.650538 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0974ca-62b1-426a-bed6-cb45b8d61676 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.651760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0974ca-62b1-426a-bed6-cb45b8d61676 admin admin] RBAC: Adding query filter params (role.id=4891c5dc7fab4407b20b35b4e6da58a8, scope.project.id=e704e7fbc18741659b80dd56204851de, user.id=e2664a2d309142219cd20e74e8066baa) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:43.652316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0974ca-62b1-426a-bed6-cb45b8d61676 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:43.654538 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0974ca-62b1-426a-bed6-cb45b8d61676 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:43.667784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6fd2b-da0f-44d6-8a12-17640ff45e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:43.667784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6fd2b-da0f-44d6-8a12-17640ff45e0d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.667784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6fd2b-da0f-44d6-8a12-17640ff45e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.667784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6fd2b-da0f-44d6-8a12-17640ff45e0d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.669468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 117/234] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:10:43 2021] GET /identity/v3/role_assignments?user.id=e2664a2d309142219cd20e74e8066baa&scope.project.id=e704e7fbc18741659b80dd56204851de&role.id=4891c5dc7fab4407b20b35b4e6da58a8 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:43.690089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6fd2b-da0f-44d6-8a12-17640ff45e0d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:43.691978 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6fd2b-da0f-44d6-8a12-17640ff45e0d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:43.706106 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 118/235] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:43.712696 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0974ca-62b1-426a-bed6-cb45b8d61676 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:43.726663 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0974ca-62b1-426a-bed6-cb45b8d61676 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:43.738559 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc03d0-f15f-47bf-89e3-7cab94b655a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:43.739929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc03d0-f15f-47bf-89e3-7cab94b655a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.740495 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc03d0-f15f-47bf-89e3-7cab94b655a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.741032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc03d0-f15f-47bf-89e3-7cab94b655a5 admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.743038 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc03d0-f15f-47bf-89e3-7cab94b655a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:43.745694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc03d0-f15f-47bf-89e3-7cab94b655a5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:43.747974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 118/236] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:43 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:43.756147 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6fd2b-da0f-44d6-8a12-17640ff45e0d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:43.769234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6fd2b-da0f-44d6-8a12-17640ff45e0d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:43.779496 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fee38-236c-4539-b8fe-f085fed1f06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:43.780196 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fee38-236c-4539-b8fe-f085fed1f06e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:43.780471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fee38-236c-4539-b8fe-f085fed1f06e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:43.780741 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fee38-236c-4539-b8fe-f085fed1f06e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:43.781599 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fee38-236c-4539-b8fe-f085fed1f06e admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=e704e7fbc18741659b80dd56204851de, user.id=5644d459227e4d61a1311eb719e23975) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:43.782429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fee38-236c-4539-b8fe-f085fed1f06e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:43.788417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fee38-236c-4539-b8fe-f085fed1f06e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:43.794933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 119/237] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:10:43 2021] GET /identity/v3/role_assignments?user.id=5644d459227e4d61a1311eb719e23975&scope.project.id=e704e7fbc18741659b80dd56204851de&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:44.555212 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79275e5f-b6c6-4827-896d-7f982c7f06bc None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:44.556260 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79275e5f-b6c6-4827-896d-7f982c7f06bc None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:44.556758 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79275e5f-b6c6-4827-896d-7f982c7f06bc None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:44.559155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 119/238] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:44.566338 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811934d-0825-495c-93cd-5b83be2b89f1 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:44.567264 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811934d-0825-495c-93cd-5b83be2b89f1 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:44.567811 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811934d-0825-495c-93cd-5b83be2b89f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:44.596996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-f811934d-0825-495c-93cd-5b83be2b89f1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:44.598756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-f811934d-0825-495c-93cd-5b83be2b89f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:44.607765 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 120/239] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:44.654613 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79275e5f-b6c6-4827-896d-7f982c7f06bc None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:44.674141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79275e5f-b6c6-4827-896d-7f982c7f06bc None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:44.679148 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf5460-d59b-4c81-9d4e-79065e8c7e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:44.680252 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5460-d59b-4c81-9d4e-79065e8c7e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:44.680779 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5460-d59b-4c81-9d4e-79065e8c7e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:44.681281 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5460-d59b-4c81-9d4e-79065e8c7e99 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:44.699678 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf5460-d59b-4c81-9d4e-79065e8c7e99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:44.707834 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-6cbf5460-d59b-4c81-9d4e-79065e8c7e99 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:44.709399 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 120/240] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:44.716270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811934d-0825-495c-93cd-5b83be2b89f1 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:44.726750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811934d-0825-495c-93cd-5b83be2b89f1 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:44.734887 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3196eb-b918-4e0e-8cb9-61fdd464834d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:44.736079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3196eb-b918-4e0e-8cb9-61fdd464834d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:44.736572 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3196eb-b918-4e0e-8cb9-61fdd464834d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:44.737051 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3196eb-b918-4e0e-8cb9-61fdd464834d admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:44.738209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3196eb-b918-4e0e-8cb9-61fdd464834d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:44.738766 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3196eb-b918-4e0e-8cb9-61fdd464834d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:44.740609 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3196eb-b918-4e0e-8cb9-61fdd464834d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:44.752337 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 121/241] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:44.759065 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf5460-d59b-4c81-9d4e-79065e8c7e99 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:44.770784 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf5460-d59b-4c81-9d4e-79065e8c7e99 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:44.782572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9df962-3e72-4529-8a62-12b37afbede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:44.783812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df962-3e72-4529-8a62-12b37afbede7 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:44.784313 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df962-3e72-4529-8a62-12b37afbede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:44.784792 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df962-3e72-4529-8a62-12b37afbede7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:44.794496 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9df962-3e72-4529-8a62-12b37afbede7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:44.796711 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9df962-3e72-4529-8a62-12b37afbede7 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:44.810994 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 121/242] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:44.819546 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3196eb-b918-4e0e-8cb9-61fdd464834d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:44.831422 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3196eb-b918-4e0e-8cb9-61fdd464834d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:44.838970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a95d8-1947-431c-81e8-1a82dcb8ed9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:44.840286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a95d8-1947-431c-81e8-1a82dcb8ed9b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:44.840831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a95d8-1947-431c-81e8-1a82dcb8ed9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:44.841332 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a95d8-1947-431c-81e8-1a82dcb8ed9b admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:44.842770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a95d8-1947-431c-81e8-1a82dcb8ed9b admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:44.845205 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a95d8-1947-431c-81e8-1a82dcb8ed9b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:44.847251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 122/243] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:44 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:44.853885 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9df962-3e72-4529-8a62-12b37afbede7 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:44.864328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9df962-3e72-4529-8a62-12b37afbede7 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:44.871563 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f1a74-372d-43e5-ad70-b7bb2fe9ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:44.872831 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f1a74-372d-43e5-ad70-b7bb2fe9ea91 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:44.873344 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f1a74-372d-43e5-ad70-b7bb2fe9ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:44.873871 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f1a74-372d-43e5-ad70-b7bb2fe9ea91 admin admin] PATH_INFO: `/v3/groups/2bb7c2fd7db946379dc2760e14059c6e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:44.887047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f1a74-372d-43e5-ad70-b7bb2fe9ea91 admin admin] RBAC: Authorizing `identity:get_group(group_id=2bb7c2fd7db946379dc2760e14059c6e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:44.888250 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-149f1a74-372d-43e5-ad70-b7bb2fe9ea91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:44.888250 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:10:44.888250 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:10:44.889738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f1a74-372d-43e5-ad70-b7bb2fe9ea91 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:44.892540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 122/244] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:44 2021] GET /identity/v3/groups/2bb7c2fd7db946379dc2760e14059c6e => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:44.899214 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a95d8-1947-431c-81e8-1a82dcb8ed9b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:44.911622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a95d8-1947-431c-81e8-1a82dcb8ed9b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:44.916941 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753507b-db36-40de-85ed-edf23c002e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:44.917826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753507b-db36-40de-85ed-edf23c002e58 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:44.918250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753507b-db36-40de-85ed-edf23c002e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:44.918633 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753507b-db36-40de-85ed-edf23c002e58 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:44.919650 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753507b-db36-40de-85ed-edf23c002e58 admin admin] RBAC: Adding query filter params (group.id=2bb7c2fd7db946379dc2760e14059c6e, role.id=999d570f97da49269327a60c1acf21d2, scope.project.id=3f445e69c8094e37889545aefb002e28) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:44.920122 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753507b-db36-40de-85ed-edf23c002e58 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:44.922213 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753507b-db36-40de-85ed-edf23c002e58 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:44.932192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 123/245] 10.222.0.87 () {56 vars in 1397 bytes} [Fri Oct 29 01:10:44 2021] GET /identity/v3/role_assignments?group.id=2bb7c2fd7db946379dc2760e14059c6e&scope.project.id=3f445e69c8094e37889545aefb002e28&role.id=999d570f97da49269327a60c1acf21d2 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:44.955600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d1d39-14db-44c3-a07f-601040c1efae None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:44.956067 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d1d39-14db-44c3-a07f-601040c1efae None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:44.956459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d1d39-14db-44c3-a07f-601040c1efae None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:44.958588 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 123/246] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:10:44.974668 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a7732-dbe2-4eff-8581-cf84ccd598bf None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:44.975117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a7732-dbe2-4eff-8581-cf84ccd598bf None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:44.975502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a7732-dbe2-4eff-8581-cf84ccd598bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:44.998988 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-385a7732-dbe2-4eff-8581-cf84ccd598bf None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:45.000410 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-385a7732-dbe2-4eff-8581-cf84ccd598bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:45.012550 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 124/247] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:45.054907 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d1d39-14db-44c3-a07f-601040c1efae None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:45.072023 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d1d39-14db-44c3-a07f-601040c1efae None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:45.077140 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e1cee-a327-4705-862d-ee178f8a8c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:45.078200 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e1cee-a327-4705-862d-ee178f8a8c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:45.078481 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e1cee-a327-4705-862d-ee178f8a8c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:45.078953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e1cee-a327-4705-862d-ee178f8a8c30 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:45.093853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e1cee-a327-4705-862d-ee178f8a8c30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:45.102260 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-fb5e1cee-a327-4705-862d-ee178f8a8c30 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 01:10:45.103652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 124/248] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:10:45 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:45.110939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a7732-dbe2-4eff-8581-cf84ccd598bf None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:45.126437 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a7732-dbe2-4eff-8581-cf84ccd598bf None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:45.136311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5493b-c0ab-4882-aade-bc4822db2cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:45.137087 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5493b-c0ab-4882-aade-bc4822db2cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:45.137423 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5493b-c0ab-4882-aade-bc4822db2cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:45.137747 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5493b-c0ab-4882-aade-bc4822db2cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:45.138605 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5493b-c0ab-4882-aade-bc4822db2cb4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:45.138955 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5493b-c0ab-4882-aade-bc4822db2cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:45.140920 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5493b-c0ab-4882-aade-bc4822db2cb4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:45.156622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 125/249] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:10:45 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:45.163836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e1cee-a327-4705-862d-ee178f8a8c30 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:45.178803 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e1cee-a327-4705-862d-ee178f8a8c30 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:45.186577 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4b8c1-7451-4cf1-84b8-4aed3e68b6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:45.187241 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4b8c1-7451-4cf1-84b8-4aed3e68b6cd admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:45.187577 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4b8c1-7451-4cf1-84b8-4aed3e68b6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:45.187959 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4b8c1-7451-4cf1-84b8-4aed3e68b6cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:45.207053 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4b8c1-7451-4cf1-84b8-4aed3e68b6cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:45.207053 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4b8c1-7451-4cf1-84b8-4aed3e68b6cd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:45.214807 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 125/250] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:45.222307 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5493b-c0ab-4882-aade-bc4822db2cb4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:45.241685 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5493b-c0ab-4882-aade-bc4822db2cb4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:45.257975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007acb1-9c4d-48cd-8962-aa7dd79e201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:45.259130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007acb1-9c4d-48cd-8962-aa7dd79e201a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:45.259407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007acb1-9c4d-48cd-8962-aa7dd79e201a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:45.259679 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007acb1-9c4d-48cd-8962-aa7dd79e201a admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:45.260970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007acb1-9c4d-48cd-8962-aa7dd79e201a admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:45.263026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007acb1-9c4d-48cd-8962-aa7dd79e201a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:45.264839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 126/251] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:45 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:45.271492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4b8c1-7451-4cf1-84b8-4aed3e68b6cd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:45.284719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4b8c1-7451-4cf1-84b8-4aed3e68b6cd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:45.290543 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4350b-6823-460e-a869-02e88101192a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:45.291673 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4350b-6823-460e-a869-02e88101192a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:45.292223 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4350b-6823-460e-a869-02e88101192a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:45.292708 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4350b-6823-460e-a869-02e88101192a admin admin] PATH_INFO: `/v3/groups/2bb7c2fd7db946379dc2760e14059c6e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:45.294108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4350b-6823-460e-a869-02e88101192a admin admin] RBAC: Authorizing `identity:get_group(group_id=2bb7c2fd7db946379dc2760e14059c6e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:45.296258 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4350b-6823-460e-a869-02e88101192a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:45.299170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 126/252] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:45 2021] GET /identity/v3/groups/2bb7c2fd7db946379dc2760e14059c6e => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:45.306307 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007acb1-9c4d-48cd-8962-aa7dd79e201a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:45.319616 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007acb1-9c4d-48cd-8962-aa7dd79e201a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:45.330023 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17dab4-e4d9-479a-a2a7-b8071042ee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:45.330737 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17dab4-e4d9-479a-a2a7-b8071042ee90 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:45.331089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17dab4-e4d9-479a-a2a7-b8071042ee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:45.331364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17dab4-e4d9-479a-a2a7-b8071042ee90 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:45.332338 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17dab4-e4d9-479a-a2a7-b8071042ee90 admin admin] RBAC: Adding query filter params (group.id=2bb7c2fd7db946379dc2760e14059c6e, role.id=4891c5dc7fab4407b20b35b4e6da58a8, scope.project.id=3f445e69c8094e37889545aefb002e28) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:45.332712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17dab4-e4d9-479a-a2a7-b8071042ee90 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:45.334880 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17dab4-e4d9-479a-a2a7-b8071042ee90 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:45.342080 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 127/253] 10.222.0.87 () {56 vars in 1397 bytes} [Fri Oct 29 01:10:45 2021] GET /identity/v3/role_assignments?group.id=2bb7c2fd7db946379dc2760e14059c6e&scope.project.id=3f445e69c8094e37889545aefb002e28&role.id=4891c5dc7fab4407b20b35b4e6da58a8 => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:45.821621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f4831-210d-473b-8853-0cd0de0b8363 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:45.822137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f4831-210d-473b-8853-0cd0de0b8363 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:45.822211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f4831-210d-473b-8853-0cd0de0b8363 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:45.824260 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 127/254] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:45.830783 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993af4b-08c8-4def-a78f-56afb64e1f06 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:45.831354 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993af4b-08c8-4def-a78f-56afb64e1f06 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:45.831354 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993af4b-08c8-4def-a78f-56afb64e1f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:45.856878 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-c993af4b-08c8-4def-a78f-56afb64e1f06 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:45.858092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c993af4b-08c8-4def-a78f-56afb64e1f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:45.871116 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 128/255] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:45.910192 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f4831-210d-473b-8853-0cd0de0b8363 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:45.929563 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f4831-210d-473b-8853-0cd0de0b8363 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:45.934280 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e852d94-1afc-4059-92f6-825fcd6760dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:45.935078 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e852d94-1afc-4059-92f6-825fcd6760dd admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:45.935360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e852d94-1afc-4059-92f6-825fcd6760dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:45.935631 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e852d94-1afc-4059-92f6-825fcd6760dd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:45.953165 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e852d94-1afc-4059-92f6-825fcd6760dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:45.960478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-8e852d94-1afc-4059-92f6-825fcd6760dd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:45.961724 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 128/256] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:45 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:10:45.968166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993af4b-08c8-4def-a78f-56afb64e1f06 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:45.978088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993af4b-08c8-4def-a78f-56afb64e1f06 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:45.986036 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d18c41-d039-4fea-a0c5-0b56928a938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:45.986726 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d18c41-d039-4fea-a0c5-0b56928a938e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:45.987008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d18c41-d039-4fea-a0c5-0b56928a938e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:45.987277 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d18c41-d039-4fea-a0c5-0b56928a938e admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:45.988103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d18c41-d039-4fea-a0c5-0b56928a938e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:45.988407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d18c41-d039-4fea-a0c5-0b56928a938e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:45.990001 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d18c41-d039-4fea-a0c5-0b56928a938e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:45.999221 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 129/257] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:45 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:46.006429 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e852d94-1afc-4059-92f6-825fcd6760dd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.017919 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e852d94-1afc-4059-92f6-825fcd6760dd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:46.027533 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f2642-3ec6-4293-8575-0ba2fb03645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:46.028217 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f2642-3ec6-4293-8575-0ba2fb03645a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.028504 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f2642-3ec6-4293-8575-0ba2fb03645a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.028778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f2642-3ec6-4293-8575-0ba2fb03645a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.038348 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f2642-3ec6-4293-8575-0ba2fb03645a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:46.040193 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f2642-3ec6-4293-8575-0ba2fb03645a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:46.054616 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 129/258] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:46.060885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d18c41-d039-4fea-a0c5-0b56928a938e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.071287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d18c41-d039-4fea-a0c5-0b56928a938e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:46.080330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f648980-a6a4-48c0-8b8a-66ceaf86f9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:46.081125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f648980-a6a4-48c0-8b8a-66ceaf86f9ac admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.081407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f648980-a6a4-48c0-8b8a-66ceaf86f9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.081682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f648980-a6a4-48c0-8b8a-66ceaf86f9ac admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.082929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f648980-a6a4-48c0-8b8a-66ceaf86f9ac admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:46.085073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f648980-a6a4-48c0-8b8a-66ceaf86f9ac admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:46.086784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 130/259] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:46.092899 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f2642-3ec6-4293-8575-0ba2fb03645a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.102626 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f2642-3ec6-4293-8575-0ba2fb03645a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:46.112624 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9239ab3-43f1-4f74-98c0-05f1f93ab1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:46.113486 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9239ab3-43f1-4f74-98c0-05f1f93ab1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.113767 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9239ab3-43f1-4f74-98c0-05f1f93ab1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.114041 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9239ab3-43f1-4f74-98c0-05f1f93ab1c0 admin admin] PATH_INFO: `/v3/groups/2bb7c2fd7db946379dc2760e14059c6e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.115296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9239ab3-43f1-4f74-98c0-05f1f93ab1c0 admin admin] RBAC: Authorizing `identity:get_group(group_id=2bb7c2fd7db946379dc2760e14059c6e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:46.117245 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9239ab3-43f1-4f74-98c0-05f1f93ab1c0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:46.118880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 130/260] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/groups/2bb7c2fd7db946379dc2760e14059c6e => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:46.125257 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f648980-a6a4-48c0-8b8a-66ceaf86f9ac admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.135962 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f648980-a6a4-48c0-8b8a-66ceaf86f9ac admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:46.144226 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ccf08-c5da-4b75-b038-89fcf6a93765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:46.144884 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccf08-c5da-4b75-b038-89fcf6a93765 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.145166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccf08-c5da-4b75-b038-89fcf6a93765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.145439 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccf08-c5da-4b75-b038-89fcf6a93765 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.146287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ccf08-c5da-4b75-b038-89fcf6a93765 admin admin] RBAC: Adding query filter params (group.id=2bb7c2fd7db946379dc2760e14059c6e, role.id=999d570f97da49269327a60c1acf21d2, scope.project.id=e704e7fbc18741659b80dd56204851de) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:46.146597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ccf08-c5da-4b75-b038-89fcf6a93765 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:46.148532 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ccf08-c5da-4b75-b038-89fcf6a93765 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:46.154933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 131/261] 10.222.0.87 () {56 vars in 1397 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/role_assignments?group.id=2bb7c2fd7db946379dc2760e14059c6e&scope.project.id=e704e7fbc18741659b80dd56204851de&role.id=999d570f97da49269327a60c1acf21d2 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:46.551443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1c581-c9a4-4c0f-a4e5-4fcf3fea356c None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.551854 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1c581-c9a4-4c0f-a4e5-4fcf3fea356c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.552093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1c581-c9a4-4c0f-a4e5-4fcf3fea356c None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.554273 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 131/262] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:46.561875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa4f51-18bf-4dc6-a001-e5277fe510bc None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.562221 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa4f51-18bf-4dc6-a001-e5277fe510bc None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.562558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa4f51-18bf-4dc6-a001-e5277fe510bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.583092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-edaa4f51-18bf-4dc6-a001-e5277fe510bc None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:46.584324 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-edaa4f51-18bf-4dc6-a001-e5277fe510bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:46.597880 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 132/263] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:46.638888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1c581-c9a4-4c0f-a4e5-4fcf3fea356c None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.657408 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1c581-c9a4-4c0f-a4e5-4fcf3fea356c None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:46.665283 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb984895-bd16-48c3-a754-ecea1ff992ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:46.666095 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb984895-bd16-48c3-a754-ecea1ff992ea admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.666368 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb984895-bd16-48c3-a754-ecea1ff992ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.666640 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb984895-bd16-48c3-a754-ecea1ff992ea admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.681301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb984895-bd16-48c3-a754-ecea1ff992ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:46.685495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f357bb-dfc0-4a88-8468-de141c57a780 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.685778 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f357bb-dfc0-4a88-8468-de141c57a780 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.686054 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f357bb-dfc0-4a88-8468-de141c57a780 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.688630 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 133/264] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:46.691238 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-fb984895-bd16-48c3-a754-ecea1ff992ea admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 01:10:46.694331 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 132/265] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:46.701689 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f357bb-dfc0-4a88-8468-de141c57a780 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.702319 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa643e9-964b-4b90-83e6-98f3a5dfa101 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.702660 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa643e9-964b-4b90-83e6-98f3a5dfa101 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.702913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa643e9-964b-4b90-83e6-98f3a5dfa101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.717307 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f357bb-dfc0-4a88-8468-de141c57a780 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:46.724488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4633d4-5367-42b6-9995-19f796ec3e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:46.725154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4633d4-5367-42b6-9995-19f796ec3e4d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.725429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4633d4-5367-42b6-9995-19f796ec3e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.725696 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4633d4-5367-42b6-9995-19f796ec3e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.726520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4633d4-5367-42b6-9995-19f796ec3e4d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:46.726875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4633d4-5367-42b6-9995-19f796ec3e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:46.728603 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4633d4-5367-42b6-9995-19f796ec3e4d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:46.732146 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-0fa643e9-964b-4b90-83e6-98f3a5dfa101 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:46.733361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0fa643e9-964b-4b90-83e6-98f3a5dfa101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:46.740887 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 134/266] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:46.747513 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4633d4-5367-42b6-9995-19f796ec3e4d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.754452 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 133/267] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:46.761695 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4633d4-5367-42b6-9995-19f796ec3e4d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:46.766818 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31294c-2b90-47f1-987d-9481a8ff7244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:46.767515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31294c-2b90-47f1-987d-9481a8ff7244 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.767873 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31294c-2b90-47f1-987d-9481a8ff7244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.768269 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31294c-2b90-47f1-987d-9481a8ff7244 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.779487 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31294c-2b90-47f1-987d-9481a8ff7244 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:46.781332 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31294c-2b90-47f1-987d-9481a8ff7244 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:46.795115 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 135/268] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:46.798411 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa643e9-964b-4b90-83e6-98f3a5dfa101 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.798733 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31294c-2b90-47f1-987d-9481a8ff7244 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.808752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31294c-2b90-47f1-987d-9481a8ff7244 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:46.812848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa643e9-964b-4b90-83e6-98f3a5dfa101 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:46.813911 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f22b5f-8caf-4187-aaf3-99f9d4dc40ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:46.814844 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f22b5f-8caf-4187-aaf3-99f9d4dc40ad admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.815093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f22b5f-8caf-4187-aaf3-99f9d4dc40ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.815407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f22b5f-8caf-4187-aaf3-99f9d4dc40ad admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.830856 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f22b5f-8caf-4187-aaf3-99f9d4dc40ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:46.837017 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304619c9-6b31-49c5-8048-f8d3cd09ea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:46.837892 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304619c9-6b31-49c5-8048-f8d3cd09ea6e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.838175 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304619c9-6b31-49c5-8048-f8d3cd09ea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.838429 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304619c9-6b31-49c5-8048-f8d3cd09ea6e admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.838996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-a7f22b5f-8caf-4187-aaf3-99f9d4dc40ad admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:10:46.840628 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 136/269] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:46.845158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304619c9-6b31-49c5-8048-f8d3cd09ea6e admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:46.847245 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304619c9-6b31-49c5-8048-f8d3cd09ea6e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:46.849076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 134/270] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:46.852138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f22b5f-8caf-4187-aaf3-99f9d4dc40ad admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.863706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f22b5f-8caf-4187-aaf3-99f9d4dc40ad admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:46.868520 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304619c9-6b31-49c5-8048-f8d3cd09ea6e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.873773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc44c3c-4b13-4b4a-b1b7-8fb98fe80dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:46.874414 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44c3c-4b13-4b4a-b1b7-8fb98fe80dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.874741 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44c3c-4b13-4b4a-b1b7-8fb98fe80dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.875104 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44c3c-4b13-4b4a-b1b7-8fb98fe80dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.876194 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc44c3c-4b13-4b4a-b1b7-8fb98fe80dcc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:46.876555 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc44c3c-4b13-4b4a-b1b7-8fb98fe80dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:46.878442 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc44c3c-4b13-4b4a-b1b7-8fb98fe80dcc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:46.884893 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304619c9-6b31-49c5-8048-f8d3cd09ea6e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:46.888932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 137/271] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:46.896984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc44c3c-4b13-4b4a-b1b7-8fb98fe80dcc admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.909060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b923ed8-46b5-4d09-a4b7-9e1253f8b1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:46.909926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923ed8-46b5-4d09-a4b7-9e1253f8b1de admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.910209 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923ed8-46b5-4d09-a4b7-9e1253f8b1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.910484 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923ed8-46b5-4d09-a4b7-9e1253f8b1de admin admin] PATH_INFO: `/v3/groups/2bb7c2fd7db946379dc2760e14059c6e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.913510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc44c3c-4b13-4b4a-b1b7-8fb98fe80dcc admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:46.916524 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b923ed8-46b5-4d09-a4b7-9e1253f8b1de admin admin] RBAC: Authorizing `identity:get_group(group_id=2bb7c2fd7db946379dc2760e14059c6e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:46.918451 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b923ed8-46b5-4d09-a4b7-9e1253f8b1de admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:46.919064 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df22016-21e0-4d9b-a698-4818ea5ace1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:46.919972 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df22016-21e0-4d9b-a698-4818ea5ace1f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.920168 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 135/272] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/groups/2bb7c2fd7db946379dc2760e14059c6e => generated 226 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:46.920688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df22016-21e0-4d9b-a698-4818ea5ace1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.921110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df22016-21e0-4d9b-a698-4818ea5ace1f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.937760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df22016-21e0-4d9b-a698-4818ea5ace1f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:46.941039 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df22016-21e0-4d9b-a698-4818ea5ace1f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:46.941968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b923ed8-46b5-4d09-a4b7-9e1253f8b1de admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.955258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 138/273] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:46.962056 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b923ed8-46b5-4d09-a4b7-9e1253f8b1de admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:46.962307 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df22016-21e0-4d9b-a698-4818ea5ace1f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.971394 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df22016-21e0-4d9b-a698-4818ea5ace1f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:46.976156 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291be6bc-1bd5-4a21-9a80-5394915cf19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:46.977349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291be6bc-1bd5-4a21-9a80-5394915cf19a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.977803 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291be6bc-1bd5-4a21-9a80-5394915cf19a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.978252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291be6bc-1bd5-4a21-9a80-5394915cf19a admin admin] PATH_INFO: `/v3/projects/2ac3fe6c70e94b5294a05c397d1a0fce` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.980146 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291be6bc-1bd5-4a21-9a80-5394915cf19a admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac3fe6c70e94b5294a05c397d1a0fce)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:46.980824 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0def95a-9821-48b0-9208-8035dddd435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:46.981484 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0def95a-9821-48b0-9208-8035dddd435b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:46.981770 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0def95a-9821-48b0-9208-8035dddd435b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:46.981965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291be6bc-1bd5-4a21-9a80-5394915cf19a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:46.982120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0def95a-9821-48b0-9208-8035dddd435b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:46.982878 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0def95a-9821-48b0-9208-8035dddd435b admin admin] RBAC: Adding query filter params (group.id=2bb7c2fd7db946379dc2760e14059c6e, role.id=4891c5dc7fab4407b20b35b4e6da58a8, scope.project.id=e704e7fbc18741659b80dd56204851de) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:46.983188 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0def95a-9821-48b0-9208-8035dddd435b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:46.983649 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 139/274] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/projects/2ac3fe6c70e94b5294a05c397d1a0fce => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:46.985928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0def95a-9821-48b0-9208-8035dddd435b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:46.990747 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291be6bc-1bd5-4a21-9a80-5394915cf19a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:46.996589 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 136/275] 10.222.0.87 () {56 vars in 1397 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/role_assignments?group.id=2bb7c2fd7db946379dc2760e14059c6e&scope.project.id=e704e7fbc18741659b80dd56204851de&role.id=4891c5dc7fab4407b20b35b4e6da58a8 => generated 260 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:47.001386 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291be6bc-1bd5-4a21-9a80-5394915cf19a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:47.012285 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817d77f-2838-445d-be43-7a557e4e6280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:47.013250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d77f-2838-445d-be43-7a557e4e6280 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:47.013602 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d77f-2838-445d-be43-7a557e4e6280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:47.013967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d77f-2838-445d-be43-7a557e4e6280 admin admin] PATH_INFO: `/v3/groups/cd1993afae3c4de28747556b025a90d8` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:47.021253 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817d77f-2838-445d-be43-7a557e4e6280 admin admin] RBAC: Authorizing `identity:get_group(group_id=cd1993afae3c4de28747556b025a90d8)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:47.029197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-e817d77f-2838-445d-be43-7a557e4e6280 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:47.029197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:10:47.029197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:10:47.030639 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817d77f-2838-445d-be43-7a557e4e6280 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:47.033201 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 140/276] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:46 2021] GET /identity/v3/groups/cd1993afae3c4de28747556b025a90d8 => generated 229 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:47.039818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0def95a-9821-48b0-9208-8035dddd435b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:47.060560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0def95a-9821-48b0-9208-8035dddd435b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:47.079234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397700d9-6668-4cb9-a90a-78c143426c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:47.080136 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397700d9-6668-4cb9-a90a-78c143426c34 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:47.080397 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397700d9-6668-4cb9-a90a-78c143426c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:47.080673 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397700d9-6668-4cb9-a90a-78c143426c34 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:47.081539 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397700d9-6668-4cb9-a90a-78c143426c34 admin admin] RBAC: Adding query filter params (group.id=cd1993afae3c4de28747556b025a90d8, role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=2ac3fe6c70e94b5294a05c397d1a0fce) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:47.081851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397700d9-6668-4cb9-a90a-78c143426c34 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:47.083833 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397700d9-6668-4cb9-a90a-78c143426c34 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:47.096298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 137/277] 10.222.0.87 () {56 vars in 1397 bytes} [Fri Oct 29 01:10:47 2021] GET /identity/v3/role_assignments?group.id=cd1993afae3c4de28747556b025a90d8&scope.project.id=2ac3fe6c70e94b5294a05c397d1a0fce&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 260 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:48.017636 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a70300-85ee-4b51-bf68-26313e87567d None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:48.017636 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a70300-85ee-4b51-bf68-26313e87567d None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:48.017636 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a70300-85ee-4b51-bf68-26313e87567d None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:48.017636 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 141/278] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:48.025777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ade8fb-05a4-42fa-a289-d180d92d0dd7 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:48.025777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ade8fb-05a4-42fa-a289-d180d92d0dd7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:48.025777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ade8fb-05a4-42fa-a289-d180d92d0dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:48.045785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-85ade8fb-05a4-42fa-a289-d180d92d0dd7 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:48.049701 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-85ade8fb-05a4-42fa-a289-d180d92d0dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:48.058248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 138/279] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:48.085904 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a70300-85ee-4b51-bf68-26313e87567d None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:48.099252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a70300-85ee-4b51-bf68-26313e87567d None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:48.105234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0520d-2e71-4c90-875d-8e69ac16c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:48.106290 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0520d-2e71-4c90-875d-8e69ac16c0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:48.106760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0520d-2e71-4c90-875d-8e69ac16c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:48.107221 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0520d-2e71-4c90-875d-8e69ac16c0d1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:48.119403 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0520d-2e71-4c90-875d-8e69ac16c0d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:48.126664 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-afe0520d-2e71-4c90-875d-8e69ac16c0d1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:48.128125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 142/280] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:48 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:48.134688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ade8fb-05a4-42fa-a289-d180d92d0dd7 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:48.144224 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ade8fb-05a4-42fa-a289-d180d92d0dd7 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:48.153293 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce344b-4844-4c0a-afe1-78eca0bd061f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:48.154267 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce344b-4844-4c0a-afe1-78eca0bd061f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:48.154752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce344b-4844-4c0a-afe1-78eca0bd061f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:48.155217 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce344b-4844-4c0a-afe1-78eca0bd061f admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:48.156212 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce344b-4844-4c0a-afe1-78eca0bd061f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:48.157575 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce344b-4844-4c0a-afe1-78eca0bd061f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:48.159357 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce344b-4844-4c0a-afe1-78eca0bd061f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:48.173274 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 139/281] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:48.179939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0520d-2e71-4c90-875d-8e69ac16c0d1 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:48.191074 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0520d-2e71-4c90-875d-8e69ac16c0d1 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:48.199427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fac30-c790-47ee-99b7-9ceda7a299f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:48.200598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fac30-c790-47ee-99b7-9ceda7a299f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:48.201090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fac30-c790-47ee-99b7-9ceda7a299f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:48.201551 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fac30-c790-47ee-99b7-9ceda7a299f4 admin admin] PATH_INFO: `/v3/groups/2bb7c2fd7db946379dc2760e14059c6e` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:48.202943 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fac30-c790-47ee-99b7-9ceda7a299f4 admin admin] RBAC: Authorizing `identity:get_group(group_id=2bb7c2fd7db946379dc2760e14059c6e)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:48.205107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fac30-c790-47ee-99b7-9ceda7a299f4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:48.207056 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 143/282] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:48 2021] GET /identity/v3/groups/2bb7c2fd7db946379dc2760e14059c6e => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:48.213421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce344b-4844-4c0a-afe1-78eca0bd061f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:48.225235 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce344b-4844-4c0a-afe1-78eca0bd061f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:48.231110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8905a-61c9-4983-9abd-3c404d86f0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:48.231993 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8905a-61c9-4983-9abd-3c404d86f0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:48.232273 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8905a-61c9-4983-9abd-3c404d86f0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:48.232547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8905a-61c9-4983-9abd-3c404d86f0f4 admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:48.234469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8905a-61c9-4983-9abd-3c404d86f0f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:48.237119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8905a-61c9-4983-9abd-3c404d86f0f4 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:48.239860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 140/283] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:48 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:48.245509 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fac30-c790-47ee-99b7-9ceda7a299f4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:48.260879 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fac30-c790-47ee-99b7-9ceda7a299f4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:48.268890 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217ea85-9663-462d-b2c0-e34afb42bbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:48.269827 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217ea85-9663-462d-b2c0-e34afb42bbc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:48.270101 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217ea85-9663-462d-b2c0-e34afb42bbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:48.270370 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217ea85-9663-462d-b2c0-e34afb42bbc4 admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28/groups/2bb7c2fd7db946379dc2760e14059c6e/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:48.273181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217ea85-9663-462d-b2c0-e34afb42bbc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f445e69c8094e37889545aefb002e28, group_id=2bb7c2fd7db946379dc2760e14059c6e, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:48.275919 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217ea85-9663-462d-b2c0-e34afb42bbc4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:48.371217 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 144/284] 10.222.0.87 () {58 vars in 1463 bytes} [Fri Oct 29 01:10:48 2021] PUT /identity/v3/projects/3f445e69c8094e37889545aefb002e28/groups/2bb7c2fd7db946379dc2760e14059c6e/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:10:48.548098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c0bf8-f9d7-4658-991e-362e802fc43e None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:48.548398 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c0bf8-f9d7-4658-991e-362e802fc43e None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:48.548648 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c0bf8-f9d7-4658-991e-362e802fc43e None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:48.550473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 141/285] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:48.557068 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9043f-0140-4ae9-9c46-f564829583fa None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:48.557511 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9043f-0140-4ae9-9c46-f564829583fa None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:48.557881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9043f-0140-4ae9-9c46-f564829583fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:48.583238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-56e9043f-0140-4ae9-9c46-f564829583fa None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:48.584488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-56e9043f-0140-4ae9-9c46-f564829583fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:48.815572 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 145/286] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:48.841633 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c0bf8-f9d7-4658-991e-362e802fc43e None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:48.856714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c0bf8-f9d7-4658-991e-362e802fc43e None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:48.861218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0f94b-42d9-4a64-bbdd-8617c319dad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:48.862032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f94b-42d9-4a64-bbdd-8617c319dad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:48.862296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f94b-42d9-4a64-bbdd-8617c319dad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:48.862565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f94b-42d9-4a64-bbdd-8617c319dad6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:48.882318 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0f94b-42d9-4a64-bbdd-8617c319dad6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:48.893427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-fca0f94b-42d9-4a64-bbdd-8617c319dad6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 01:10:48.894893 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 142/287] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:10:48 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:48.901616 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9043f-0140-4ae9-9c46-f564829583fa None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:48.918333 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9043f-0140-4ae9-9c46-f564829583fa None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:48.923893 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1b5b9-2590-4876-8d1e-dae175b40c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:48.924831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1b5b9-2590-4876-8d1e-dae175b40c86 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:48.925259 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1b5b9-2590-4876-8d1e-dae175b40c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:48.925672 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1b5b9-2590-4876-8d1e-dae175b40c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:48.926604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1b5b9-2590-4876-8d1e-dae175b40c86 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:48.927050 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1b5b9-2590-4876-8d1e-dae175b40c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:48.928801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1b5b9-2590-4876-8d1e-dae175b40c86 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:48.943247 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 146/288] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:10:48 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:48.950069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0f94b-42d9-4a64-bbdd-8617c319dad6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:48.961267 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0f94b-42d9-4a64-bbdd-8617c319dad6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:48.972978 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394f51c-1979-415e-8d5a-e7e8aaa04f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:48.973887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394f51c-1979-415e-8d5a-e7e8aaa04f77 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:48.974161 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394f51c-1979-415e-8d5a-e7e8aaa04f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:48.974431 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394f51c-1979-415e-8d5a-e7e8aaa04f77 admin admin] PATH_INFO: `/v3/groups/2bb7c2fd7db946379dc2760e14059c6e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:48.975870 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394f51c-1979-415e-8d5a-e7e8aaa04f77 admin admin] RBAC: Authorizing `identity:get_group(group_id=2bb7c2fd7db946379dc2760e14059c6e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:48.977848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394f51c-1979-415e-8d5a-e7e8aaa04f77 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:48.979807 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 143/289] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:48 2021] GET /identity/v3/groups/2bb7c2fd7db946379dc2760e14059c6e => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:48.986495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1b5b9-2590-4876-8d1e-dae175b40c86 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:49.000832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1b5b9-2590-4876-8d1e-dae175b40c86 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:49.005691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaf611-7663-4d96-b895-0408aab71204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:49.006746 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaf611-7663-4d96-b895-0408aab71204 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:49.007173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaf611-7663-4d96-b895-0408aab71204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:49.007587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaf611-7663-4d96-b895-0408aab71204 admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:49.009059 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcaf611-7663-4d96-b895-0408aab71204 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:49.011343 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcaf611-7663-4d96-b895-0408aab71204 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:49.013404 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 147/290] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:48 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:49.020824 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394f51c-1979-415e-8d5a-e7e8aaa04f77 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:49.032185 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394f51c-1979-415e-8d5a-e7e8aaa04f77 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:49.044416 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfb41c-7231-4b3a-a040-a6324d894370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:49.045356 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfb41c-7231-4b3a-a040-a6324d894370 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:49.045704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfb41c-7231-4b3a-a040-a6324d894370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:49.045968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfb41c-7231-4b3a-a040-a6324d894370 admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28/groups/2bb7c2fd7db946379dc2760e14059c6e/roles/4891c5dc7fab4407b20b35b4e6da58a8` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:49.053998 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfb41c-7231-4b3a-a040-a6324d894370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f445e69c8094e37889545aefb002e28, group_id=2bb7c2fd7db946379dc2760e14059c6e, role_id=4891c5dc7fab4407b20b35b4e6da58a8)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:49.056868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfb41c-7231-4b3a-a040-a6324d894370 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:49.136533 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 144/291] 10.222.0.87 () {58 vars in 1463 bytes} [Fri Oct 29 01:10:49 2021] PUT /identity/v3/projects/3f445e69c8094e37889545aefb002e28/groups/2bb7c2fd7db946379dc2760e14059c6e/roles/4891c5dc7fab4407b20b35b4e6da58a8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:10:49.212363 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44a370-fd5f-4c33-8496-5674c6c4d3af None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:49.212875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44a370-fd5f-4c33-8496-5674c6c4d3af None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:49.212948 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44a370-fd5f-4c33-8496-5674c6c4d3af None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:49.215047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 148/292] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:49.221755 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8593-3900-4a91-a446-8d35afe96f62 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:49.222065 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8593-3900-4a91-a446-8d35afe96f62 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:49.222305 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8593-3900-4a91-a446-8d35afe96f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:49.242193 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-1c2f8593-3900-4a91-a446-8d35afe96f62 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:49.243392 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1c2f8593-3900-4a91-a446-8d35afe96f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:49.308288 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 145/293] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:49.334362 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44a370-fd5f-4c33-8496-5674c6c4d3af None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:49.348105 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44a370-fd5f-4c33-8496-5674c6c4d3af None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:49.352784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed3ab0-4459-44dc-aaf6-f088fee47cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:49.353640 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed3ab0-4459-44dc-aaf6-f088fee47cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:49.353959 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed3ab0-4459-44dc-aaf6-f088fee47cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:49.354241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed3ab0-4459-44dc-aaf6-f088fee47cc2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:49.366888 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed3ab0-4459-44dc-aaf6-f088fee47cc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:49.374350 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-72ed3ab0-4459-44dc-aaf6-f088fee47cc2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:49.376679 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 149/294] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:49 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:49.384048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f8593-3900-4a91-a446-8d35afe96f62 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:49.393929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f8593-3900-4a91-a446-8d35afe96f62 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:49.399322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1e5ed-6573-400c-89f2-37e22ead3de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:49.400083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e5ed-6573-400c-89f2-37e22ead3de6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:49.400372 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e5ed-6573-400c-89f2-37e22ead3de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:49.400707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e5ed-6573-400c-89f2-37e22ead3de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:49.401505 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1e5ed-6573-400c-89f2-37e22ead3de6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:49.401866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1e5ed-6573-400c-89f2-37e22ead3de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:49.403639 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1e5ed-6573-400c-89f2-37e22ead3de6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:49.416191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 146/295] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:49 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:49.428580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed3ab0-4459-44dc-aaf6-f088fee47cc2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:49.447838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed3ab0-4459-44dc-aaf6-f088fee47cc2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:49.465108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dc694-8ea1-4b71-930e-9857347f2bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:49.466035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dc694-8ea1-4b71-930e-9857347f2bbb admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:49.466313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dc694-8ea1-4b71-930e-9857347f2bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:49.466582 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dc694-8ea1-4b71-930e-9857347f2bbb admin admin] PATH_INFO: `/v3/groups/2bb7c2fd7db946379dc2760e14059c6e` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:49.468639 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dc694-8ea1-4b71-930e-9857347f2bbb admin admin] RBAC: Authorizing `identity:get_group(group_id=2bb7c2fd7db946379dc2760e14059c6e)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:49.470994 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dc694-8ea1-4b71-930e-9857347f2bbb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:49.473153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 150/296] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:49 2021] GET /identity/v3/groups/2bb7c2fd7db946379dc2760e14059c6e => generated 226 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:49.479997 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1e5ed-6573-400c-89f2-37e22ead3de6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:49.499637 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1e5ed-6573-400c-89f2-37e22ead3de6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:49.516651 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9db3fa-9bcf-4b74-aa62-1a520d7eabde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:49.517653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9db3fa-9bcf-4b74-aa62-1a520d7eabde admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:49.517993 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9db3fa-9bcf-4b74-aa62-1a520d7eabde admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:49.518268 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9db3fa-9bcf-4b74-aa62-1a520d7eabde admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:49.519589 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9db3fa-9bcf-4b74-aa62-1a520d7eabde admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:49.521853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9db3fa-9bcf-4b74-aa62-1a520d7eabde admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:49.524044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 147/297] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:49 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:49.530101 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dc694-8ea1-4b71-930e-9857347f2bbb admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:49.544811 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dc694-8ea1-4b71-930e-9857347f2bbb admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:49.555588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154534e9-3440-4ace-b3e4-1751a77cfb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:49.556576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154534e9-3440-4ace-b3e4-1751a77cfb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:49.556856 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154534e9-3440-4ace-b3e4-1751a77cfb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:49.557187 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154534e9-3440-4ace-b3e4-1751a77cfb72 admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de/groups/2bb7c2fd7db946379dc2760e14059c6e/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:49.559283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154534e9-3440-4ace-b3e4-1751a77cfb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e704e7fbc18741659b80dd56204851de, group_id=2bb7c2fd7db946379dc2760e14059c6e, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:49.562165 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154534e9-3440-4ace-b3e4-1751a77cfb72 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:49.634273 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 151/298] 10.222.0.87 () {58 vars in 1463 bytes} [Fri Oct 29 01:10:49 2021] PUT /identity/v3/projects/e704e7fbc18741659b80dd56204851de/groups/2bb7c2fd7db946379dc2760e14059c6e/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:10:49.936130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea33bf6-af4f-4dc4-a035-55cc6dbd3438 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:49.936460 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea33bf6-af4f-4dc4-a035-55cc6dbd3438 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:49.936684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea33bf6-af4f-4dc4-a035-55cc6dbd3438 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:49.938581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 148/299] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:49.945592 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0084059-1855-4096-b42d-d8a5c5d03329 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:49.945874 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0084059-1855-4096-b42d-d8a5c5d03329 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:49.946133 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0084059-1855-4096-b42d-d8a5c5d03329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:49.973586 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d0084059-1855-4096-b42d-d8a5c5d03329 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:49.974858 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d0084059-1855-4096-b42d-d8a5c5d03329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:50.050837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 152/300] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:50.080241 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea33bf6-af4f-4dc4-a035-55cc6dbd3438 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:50.097601 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea33bf6-af4f-4dc4-a035-55cc6dbd3438 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:50.103796 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4b04e-0ecc-4a0c-87ee-3f32a5c04974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:50.104838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4b04e-0ecc-4a0c-87ee-3f32a5c04974 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:50.105203 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4b04e-0ecc-4a0c-87ee-3f32a5c04974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:50.105556 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4b04e-0ecc-4a0c-87ee-3f32a5c04974 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:50.119312 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4b04e-0ecc-4a0c-87ee-3f32a5c04974 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:50.128758 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-85f4b04e-0ecc-4a0c-87ee-3f32a5c04974 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 01:10:50.130216 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 149/301] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:10:50 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:50.137949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0084059-1855-4096-b42d-d8a5c5d03329 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:50.154372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0084059-1855-4096-b42d-d8a5c5d03329 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:50.163676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4d412-cf5b-466e-aa1b-f80ea2ff52be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:50.164476 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4d412-cf5b-466e-aa1b-f80ea2ff52be admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:50.164677 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4d412-cf5b-466e-aa1b-f80ea2ff52be admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:50.164918 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4d412-cf5b-466e-aa1b-f80ea2ff52be admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:50.165721 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4d412-cf5b-466e-aa1b-f80ea2ff52be admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:50.165989 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4d412-cf5b-466e-aa1b-f80ea2ff52be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:50.167679 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4d412-cf5b-466e-aa1b-f80ea2ff52be admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:50.177549 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 153/302] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:10:50 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:50.186047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4b04e-0ecc-4a0c-87ee-3f32a5c04974 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:50.204322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4b04e-0ecc-4a0c-87ee-3f32a5c04974 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:50.212405 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847eb29-7f5f-4d83-8f60-791e00a71f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:50.213573 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847eb29-7f5f-4d83-8f60-791e00a71f33 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:50.214033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847eb29-7f5f-4d83-8f60-791e00a71f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:50.214487 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847eb29-7f5f-4d83-8f60-791e00a71f33 admin admin] PATH_INFO: `/v3/groups/2bb7c2fd7db946379dc2760e14059c6e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:50.216359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847eb29-7f5f-4d83-8f60-791e00a71f33 admin admin] RBAC: Authorizing `identity:get_group(group_id=2bb7c2fd7db946379dc2760e14059c6e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:50.218476 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847eb29-7f5f-4d83-8f60-791e00a71f33 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:50.220988 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 150/303] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:50 2021] GET /identity/v3/groups/2bb7c2fd7db946379dc2760e14059c6e => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:50.227479 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4d412-cf5b-466e-aa1b-f80ea2ff52be admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:50.240924 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4d412-cf5b-466e-aa1b-f80ea2ff52be admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:50.251910 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4941df9-2be0-4345-aa09-425b781fd0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:50.252777 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4941df9-2be0-4345-aa09-425b781fd0bb admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:50.253125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4941df9-2be0-4345-aa09-425b781fd0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:50.253398 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4941df9-2be0-4345-aa09-425b781fd0bb admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:50.254623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4941df9-2be0-4345-aa09-425b781fd0bb admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:50.256694 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4941df9-2be0-4345-aa09-425b781fd0bb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:50.258697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 154/304] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:50 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:50.265164 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847eb29-7f5f-4d83-8f60-791e00a71f33 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:50.277439 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847eb29-7f5f-4d83-8f60-791e00a71f33 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:50.284394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0718260-0775-4b51-ba17-14d968c3a80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:50.285680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0718260-0775-4b51-ba17-14d968c3a80a admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:50.286141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0718260-0775-4b51-ba17-14d968c3a80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:50.286644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0718260-0775-4b51-ba17-14d968c3a80a admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de/groups/2bb7c2fd7db946379dc2760e14059c6e/roles/4891c5dc7fab4407b20b35b4e6da58a8` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:50.294162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0718260-0775-4b51-ba17-14d968c3a80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e704e7fbc18741659b80dd56204851de, group_id=2bb7c2fd7db946379dc2760e14059c6e, role_id=4891c5dc7fab4407b20b35b4e6da58a8)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:50.297476 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0718260-0775-4b51-ba17-14d968c3a80a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:50.383119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 151/305] 10.222.0.87 () {58 vars in 1463 bytes} [Fri Oct 29 01:10:50 2021] PUT /identity/v3/projects/e704e7fbc18741659b80dd56204851de/groups/2bb7c2fd7db946379dc2760e14059c6e/roles/4891c5dc7fab4407b20b35b4e6da58a8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:10:50.471211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a236f6-21af-4517-bcdc-ffa30a4b1a05 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:50.471489 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a236f6-21af-4517-bcdc-ffa30a4b1a05 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:50.471783 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a236f6-21af-4517-bcdc-ffa30a4b1a05 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:50.473805 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 155/306] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:50.480387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda2780-de53-4b9f-bbcd-f879c2243944 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:50.480884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda2780-de53-4b9f-bbcd-f879c2243944 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:50.481304 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda2780-de53-4b9f-bbcd-f879c2243944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:50.504110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-4eda2780-de53-4b9f-bbcd-f879c2243944 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:50.505420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4eda2780-de53-4b9f-bbcd-f879c2243944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:50.602924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 152/307] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:50.643214 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a236f6-21af-4517-bcdc-ffa30a4b1a05 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:50.659328 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a236f6-21af-4517-bcdc-ffa30a4b1a05 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:50.667520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a4983-718f-4254-9988-8b261c4da839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:50.668338 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a4983-718f-4254-9988-8b261c4da839 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:50.668613 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a4983-718f-4254-9988-8b261c4da839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:50.668884 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a4983-718f-4254-9988-8b261c4da839 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:50.682591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a4983-718f-4254-9988-8b261c4da839 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:50.690152 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-887a4983-718f-4254-9988-8b261c4da839 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:10:50.691630 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 156/308] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:10:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:10:50.699021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda2780-de53-4b9f-bbcd-f879c2243944 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:50.711176 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda2780-de53-4b9f-bbcd-f879c2243944 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:50.720694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c6b8e-ce99-49ed-8981-f8654f264e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:50.721810 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c6b8e-ce99-49ed-8981-f8654f264e3b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:50.722348 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c6b8e-ce99-49ed-8981-f8654f264e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:50.722854 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c6b8e-ce99-49ed-8981-f8654f264e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:50.723971 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c6b8e-ce99-49ed-8981-f8654f264e3b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:50.724554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c6b8e-ce99-49ed-8981-f8654f264e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:50.726431 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c6b8e-ce99-49ed-8981-f8654f264e3b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:50.738885 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 153/309] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:50.744790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a4983-718f-4254-9988-8b261c4da839 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:50.759474 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a4983-718f-4254-9988-8b261c4da839 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:50.765525 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6400318-2dce-405a-9601-34753b2ac008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:50.766918 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400318-2dce-405a-9601-34753b2ac008 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:50.767196 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400318-2dce-405a-9601-34753b2ac008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:50.767468 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400318-2dce-405a-9601-34753b2ac008 admin admin] PATH_INFO: `/v3/groups/cd1993afae3c4de28747556b025a90d8` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:50.768769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6400318-2dce-405a-9601-34753b2ac008 admin admin] RBAC: Authorizing `identity:get_group(group_id=cd1993afae3c4de28747556b025a90d8)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:50.770697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6400318-2dce-405a-9601-34753b2ac008 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:50.774184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 157/310] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:50 2021] GET /identity/v3/groups/cd1993afae3c4de28747556b025a90d8 => generated 229 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:50.782566 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c6b8e-ce99-49ed-8981-f8654f264e3b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:50.796994 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c6b8e-ce99-49ed-8981-f8654f264e3b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:50.803529 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b5a3e-239f-449d-ba81-f9e3ccb0cbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:50.804925 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b5a3e-239f-449d-ba81-f9e3ccb0cbcb admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:50.805345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b5a3e-239f-449d-ba81-f9e3ccb0cbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:50.805808 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b5a3e-239f-449d-ba81-f9e3ccb0cbcb admin admin] PATH_INFO: `/v3/projects/2ac3fe6c70e94b5294a05c397d1a0fce` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:50.807624 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b5a3e-239f-449d-ba81-f9e3ccb0cbcb admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac3fe6c70e94b5294a05c397d1a0fce)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:50.810663 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b5a3e-239f-449d-ba81-f9e3ccb0cbcb admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:50.813616 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 154/311] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:50 2021] GET /identity/v3/projects/2ac3fe6c70e94b5294a05c397d1a0fce => generated 344 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:50.823904 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6400318-2dce-405a-9601-34753b2ac008 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:50.840928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6400318-2dce-405a-9601-34753b2ac008 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:50.848089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d748c-c529-4f72-a888-96424083ab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:50.849659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d748c-c529-4f72-a888-96424083ab8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:50.850522 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d748c-c529-4f72-a888-96424083ab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:50.851457 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d748c-c529-4f72-a888-96424083ab8f admin admin] PATH_INFO: `/v3/projects/2ac3fe6c70e94b5294a05c397d1a0fce/groups/cd1993afae3c4de28747556b025a90d8/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:50.854734 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d748c-c529-4f72-a888-96424083ab8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac3fe6c70e94b5294a05c397d1a0fce, group_id=cd1993afae3c4de28747556b025a90d8, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:50.860425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d748c-c529-4f72-a888-96424083ab8f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:50.927040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 158/312] 10.222.0.87 () {58 vars in 1463 bytes} [Fri Oct 29 01:10:50 2021] PUT /identity/v3/projects/2ac3fe6c70e94b5294a05c397d1a0fce/groups/cd1993afae3c4de28747556b025a90d8/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:10:51.744676 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906c769-b693-4299-8921-d7f0e1f93353 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:51.745311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906c769-b693-4299-8921-d7f0e1f93353 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:51.745311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906c769-b693-4299-8921-d7f0e1f93353 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:51.747305 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 155/313] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:51.759223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3022d-02c3-4729-97ca-d784c57d1aac None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:51.759912 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3022d-02c3-4729-97ca-d784c57d1aac None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:51.759912 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3022d-02c3-4729-97ca-d784c57d1aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:51.786730 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-eac3022d-02c3-4729-97ca-d784c57d1aac None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:51.788001 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-eac3022d-02c3-4729-97ca-d784c57d1aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:51.896432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 159/314] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:51.912938 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e201-98c4-4f1e-b008-4806fdeb16ec None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:51.913610 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e201-98c4-4f1e-b008-4806fdeb16ec None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:51.914113 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e201-98c4-4f1e-b008-4806fdeb16ec None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:51.917333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 156/315] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:51.924774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6404-9fc4-45d1-97e2-0bacd014e60e None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:51.925084 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6404-9fc4-45d1-97e2-0bacd014e60e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:51.925329 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6404-9fc4-45d1-97e2-0bacd014e60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:51.948740 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-59cf6404-9fc4-45d1-97e2-0bacd014e60e None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:51.950284 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-59cf6404-9fc4-45d1-97e2-0bacd014e60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:51.963243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320e201-98c4-4f1e-b008-4806fdeb16ec None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:51.963556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 160/316] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:52.001932 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320e201-98c4-4f1e-b008-4806fdeb16ec None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:52.008510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf6404-9fc4-45d1-97e2-0bacd014e60e None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:52.013341 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297c835-debe-4f18-adaf-64006f86fef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:52.015778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297c835-debe-4f18-adaf-64006f86fef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:52.015778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297c835-debe-4f18-adaf-64006f86fef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:52.015778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297c835-debe-4f18-adaf-64006f86fef1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:52.024151 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf6404-9fc4-45d1-97e2-0bacd014e60e None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:52.034370 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7d6a8-adb7-4c21-a8d6-ca2eea475ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:52.035194 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7d6a8-adb7-4c21-a8d6-ca2eea475ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:52.035476 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7d6a8-adb7-4c21-a8d6-ca2eea475ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:52.035763 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7d6a8-adb7-4c21-a8d6-ca2eea475ac5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:52.037264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297c835-debe-4f18-adaf-64006f86fef1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:52.044235 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-9297c835-debe-4f18-adaf-64006f86fef1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:52.045649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 157/317] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:52.062433 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297c835-debe-4f18-adaf-64006f86fef1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:52.064405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7d6a8-adb7-4c21-a8d6-ca2eea475ac5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:52.071966 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-8fc7d6a8-adb7-4c21-a8d6-ca2eea475ac5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 01:10:52.073592 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 161/318] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:10:52 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:10:52.083565 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7d6a8-adb7-4c21-a8d6-ca2eea475ac5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:52.090151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297c835-debe-4f18-adaf-64006f86fef1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:52.098733 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325772d-28aa-47e5-b728-c2fd5d9dcc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:52.099811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325772d-28aa-47e5-b728-c2fd5d9dcc12 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:52.100308 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325772d-28aa-47e5-b728-c2fd5d9dcc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:52.100802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325772d-28aa-47e5-b728-c2fd5d9dcc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:52.101803 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325772d-28aa-47e5-b728-c2fd5d9dcc12 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:52.101980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7d6a8-adb7-4c21-a8d6-ca2eea475ac5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:52.102468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325772d-28aa-47e5-b728-c2fd5d9dcc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:52.105929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325772d-28aa-47e5-b728-c2fd5d9dcc12 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:52.115767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea1c5c-7740-4ca3-906c-ebf5fba8ac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:52.115767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea1c5c-7740-4ca3-906c-ebf5fba8ac40 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:52.115767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea1c5c-7740-4ca3-906c-ebf5fba8ac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:52.115767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea1c5c-7740-4ca3-906c-ebf5fba8ac40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:52.116184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea1c5c-7740-4ca3-906c-ebf5fba8ac40 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:52.116184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea1c5c-7740-4ca3-906c-ebf5fba8ac40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:52.116324 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea1c5c-7740-4ca3-906c-ebf5fba8ac40 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:52.127334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 162/319] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:10:52 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:52.128556 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 158/320] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:52 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:52.136339 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea1c5c-7740-4ca3-906c-ebf5fba8ac40 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:52.139148 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325772d-28aa-47e5-b728-c2fd5d9dcc12 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:52.160813 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea1c5c-7740-4ca3-906c-ebf5fba8ac40 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:52.163445 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325772d-28aa-47e5-b728-c2fd5d9dcc12 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:52.175679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5b451-eeed-461e-bb08-adf6e89645c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:52.176707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b451-eeed-461e-bb08-adf6e89645c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:52.178106 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b451-eeed-461e-bb08-adf6e89645c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:52.178641 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b451-eeed-461e-bb08-adf6e89645c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:52.179640 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344ae82-a229-43e9-a5f9-8212916255e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:52.181688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344ae82-a229-43e9-a5f9-8212916255e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:52.182581 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344ae82-a229-43e9-a5f9-8212916255e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:52.188188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344ae82-a229-43e9-a5f9-8212916255e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:52.201680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5b451-eeed-461e-bb08-adf6e89645c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:52.204683 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344ae82-a229-43e9-a5f9-8212916255e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:52.205627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5b451-eeed-461e-bb08-adf6e89645c9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:52.213753 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344ae82-a229-43e9-a5f9-8212916255e4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:52.229694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 159/321] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:10:52.233691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 163/322] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:52.241377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5b451-eeed-461e-bb08-adf6e89645c9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:52.249502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344ae82-a229-43e9-a5f9-8212916255e4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:52.253409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5b451-eeed-461e-bb08-adf6e89645c9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:52.259547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb35b-99a9-4f21-bff1-6b0e04123e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:52.261004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb35b-99a9-4f21-bff1-6b0e04123e55 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:52.261518 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb35b-99a9-4f21-bff1-6b0e04123e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:52.262136 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb35b-99a9-4f21-bff1-6b0e04123e55 admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:52.264319 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cb35b-99a9-4f21-bff1-6b0e04123e55 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:52.267376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344ae82-a229-43e9-a5f9-8212916255e4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:52.267528 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cb35b-99a9-4f21-bff1-6b0e04123e55 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:52.273350 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 160/323] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:52 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:52.276179 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcb3e9-a008-4e77-8351-802e11a9e889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:52.278831 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb35b-99a9-4f21-bff1-6b0e04123e55 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:52.284421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcb3e9-a008-4e77-8351-802e11a9e889 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:52.284801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcb3e9-a008-4e77-8351-802e11a9e889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:52.285067 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcb3e9-a008-4e77-8351-802e11a9e889 admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:52.288484 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcb3e9-a008-4e77-8351-802e11a9e889 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:52.292695 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcb3e9-a008-4e77-8351-802e11a9e889 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:52.295248 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 164/324] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:52 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:52.305888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb35b-99a9-4f21-bff1-6b0e04123e55 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:52.309969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcb3e9-a008-4e77-8351-802e11a9e889 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:52.328026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2c00e-b0d7-475c-a8ec-852279766baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:52.329834 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2c00e-b0d7-475c-a8ec-852279766baa admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:52.330114 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2c00e-b0d7-475c-a8ec-852279766baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:52.330385 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2c00e-b0d7-475c-a8ec-852279766baa admin admin] PATH_INFO: `/v3/groups/2bb7c2fd7db946379dc2760e14059c6e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:52.334721 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2c00e-b0d7-475c-a8ec-852279766baa admin admin] RBAC: Authorizing `identity:get_group(group_id=2bb7c2fd7db946379dc2760e14059c6e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:52.336408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcb3e9-a008-4e77-8351-802e11a9e889 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:52.340060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2c00e-b0d7-475c-a8ec-852279766baa admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:52.345193 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 161/325] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:52 2021] GET /identity/v3/groups/2bb7c2fd7db946379dc2760e14059c6e => generated 226 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:52.347968 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba075f-b723-43b9-ba9d-632a2d15d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:52.348824 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba075f-b723-43b9-ba9d-632a2d15d3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:52.349151 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba075f-b723-43b9-ba9d-632a2d15d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:52.349473 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba075f-b723-43b9-ba9d-632a2d15d3d8 admin admin] PATH_INFO: `/v3/groups/2bb7c2fd7db946379dc2760e14059c6e` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:52.351688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2c00e-b0d7-475c-a8ec-852279766baa admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:52.352350 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba075f-b723-43b9-ba9d-632a2d15d3d8 admin admin] RBAC: Authorizing `identity:get_group(group_id=2bb7c2fd7db946379dc2760e14059c6e)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:52.354463 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba075f-b723-43b9-ba9d-632a2d15d3d8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:52.356719 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 165/326] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:52 2021] GET /identity/v3/groups/2bb7c2fd7db946379dc2760e14059c6e => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:52.365024 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba075f-b723-43b9-ba9d-632a2d15d3d8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:52.376039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2c00e-b0d7-475c-a8ec-852279766baa admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:52.385959 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba075f-b723-43b9-ba9d-632a2d15d3d8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:52.389731 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6476ead-3fe1-424b-beac-e6a32ddbac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:52.391630 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6476ead-3fe1-424b-beac-e6a32ddbac7c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:52.392474 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6476ead-3fe1-424b-beac-e6a32ddbac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:52.393107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6476ead-3fe1-424b-beac-e6a32ddbac7c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:52.394880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6476ead-3fe1-424b-beac-e6a32ddbac7c admin admin] RBAC: Adding query filter params (group.id=2bb7c2fd7db946379dc2760e14059c6e, role.id=999d570f97da49269327a60c1acf21d2, scope.project.id=3f445e69c8094e37889545aefb002e28) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:52.395694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6476ead-3fe1-424b-beac-e6a32ddbac7c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:52.398524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466385a-fb10-4d1a-ae79-954a3ff6c89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:52.399176 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466385a-fb10-4d1a-ae79-954a3ff6c89e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:52.399454 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466385a-fb10-4d1a-ae79-954a3ff6c89e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:52.399753 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466385a-fb10-4d1a-ae79-954a3ff6c89e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:52.400654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6476ead-3fe1-424b-beac-e6a32ddbac7c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:52.400801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466385a-fb10-4d1a-ae79-954a3ff6c89e admin admin] RBAC: Adding query filter params (group.id=2bb7c2fd7db946379dc2760e14059c6e, role.id=4891c5dc7fab4407b20b35b4e6da58a8, scope.project.id=3f445e69c8094e37889545aefb002e28) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:52.400945 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466385a-fb10-4d1a-ae79-954a3ff6c89e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:52.402744 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466385a-fb10-4d1a-ae79-954a3ff6c89e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:52.409583 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 162/327] 10.222.0.87 () {56 vars in 1397 bytes} [Fri Oct 29 01:10:52 2021] GET /identity/v3/role_assignments?group.id=2bb7c2fd7db946379dc2760e14059c6e&scope.project.id=3f445e69c8094e37889545aefb002e28&role.id=999d570f97da49269327a60c1acf21d2 => generated 611 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:52.421601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 166/328] 10.222.0.87 () {56 vars in 1397 bytes} [Fri Oct 29 01:10:52 2021] GET /identity/v3/role_assignments?group.id=2bb7c2fd7db946379dc2760e14059c6e&scope.project.id=3f445e69c8094e37889545aefb002e28&role.id=4891c5dc7fab4407b20b35b4e6da58a8 => generated 611 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:52.970812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a609d0e-1a50-461e-8956-452c750ef121 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:52.971839 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a609d0e-1a50-461e-8956-452c750ef121 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:52.972318 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a609d0e-1a50-461e-8956-452c750ef121 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:52.974750 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 163/329] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:52 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:52.980949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8f3a2-9bf3-4072-ae3a-60b0fdc06503 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:52.981815 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8f3a2-9bf3-4072-ae3a-60b0fdc06503 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:52.982296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8f3a2-9bf3-4072-ae3a-60b0fdc06503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.001016 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-24c8f3a2-9bf3-4072-ae3a-60b0fdc06503 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:53.002530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-24c8f3a2-9bf3-4072-ae3a-60b0fdc06503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:53.010714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 167/330] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:53.035912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a609d0e-1a50-461e-8956-452c750ef121 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:53.049489 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a609d0e-1a50-461e-8956-452c750ef121 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:53.053738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59eba1-f16f-49b0-852f-38f86676ef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:53.054712 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59eba1-f16f-49b0-852f-38f86676ef16 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.054989 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59eba1-f16f-49b0-852f-38f86676ef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.055259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59eba1-f16f-49b0-852f-38f86676ef16 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.066708 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59eba1-f16f-49b0-852f-38f86676ef16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:53.075176 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-1a59eba1-f16f-49b0-852f-38f86676ef16 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 01:10:53.076615 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 164/331] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:53.083497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8f3a2-9bf3-4072-ae3a-60b0fdc06503 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:53.092554 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8f3a2-9bf3-4072-ae3a-60b0fdc06503 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:53.097492 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e965ef6-9f53-473e-bc6e-2dbf79c8e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:53.098150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e965ef6-9f53-473e-bc6e-2dbf79c8e67c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.098425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e965ef6-9f53-473e-bc6e-2dbf79c8e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.098693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e965ef6-9f53-473e-bc6e-2dbf79c8e67c admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.099451 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e965ef6-9f53-473e-bc6e-2dbf79c8e67c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:53.099767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e965ef6-9f53-473e-bc6e-2dbf79c8e67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:53.101396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e965ef6-9f53-473e-bc6e-2dbf79c8e67c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:53.113250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 168/332] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:10:53 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:53.120641 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59eba1-f16f-49b0-852f-38f86676ef16 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:53.132319 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59eba1-f16f-49b0-852f-38f86676ef16 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:53.137077 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eeca4-f7ed-4e67-9804-e999884b7396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:53.137723 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eeca4-f7ed-4e67-9804-e999884b7396 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.138014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eeca4-f7ed-4e67-9804-e999884b7396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.138314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eeca4-f7ed-4e67-9804-e999884b7396 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.148191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eeca4-f7ed-4e67-9804-e999884b7396 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:53.150005 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eeca4-f7ed-4e67-9804-e999884b7396 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:53.163814 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 165/333] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:10:53.166811 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e965ef6-9f53-473e-bc6e-2dbf79c8e67c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:53.178567 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e965ef6-9f53-473e-bc6e-2dbf79c8e67c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:53.183253 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70ddeb-7b29-4b08-aba1-a831880621df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:53.184429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70ddeb-7b29-4b08-aba1-a831880621df admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.184931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70ddeb-7b29-4b08-aba1-a831880621df admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.185406 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70ddeb-7b29-4b08-aba1-a831880621df admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.186943 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70ddeb-7b29-4b08-aba1-a831880621df admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:53.189907 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70ddeb-7b29-4b08-aba1-a831880621df admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:53.192155 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 169/334] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:53 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:53.199437 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eeca4-f7ed-4e67-9804-e999884b7396 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:53.210709 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eeca4-f7ed-4e67-9804-e999884b7396 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:53.215414 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e8857-b4ab-4c4e-9571-ede8d7402f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:53.216332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e8857-b4ab-4c4e-9571-ede8d7402f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.216600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e8857-b4ab-4c4e-9571-ede8d7402f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.216866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e8857-b4ab-4c4e-9571-ede8d7402f94 admin admin] PATH_INFO: `/v3/groups/2bb7c2fd7db946379dc2760e14059c6e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.218176 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e8857-b4ab-4c4e-9571-ede8d7402f94 admin admin] RBAC: Authorizing `identity:get_group(group_id=2bb7c2fd7db946379dc2760e14059c6e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:53.220492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e8857-b4ab-4c4e-9571-ede8d7402f94 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:53.222560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 166/335] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:53 2021] GET /identity/v3/groups/2bb7c2fd7db946379dc2760e14059c6e => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:53.229166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70ddeb-7b29-4b08-aba1-a831880621df admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:53.239871 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70ddeb-7b29-4b08-aba1-a831880621df admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:53.244084 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30fa99-e022-426e-bdb1-bf1db4b59f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:53.244714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30fa99-e022-426e-bdb1-bf1db4b59f87 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.244990 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30fa99-e022-426e-bdb1-bf1db4b59f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.245258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30fa99-e022-426e-bdb1-bf1db4b59f87 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.246082 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30fa99-e022-426e-bdb1-bf1db4b59f87 admin admin] RBAC: Adding query filter params (group.id=2bb7c2fd7db946379dc2760e14059c6e, role.id=999d570f97da49269327a60c1acf21d2, scope.project.id=e704e7fbc18741659b80dd56204851de) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:53.246382 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30fa99-e022-426e-bdb1-bf1db4b59f87 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:53.248293 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30fa99-e022-426e-bdb1-bf1db4b59f87 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:53.254705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 170/336] 10.222.0.87 () {56 vars in 1397 bytes} [Fri Oct 29 01:10:53 2021] GET /identity/v3/role_assignments?group.id=2bb7c2fd7db946379dc2760e14059c6e&scope.project.id=e704e7fbc18741659b80dd56204851de&role.id=999d570f97da49269327a60c1acf21d2 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:53.344541 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b5bd3-f799-4e9a-b1ae-ac3371e6ea05 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.344895 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b5bd3-f799-4e9a-b1ae-ac3371e6ea05 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.345101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b5bd3-f799-4e9a-b1ae-ac3371e6ea05 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.347340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 167/337] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:53.354718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535a2b-987c-435b-989d-d85f45244b6a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.355184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535a2b-987c-435b-989d-d85f45244b6a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.357282 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535a2b-987c-435b-989d-d85f45244b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.376150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-98535a2b-987c-435b-989d-d85f45244b6a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:53.377929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-98535a2b-987c-435b-989d-d85f45244b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:53.386073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 171/338] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:53.413164 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b5bd3-f799-4e9a-b1ae-ac3371e6ea05 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:53.426629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b5bd3-f799-4e9a-b1ae-ac3371e6ea05 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:53.430925 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5e318-f4c4-4585-98f5-ef6c75b1fa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:53.431761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5e318-f4c4-4585-98f5-ef6c75b1fa1e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.432048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5e318-f4c4-4585-98f5-ef6c75b1fa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.432309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5e318-f4c4-4585-98f5-ef6c75b1fa1e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.444341 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5e318-f4c4-4585-98f5-ef6c75b1fa1e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:53.451613 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-60d5e318-f4c4-4585-98f5-ef6c75b1fa1e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 01:10:53.453089 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 168/339] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:10:53 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:10:53.459391 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98535a2b-987c-435b-989d-d85f45244b6a None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:53.469712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98535a2b-987c-435b-989d-d85f45244b6a None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:53.474091 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f94322-17db-4961-a17d-4a72e9c0985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:53.474742 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f94322-17db-4961-a17d-4a72e9c0985d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.475018 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f94322-17db-4961-a17d-4a72e9c0985d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.475288 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f94322-17db-4961-a17d-4a72e9c0985d admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.476080 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f94322-17db-4961-a17d-4a72e9c0985d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:53.476378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f94322-17db-4961-a17d-4a72e9c0985d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:53.477949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f94322-17db-4961-a17d-4a72e9c0985d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:53.486576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 172/340] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:10:53 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:53.492746 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5e318-f4c4-4585-98f5-ef6c75b1fa1e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:53.504809 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5e318-f4c4-4585-98f5-ef6c75b1fa1e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:53.509115 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8849c67-e25f-41a6-915f-81d283f3382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:53.509745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8849c67-e25f-41a6-915f-81d283f3382e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.510023 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8849c67-e25f-41a6-915f-81d283f3382e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.510294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8849c67-e25f-41a6-915f-81d283f3382e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.519890 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8849c67-e25f-41a6-915f-81d283f3382e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:53.521777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8849c67-e25f-41a6-915f-81d283f3382e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:53.531104 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 169/341] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:53.537455 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f94322-17db-4961-a17d-4a72e9c0985d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:53.547963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f94322-17db-4961-a17d-4a72e9c0985d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:53.552402 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae9c93-1654-4abb-bd56-7015f48333d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:53.553253 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9c93-1654-4abb-bd56-7015f48333d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.553537 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9c93-1654-4abb-bd56-7015f48333d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.553814 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9c93-1654-4abb-bd56-7015f48333d2 admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.555024 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae9c93-1654-4abb-bd56-7015f48333d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:53.557117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae9c93-1654-4abb-bd56-7015f48333d2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:53.558916 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 173/342] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:53 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:53.565741 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8849c67-e25f-41a6-915f-81d283f3382e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:53.575110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8849c67-e25f-41a6-915f-81d283f3382e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:53.580633 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f00366-595d-4fd4-8748-abbdfa4c2407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:53.581498 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f00366-595d-4fd4-8748-abbdfa4c2407 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.581774 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f00366-595d-4fd4-8748-abbdfa4c2407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.582042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f00366-595d-4fd4-8748-abbdfa4c2407 admin admin] PATH_INFO: `/v3/groups/2bb7c2fd7db946379dc2760e14059c6e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.583322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f00366-595d-4fd4-8748-abbdfa4c2407 admin admin] RBAC: Authorizing `identity:get_group(group_id=2bb7c2fd7db946379dc2760e14059c6e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:53.585377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f00366-595d-4fd4-8748-abbdfa4c2407 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:53.587363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 170/343] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:53 2021] GET /identity/v3/groups/2bb7c2fd7db946379dc2760e14059c6e => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:53.593742 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae9c93-1654-4abb-bd56-7015f48333d2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:53.603872 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae9c93-1654-4abb-bd56-7015f48333d2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:53.612287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f1961-837e-4123-a161-1a2a4ca7e41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:53.612947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f1961-837e-4123-a161-1a2a4ca7e41e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.613224 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f1961-837e-4123-a161-1a2a4ca7e41e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.613495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f1961-837e-4123-a161-1a2a4ca7e41e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.614333 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f1961-837e-4123-a161-1a2a4ca7e41e admin admin] RBAC: Adding query filter params (group.id=2bb7c2fd7db946379dc2760e14059c6e, role.id=4891c5dc7fab4407b20b35b4e6da58a8, scope.project.id=e704e7fbc18741659b80dd56204851de) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:53.614638 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f1961-837e-4123-a161-1a2a4ca7e41e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:53.616501 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f1961-837e-4123-a161-1a2a4ca7e41e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:53.623529 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 174/344] 10.222.0.87 () {56 vars in 1397 bytes} [Fri Oct 29 01:10:53 2021] GET /identity/v3/role_assignments?group.id=2bb7c2fd7db946379dc2760e14059c6e&scope.project.id=e704e7fbc18741659b80dd56204851de&role.id=4891c5dc7fab4407b20b35b4e6da58a8 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:53.940575 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9b541-0cc1-44fa-83ba-0fcdbe012080 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.940861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9b541-0cc1-44fa-83ba-0fcdbe012080 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.941143 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9b541-0cc1-44fa-83ba-0fcdbe012080 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.942924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 171/345] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:10:53.949187 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d04d-60a2-4c63-adb2-9601cac7a34c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:53.949476 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d04d-60a2-4c63-adb2-9601cac7a34c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:53.949753 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d04d-60a2-4c63-adb2-9601cac7a34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:53.967899 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-7633d04d-60a2-4c63-adb2-9601cac7a34c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:53.969262 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-7633d04d-60a2-4c63-adb2-9601cac7a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:53.976807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 175/346] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:54.001695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9b541-0cc1-44fa-83ba-0fcdbe012080 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:54.013875 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9b541-0cc1-44fa-83ba-0fcdbe012080 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:54.020373 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab5c87-6d16-4132-8c94-c5f89a3f7715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:54.021159 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab5c87-6d16-4132-8c94-c5f89a3f7715 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:54.021437 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab5c87-6d16-4132-8c94-c5f89a3f7715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:54.021707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab5c87-6d16-4132-8c94-c5f89a3f7715 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:54.032915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab5c87-6d16-4132-8c94-c5f89a3f7715 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:54.039692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-fdab5c87-6d16-4132-8c94-c5f89a3f7715 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:10:54.040898 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 172/347] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:10:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:10:54.047993 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633d04d-60a2-4c63-adb2-9601cac7a34c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:54.056828 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633d04d-60a2-4c63-adb2-9601cac7a34c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:54.061160 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e16cd-198a-49e7-9808-9620b3025cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:54.061802 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e16cd-198a-49e7-9808-9620b3025cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:54.062079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e16cd-198a-49e7-9808-9620b3025cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:54.062348 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e16cd-198a-49e7-9808-9620b3025cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:54.063760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e16cd-198a-49e7-9808-9620b3025cb3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:54.064065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e16cd-198a-49e7-9808-9620b3025cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:54.065648 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e16cd-198a-49e7-9808-9620b3025cb3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:54.073936 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 176/348] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:10:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:54.080640 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab5c87-6d16-4132-8c94-c5f89a3f7715 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:54.090028 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab5c87-6d16-4132-8c94-c5f89a3f7715 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:54.095301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cae1c-c9a4-42ba-9cb5-4e21092491b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:54.095956 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cae1c-c9a4-42ba-9cb5-4e21092491b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:54.096240 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cae1c-c9a4-42ba-9cb5-4e21092491b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:54.096516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cae1c-c9a4-42ba-9cb5-4e21092491b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:54.104562 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cae1c-c9a4-42ba-9cb5-4e21092491b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:54.106278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cae1c-c9a4-42ba-9cb5-4e21092491b9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:54.115816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 173/349] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:10:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:10:54.121957 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e16cd-198a-49e7-9808-9620b3025cb3 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:54.131353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e16cd-198a-49e7-9808-9620b3025cb3 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:54.135595 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e35381-a16e-41de-ab6e-519883208e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:54.136448 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e35381-a16e-41de-ab6e-519883208e7c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:54.136728 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e35381-a16e-41de-ab6e-519883208e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:54.137000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e35381-a16e-41de-ab6e-519883208e7c admin admin] PATH_INFO: `/v3/projects/2ac3fe6c70e94b5294a05c397d1a0fce` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:54.138170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e35381-a16e-41de-ab6e-519883208e7c admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac3fe6c70e94b5294a05c397d1a0fce)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:54.139975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e35381-a16e-41de-ab6e-519883208e7c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:54.141882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 177/350] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:10:54 2021] GET /identity/v3/projects/2ac3fe6c70e94b5294a05c397d1a0fce => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:54.147423 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cae1c-c9a4-42ba-9cb5-4e21092491b9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:54.156008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cae1c-c9a4-42ba-9cb5-4e21092491b9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:54.161055 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fcbbf-0a81-432f-9da4-6c35615982fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:54.161915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fcbbf-0a81-432f-9da4-6c35615982fe admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:54.162198 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fcbbf-0a81-432f-9da4-6c35615982fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:54.162472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fcbbf-0a81-432f-9da4-6c35615982fe admin admin] PATH_INFO: `/v3/groups/cd1993afae3c4de28747556b025a90d8` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:54.163650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fcbbf-0a81-432f-9da4-6c35615982fe admin admin] RBAC: Authorizing `identity:get_group(group_id=cd1993afae3c4de28747556b025a90d8)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:54.165554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fcbbf-0a81-432f-9da4-6c35615982fe admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:54.167117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 174/351] 10.222.0.87 () {56 vars in 1201 bytes} [Fri Oct 29 01:10:54 2021] GET /identity/v3/groups/cd1993afae3c4de28747556b025a90d8 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:54.174001 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e35381-a16e-41de-ab6e-519883208e7c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:54.183401 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e35381-a16e-41de-ab6e-519883208e7c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:54.187750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c247f6-8741-4836-9437-8a8009484961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:54.188436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c247f6-8741-4836-9437-8a8009484961 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:54.188708 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c247f6-8741-4836-9437-8a8009484961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:54.188972 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c247f6-8741-4836-9437-8a8009484961 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:54.189868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c247f6-8741-4836-9437-8a8009484961 admin admin] RBAC: Adding query filter params (group.id=cd1993afae3c4de28747556b025a90d8, role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=2ac3fe6c70e94b5294a05c397d1a0fce) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:54.190211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c247f6-8741-4836-9437-8a8009484961 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:54.192208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c247f6-8741-4836-9437-8a8009484961 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:54.198096 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 178/352] 10.222.0.87 () {56 vars in 1397 bytes} [Fri Oct 29 01:10:54 2021] GET /identity/v3/role_assignments?group.id=cd1993afae3c4de28747556b025a90d8&scope.project.id=2ac3fe6c70e94b5294a05c397d1a0fce&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:57.114849 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd14c1e-c98a-4896-ad8f-30be490897bf None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.115367 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd14c1e-c98a-4896-ad8f-30be490897bf None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.115367 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd14c1e-c98a-4896-ad8f-30be490897bf None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.117453 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 175/353] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:57.123630 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da935e-def8-41b6-b5a3-7735e4a907c1 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.124555 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da935e-def8-41b6-b5a3-7735e4a907c1 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.125607 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da935e-def8-41b6-b5a3-7735e4a907c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.157527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-b5da935e-def8-41b6-b5a3-7735e4a907c1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:57.159270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b5da935e-def8-41b6-b5a3-7735e4a907c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:57.167643 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 179/354] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:57.193068 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957879d-a415-4539-a7b3-bda18a5f6d4e None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.193684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957879d-a415-4539-a7b3-bda18a5f6d4e None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.194429 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957879d-a415-4539-a7b3-bda18a5f6d4e None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.196423 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 176/355] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:57.206582 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da935e-def8-41b6-b5a3-7735e4a907c1 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:57.208927 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1b739-8b99-49fd-a866-1ea43af19a87 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.209424 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1b739-8b99-49fd-a866-1ea43af19a87 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.209893 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1b739-8b99-49fd-a866-1ea43af19a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.218026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da935e-def8-41b6-b5a3-7735e4a907c1 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:57.224223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824603e-37bb-4c80-8621-761e88834d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:57.225009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824603e-37bb-4c80-8621-761e88834d45 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.225288 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824603e-37bb-4c80-8621-761e88834d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.225559 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824603e-37bb-4c80-8621-761e88834d45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.237121 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824603e-37bb-4c80-8621-761e88834d45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:57.238392 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-c2e1b739-8b99-49fd-a866-1ea43af19a87 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:57.238965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824603e-37bb-4c80-8621-761e88834d45 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:57.240072 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c2e1b739-8b99-49fd-a866-1ea43af19a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:57.253953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 177/356] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:57.262818 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-5824603e-37bb-4c80-8621-761e88834d45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:10:57.264159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 180/357] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:57.276086 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1b739-8b99-49fd-a866-1ea43af19a87 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:57.289566 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1b739-8b99-49fd-a866-1ea43af19a87 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:57.295751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824603e-37bb-4c80-8621-761e88834d45 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:57.301633 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d107a6-30a6-4a29-9262-74fd13c3a095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:57.302566 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d107a6-30a6-4a29-9262-74fd13c3a095 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.303065 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d107a6-30a6-4a29-9262-74fd13c3a095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.303279 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824603e-37bb-4c80-8621-761e88834d45 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:57.303765 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d107a6-30a6-4a29-9262-74fd13c3a095 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.304755 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d107a6-30a6-4a29-9262-74fd13c3a095 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:57.305256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d107a6-30a6-4a29-9262-74fd13c3a095 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:57.306458 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-07d107a6-30a6-4a29-9262-74fd13c3a095 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:57.306458 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:10:57.306458 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:10:57.307780 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d107a6-30a6-4a29-9262-74fd13c3a095 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:57.315458 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15b046-3c17-4038-b2b7-104701b71f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:57.316294 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15b046-3c17-4038-b2b7-104701b71f02 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.316573 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15b046-3c17-4038-b2b7-104701b71f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.316844 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15b046-3c17-4038-b2b7-104701b71f02 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.327911 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 178/358] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:10:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:10:57.333396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15b046-3c17-4038-b2b7-104701b71f02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:57.334625 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d107a6-30a6-4a29-9262-74fd13c3a095 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:57.337502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15b046-3c17-4038-b2b7-104701b71f02 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:57.350799 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d107a6-30a6-4a29-9262-74fd13c3a095 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:57.370576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-bd15b046-3c17-4038-b2b7-104701b71f02 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:10:57.371520 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd970d51-9090-4ac2-96a8-19a479092a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:57.372653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd970d51-9090-4ac2-96a8-19a479092a40 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.373194 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd970d51-9090-4ac2-96a8-19a479092a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.373735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd970d51-9090-4ac2-96a8-19a479092a40 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.374262 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 181/359] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:57.375526 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd970d51-9090-4ac2-96a8-19a479092a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:57.377782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd970d51-9090-4ac2-96a8-19a479092a40 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:57.381404 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15b046-3c17-4038-b2b7-104701b71f02 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:57.399010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15b046-3c17-4038-b2b7-104701b71f02 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:57.405212 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eadc7-4110-4125-b79a-154d307f1f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:57.405902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eadc7-4110-4125-b79a-154d307f1f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.406790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eadc7-4110-4125-b79a-154d307f1f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.407055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eadc7-4110-4125-b79a-154d307f1f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.407904 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4eadc7-4110-4125-b79a-154d307f1f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:57.408253 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4eadc7-4110-4125-b79a-154d307f1f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:57.409972 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4eadc7-4110-4125-b79a-154d307f1f43 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:57.426044 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 182/360] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:10:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:57.432553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eadc7-4110-4125-b79a-154d307f1f43 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:57.442977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eadc7-4110-4125-b79a-154d307f1f43 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:57.453901 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510366a-f03c-47cd-a712-4535ecddcf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:57.454588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510366a-f03c-47cd-a712-4535ecddcf58 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.454865 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510366a-f03c-47cd-a712-4535ecddcf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.455135 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510366a-f03c-47cd-a712-4535ecddcf58 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.455894 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510366a-f03c-47cd-a712-4535ecddcf58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:57.457958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510366a-f03c-47cd-a712-4535ecddcf58 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:57.491587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 179/361] 10.222.0.87 () {60 vars in 1153 bytes} [Fri Oct 29 01:10:57 2021] POST /identity/v3/users => generated 248 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:10:57.533358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 183/362] 10.222.0.87 () {60 vars in 1153 bytes} [Fri Oct 29 01:10:57 2021] POST /identity/v3/users => generated 246 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:10:57.540457 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac8f1-2e87-47e4-8a7b-2b6056fea055 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.540763 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac8f1-2e87-47e4-8a7b-2b6056fea055 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.541006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac8f1-2e87-47e4-8a7b-2b6056fea055 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.543112 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 180/363] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:57.550756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9eca7-1fcb-4bd0-8e0d-76a23d7ff962 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.551069 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9eca7-1fcb-4bd0-8e0d-76a23d7ff962 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.551305 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9eca7-1fcb-4bd0-8e0d-76a23d7ff962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.579932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-1bd9eca7-1fcb-4bd0-8e0d-76a23d7ff962 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:57.581253 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-1bd9eca7-1fcb-4bd0-8e0d-76a23d7ff962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:57.592770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 184/364] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:10:57.622675 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1195058-9bc8-4c83-8300-94ff1d592275 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.623016 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1195058-9bc8-4c83-8300-94ff1d592275 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.623198 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1195058-9bc8-4c83-8300-94ff1d592275 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.625314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 181/365] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:57.632281 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3618-a305-45ea-a92a-ece07bd9861d None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.632648 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3618-a305-45ea-a92a-ece07bd9861d None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.632810 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3618-a305-45ea-a92a-ece07bd9861d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.657869 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1195058-9bc8-4c83-8300-94ff1d592275 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:57.658201 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-7ffb3618-a305-45ea-a92a-ece07bd9861d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:57.659233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-7ffb3618-a305-45ea-a92a-ece07bd9861d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:57.673934 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 185/366] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:57.680619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1195058-9bc8-4c83-8300-94ff1d592275 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:57.688758 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79f2c0-abd2-4133-b436-aaed67200a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:57.689585 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f2c0-abd2-4133-b436-aaed67200a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.689863 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f2c0-abd2-4133-b436-aaed67200a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.690136 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f2c0-abd2-4133-b436-aaed67200a88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.700835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3618-a305-45ea-a92a-ece07bd9861d None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:57.710191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79f2c0-abd2-4133-b436-aaed67200a88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:57.711299 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3618-a305-45ea-a92a-ece07bd9861d None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:57.712107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79f2c0-abd2-4133-b436-aaed67200a88 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:57.725130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7e583-a37a-48aa-b073-fbb1b685c37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:57.725950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7e583-a37a-48aa-b073-fbb1b685c37d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.726229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7e583-a37a-48aa-b073-fbb1b685c37d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.726494 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7e583-a37a-48aa-b073-fbb1b685c37d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.749737 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7e583-a37a-48aa-b073-fbb1b685c37d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:57.752232 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7e583-a37a-48aa-b073-fbb1b685c37d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:57.754491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-df79f2c0-abd2-4133-b436-aaed67200a88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:10:57.756132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 182/367] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:10:57.763516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79f2c0-abd2-4133-b436-aaed67200a88 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:57.787770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-d1a7e583-a37a-48aa-b073-fbb1b685c37d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:10:57.787770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 186/368] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:10:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:57.789569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79f2c0-abd2-4133-b436-aaed67200a88 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:57.793862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb6d75-d322-49f1-82ad-432a839365b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:57.794857 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb6d75-d322-49f1-82ad-432a839365b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.795236 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7e583-a37a-48aa-b073-fbb1b685c37d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:57.795558 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb6d75-d322-49f1-82ad-432a839365b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.796173 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb6d75-d322-49f1-82ad-432a839365b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.797387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb6d75-d322-49f1-82ad-432a839365b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:57.797901 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb6d75-d322-49f1-82ad-432a839365b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:57.801824 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb6d75-d322-49f1-82ad-432a839365b1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:57.808946 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7e583-a37a-48aa-b073-fbb1b685c37d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:57.819148 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 183/369] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:10:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:57.822229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573f1e9-58aa-49f9-b656-c17678d851bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:57.826166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f1e9-58aa-49f9-b656-c17678d851bf admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.826166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f1e9-58aa-49f9-b656-c17678d851bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.826166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f1e9-58aa-49f9-b656-c17678d851bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.826166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573f1e9-58aa-49f9-b656-c17678d851bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:57.826166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573f1e9-58aa-49f9-b656-c17678d851bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:57.826166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573f1e9-58aa-49f9-b656-c17678d851bf admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:57.827986 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb6d75-d322-49f1-82ad-432a839365b1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:57.838336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb6d75-d322-49f1-82ad-432a839365b1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:57.839365 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 187/370] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:10:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:10:57.846926 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573f1e9-58aa-49f9-b656-c17678d851bf admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:57.850355 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc41d4b-fb42-498b-a5e9-94cfd5d7c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:57.851101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41d4b-fb42-498b-a5e9-94cfd5d7c9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.851380 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41d4b-fb42-498b-a5e9-94cfd5d7c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.851652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41d4b-fb42-498b-a5e9-94cfd5d7c9b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.852451 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc41d4b-fb42-498b-a5e9-94cfd5d7c9b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:57.854470 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc41d4b-fb42-498b-a5e9-94cfd5d7c9b4 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:57.857090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573f1e9-58aa-49f9-b656-c17678d851bf admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:57.861683 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad32fe-ac85-4e79-8753-81bdb3b7024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:57.862339 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad32fe-ac85-4e79-8753-81bdb3b7024b admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:57.862615 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad32fe-ac85-4e79-8753-81bdb3b7024b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:57.862885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad32fe-ac85-4e79-8753-81bdb3b7024b admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:57.863602 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad32fe-ac85-4e79-8753-81bdb3b7024b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:57.865725 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad32fe-ac85-4e79-8753-81bdb3b7024b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:57.948956 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 184/371] 10.222.0.87 () {60 vars in 1153 bytes} [Fri Oct 29 01:10:57 2021] POST /identity/v3/users => generated 249 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:10:57.959865 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 188/372] 10.222.0.87 () {60 vars in 1153 bytes} [Fri Oct 29 01:10:57 2021] POST /identity/v3/users => generated 248 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:10:58.807242 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d872e4-75d3-4151-afda-53ffac734021 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:58.807789 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d872e4-75d3-4151-afda-53ffac734021 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:58.807789 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d872e4-75d3-4151-afda-53ffac734021 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:58.809889 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 185/373] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:10:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:10:58.816395 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b3fd5-acf2-44cb-98b3-1212ee39570a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:58.817244 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b3fd5-acf2-44cb-98b3-1212ee39570a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:58.817738 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b3fd5-acf2-44cb-98b3-1212ee39570a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:58.836437 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-2d4b3fd5-acf2-44cb-98b3-1212ee39570a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:10:58.837895 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2d4b3fd5-acf2-44cb-98b3-1212ee39570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:10:58.846552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 189/374] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:10:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:10:58.896227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d872e4-75d3-4151-afda-53ffac734021 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:58.913589 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d872e4-75d3-4151-afda-53ffac734021 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:58.920579 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4d223-45d2-4b57-9dae-01ca230654d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:58.921248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4d223-45d2-4b57-9dae-01ca230654d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:58.921521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4d223-45d2-4b57-9dae-01ca230654d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:58.922339 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4d223-45d2-4b57-9dae-01ca230654d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:58.923112 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4d223-45d2-4b57-9dae-01ca230654d7 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:58.924748 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4d223-45d2-4b57-9dae-01ca230654d7 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:58.965126 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.sql.core [None req-55a4d223-45d2-4b57-9dae-01ca230654d7 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 29 01:10:58.965126 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 29 01:10:58.965126 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [parameters: {'id': '0acbb58b2f174ed38718cb04ac326ed9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 29 01:10:58.965126 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79704) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 01:10:58.988825 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-55a4d223-45d2-4b57-9dae-01ca230654d7 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 29 01:10:58.990801 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 186/375] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:10:58 2021] POST /identity/v3/roles => generated 144 bytes in 95 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:58.997528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b3fd5-acf2-44cb-98b3-1212ee39570a None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:59.006998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b3fd5-acf2-44cb-98b3-1212ee39570a None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:59.020602 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b43a-fb32-4fdb-bbb6-6eb79aa18e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:59.021425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b43a-fb32-4fdb-bbb6-6eb79aa18e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:59.021703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b43a-fb32-4fdb-bbb6-6eb79aa18e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:59.021974 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b43a-fb32-4fdb-bbb6-6eb79aa18e2c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:59.035437 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0b43a-fb32-4fdb-bbb6-6eb79aa18e2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:10:59.042888 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-e6f0b43a-fb32-4fdb-bbb6-6eb79aa18e2c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 01:10:59.044183 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 190/376] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:10:58 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:10:59.052132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4d223-45d2-4b57-9dae-01ca230654d7 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:10:59.075878 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4d223-45d2-4b57-9dae-01ca230654d7 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:10:59.092770 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89112f3d-0602-453a-ae0d-47d903a063c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:10:59.094719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112f3d-0602-453a-ae0d-47d903a063c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:10:59.095203 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112f3d-0602-453a-ae0d-47d903a063c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:10:59.095699 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112f3d-0602-453a-ae0d-47d903a063c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:10:59.096707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89112f3d-0602-453a-ae0d-47d903a063c7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:10:59.097232 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89112f3d-0602-453a-ae0d-47d903a063c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:10:59.099036 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89112f3d-0602-453a-ae0d-47d903a063c7 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:10:59.112491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 187/377] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:10:59 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:00.309534 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca7c8-e35b-42a7-b19d-0420c3d431fd None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.310423 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca7c8-e35b-42a7-b19d-0420c3d431fd None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.312033 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca7c8-e35b-42a7-b19d-0420c3d431fd None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.313589 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 191/378] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:00.320447 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2243e-42cf-49ca-90de-0f59b0f523bf None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.320918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2243e-42cf-49ca-90de-0f59b0f523bf None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.321316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2243e-42cf-49ca-90de-0f59b0f523bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.353904 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-56e2243e-42cf-49ca-90de-0f59b0f523bf None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:00.355458 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-56e2243e-42cf-49ca-90de-0f59b0f523bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:00.369049 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 188/379] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:00.409546 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228bf11-5897-429e-8490-0e85e073493b None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.409872 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228bf11-5897-429e-8490-0e85e073493b None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.410215 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228bf11-5897-429e-8490-0e85e073493b None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.413456 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2243e-42cf-49ca-90de-0f59b0f523bf None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:00.418913 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 192/380] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:00 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:00.427314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2243e-42cf-49ca-90de-0f59b0f523bf None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:00.436507 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee2d13-3b1c-4625-bc38-dceb2adab996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:00.437982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee2d13-3b1c-4625-bc38-dceb2adab996 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.438302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee2d13-3b1c-4625-bc38-dceb2adab996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.438607 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee2d13-3b1c-4625-bc38-dceb2adab996 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.441695 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624948c3-74aa-495c-a2e1-d28dfd42e252 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.441989 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624948c3-74aa-495c-a2e1-d28dfd42e252 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.442267 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624948c3-74aa-495c-a2e1-d28dfd42e252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.453599 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee2d13-3b1c-4625-bc38-dceb2adab996 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:00.462259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-c2ee2d13-3b1c-4625-bc38-dceb2adab996 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:00.464179 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 189/381] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:00.470873 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee2d13-3b1c-4625-bc38-dceb2adab996 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:00.485990 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-624948c3-74aa-495c-a2e1-d28dfd42e252 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:00.487195 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-624948c3-74aa-495c-a2e1-d28dfd42e252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:00.495079 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee2d13-3b1c-4625-bc38-dceb2adab996 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:00.505675 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea391c1-74c1-4a54-9f98-ebc8ca6f9e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:00.505904 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 193/382] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:00.506723 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea391c1-74c1-4a54-9f98-ebc8ca6f9e91 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.507144 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea391c1-74c1-4a54-9f98-ebc8ca6f9e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.507555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea391c1-74c1-4a54-9f98-ebc8ca6f9e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.508523 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea391c1-74c1-4a54-9f98-ebc8ca6f9e91 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:00.508968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea391c1-74c1-4a54-9f98-ebc8ca6f9e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:00.510722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea391c1-74c1-4a54-9f98-ebc8ca6f9e91 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:00.537929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 190/383] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:00.540254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624948c3-74aa-495c-a2e1-d28dfd42e252 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:00.554591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624948c3-74aa-495c-a2e1-d28dfd42e252 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:00.556827 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea391c1-74c1-4a54-9f98-ebc8ca6f9e91 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:00.569637 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea391c1-74c1-4a54-9f98-ebc8ca6f9e91 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:00.570531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cdd0a-ce55-4927-b518-b28549eff78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:00.571537 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cdd0a-ce55-4927-b518-b28549eff78a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.572024 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cdd0a-ce55-4927-b518-b28549eff78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.573207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cdd0a-ce55-4927-b518-b28549eff78a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.584339 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894307c-e916-47a4-984b-c7e1426d682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:00.585428 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894307c-e916-47a4-984b-c7e1426d682b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.585885 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894307c-e916-47a4-984b-c7e1426d682b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.587878 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894307c-e916-47a4-984b-c7e1426d682b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.593049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cdd0a-ce55-4927-b518-b28549eff78a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:00.601050 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-a06cdd0a-ce55-4927-b518-b28549eff78a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:00.608498 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 194/384] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:00.610371 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cdd0a-ce55-4927-b518-b28549eff78a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:00.619510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894307c-e916-47a4-984b-c7e1426d682b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:00.620817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cdd0a-ce55-4927-b518-b28549eff78a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:00.622625 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894307c-e916-47a4-984b-c7e1426d682b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:00.633200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b0494-2700-428d-9785-30173618c12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:00.633922 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b0494-2700-428d-9785-30173618c12d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.634374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b0494-2700-428d-9785-30173618c12d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.634653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b0494-2700-428d-9785-30173618c12d admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.635429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b0494-2700-428d-9785-30173618c12d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:00.635755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b0494-2700-428d-9785-30173618c12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:00.638099 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b0494-2700-428d-9785-30173618c12d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:00.663086 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 195/385] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:00.664853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-9894307c-e916-47a4-984b-c7e1426d682b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:00.666410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 191/386] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:00.667830 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b0494-2700-428d-9785-30173618c12d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:00.673941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894307c-e916-47a4-984b-c7e1426d682b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:00.685058 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b0494-2700-428d-9785-30173618c12d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:00.689751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894307c-e916-47a4-984b-c7e1426d682b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:00.690234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68274bf0-acd8-435a-bf7d-8b06dfe03dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:00.691100 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68274bf0-acd8-435a-bf7d-8b06dfe03dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.695825 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68274bf0-acd8-435a-bf7d-8b06dfe03dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.695825 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68274bf0-acd8-435a-bf7d-8b06dfe03dcc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.704079 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa930f77-f491-44ef-a5d7-b81619776d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:00.704798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930f77-f491-44ef-a5d7-b81619776d1a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.705078 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930f77-f491-44ef-a5d7-b81619776d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.706995 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930f77-f491-44ef-a5d7-b81619776d1a admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.707763 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa930f77-f491-44ef-a5d7-b81619776d1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:00.708074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa930f77-f491-44ef-a5d7-b81619776d1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:00.712365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa930f77-f491-44ef-a5d7-b81619776d1a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:00.717618 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68274bf0-acd8-435a-bf7d-8b06dfe03dcc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:00.721847 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68274bf0-acd8-435a-bf7d-8b06dfe03dcc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:00.736926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 192/387] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:00.744010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa930f77-f491-44ef-a5d7-b81619776d1a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:00.755751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-68274bf0-acd8-435a-bf7d-8b06dfe03dcc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:00.759977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 196/388] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:00.762027 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68274bf0-acd8-435a-bf7d-8b06dfe03dcc admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:00.765951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa930f77-f491-44ef-a5d7-b81619776d1a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:00.772828 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68274bf0-acd8-435a-bf7d-8b06dfe03dcc admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:00.778217 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2e23d-9bc8-46e9-be53-c593b5f8e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:00.779046 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e606205-b952-42c1-b36e-fc0f4e3532ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:00.780184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2e23d-9bc8-46e9-be53-c593b5f8e3fd admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.780454 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2e23d-9bc8-46e9-be53-c593b5f8e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.780969 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2e23d-9bc8-46e9-be53-c593b5f8e3fd admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.781068 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606205-b952-42c1-b36e-fc0f4e3532ea admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.783754 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606205-b952-42c1-b36e-fc0f4e3532ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.783754 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606205-b952-42c1-b36e-fc0f4e3532ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.783754 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e606205-b952-42c1-b36e-fc0f4e3532ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:00.783754 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e606205-b952-42c1-b36e-fc0f4e3532ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:00.784950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e606205-b952-42c1-b36e-fc0f4e3532ea admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:00.802145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2e23d-9bc8-46e9-be53-c593b5f8e3fd admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:00.805525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2e23d-9bc8-46e9-be53-c593b5f8e3fd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:00.820023 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 197/389] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:00.830275 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-36f2e23d-9bc8-46e9-be53-c593b5f8e3fd admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 29 01:11:00.832174 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 193/390] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:00 2021] GET /identity/v3/users/glance => generated 84 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:00.832970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e606205-b952-42c1-b36e-fc0f4e3532ea admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:00.838593 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2e23d-9bc8-46e9-be53-c593b5f8e3fd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:00.849945 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2e23d-9bc8-46e9-be53-c593b5f8e3fd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:00.855051 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da0c65-797c-490d-80f4-caaae608a563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:00.856063 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da0c65-797c-490d-80f4-caaae608a563 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.856388 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da0c65-797c-490d-80f4-caaae608a563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.856809 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da0c65-797c-490d-80f4-caaae608a563 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.857793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da0c65-797c-490d-80f4-caaae608a563 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:00.858268 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da0c65-797c-490d-80f4-caaae608a563 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:00.860256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-d8da0c65-797c-490d-80f4-caaae608a563 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:00.860256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:11:00.860256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:11:00.861846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da0c65-797c-490d-80f4-caaae608a563 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:00.862017 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e606205-b952-42c1-b36e-fc0f4e3532ea admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:00.900614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e622b-9d41-4203-af55-3f6100e9faa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:00.901473 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e622b-9d41-4203-af55-3f6100e9faa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.901815 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e622b-9d41-4203-af55-3f6100e9faa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.902112 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e622b-9d41-4203-af55-3f6100e9faa3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.919581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 194/391] 10.222.0.87 () {56 vars in 1158 bytes} [Fri Oct 29 01:11:00 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:00.924865 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e622b-9d41-4203-af55-3f6100e9faa3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:00.927926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da0c65-797c-490d-80f4-caaae608a563 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:00.933896 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e622b-9d41-4203-af55-3f6100e9faa3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:00.947611 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da0c65-797c-490d-80f4-caaae608a563 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:00.957735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111f7de-1c7e-45b8-8a8b-bac11de9f3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:00.958676 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111f7de-1c7e-45b8-8a8b-bac11de9f3ff admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:00.959104 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111f7de-1c7e-45b8-8a8b-bac11de9f3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:00.960812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111f7de-1c7e-45b8-8a8b-bac11de9f3ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:00.967537 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-f89e622b-9d41-4203-af55-3f6100e9faa3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 01:11:00.970262 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 198/392] 10.222.0.87 () {56 vars in 1114 bytes} [Fri Oct 29 01:11:00 2021] GET /identity/v3/users/nova => generated 82 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:00.981142 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111f7de-1c7e-45b8-8a8b-bac11de9f3ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:00.983164 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111f7de-1c7e-45b8-8a8b-bac11de9f3ff admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:00.993189 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e622b-9d41-4203-af55-3f6100e9faa3 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.003646 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e622b-9d41-4203-af55-3f6100e9faa3 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.004046 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 195/393] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:01.005496 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d25de0-6f3d-4912-8074-32a9d88c94b5 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.005782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d25de0-6f3d-4912-8074-32a9d88c94b5 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.006057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d25de0-6f3d-4912-8074-32a9d88c94b5 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.012218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 196/394] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:01.012936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d25de0-6f3d-4912-8074-32a9d88c94b5 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.014379 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf6216-f419-4f6c-92b1-890e9069a95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.015309 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf6216-f419-4f6c-92b1-890e9069a95e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.016117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf6216-f419-4f6c-92b1-890e9069a95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.016591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf6216-f419-4f6c-92b1-890e9069a95e admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.017634 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf6216-f419-4f6c-92b1-890e9069a95e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.018118 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf6216-f419-4f6c-92b1-890e9069a95e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.019327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-b6bf6216-f419-4f6c-92b1-890e9069a95e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:01.019327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:11:01.019327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:11:01.020840 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf6216-f419-4f6c-92b1-890e9069a95e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.027517 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d25de0-6f3d-4912-8074-32a9d88c94b5 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.033751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfe42b-f16b-45fc-8f75-d1070b318056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.034785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfe42b-f16b-45fc-8f75-d1070b318056 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.035142 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfe42b-f16b-45fc-8f75-d1070b318056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.035505 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfe42b-f16b-45fc-8f75-d1070b318056 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.048143 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfe42b-f16b-45fc-8f75-d1070b318056 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.050249 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfe42b-f16b-45fc-8f75-d1070b318056 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.063016 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 199/395] 10.222.0.87 () {56 vars in 1154 bytes} [Fri Oct 29 01:11:00 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:01.064563 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9c6a4-750a-4c34-b1ef-6ecb78af4351 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.064868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9c6a4-750a-4c34-b1ef-6ecb78af4351 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.065163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9c6a4-750a-4c34-b1ef-6ecb78af4351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.069249 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-e6bfe42b-f16b-45fc-8f75-d1070b318056 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:01.070621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 197/396] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:01.071693 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf273-044b-407f-b5ce-2c656d5e5f40 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.071943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf273-044b-407f-b5ce-2c656d5e5f40 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.072215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf273-044b-407f-b5ce-2c656d5e5f40 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.074125 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 198/397] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:01.074820 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bf273-044b-407f-b5ce-2c656d5e5f40 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.086842 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bf273-044b-407f-b5ce-2c656d5e5f40 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.089436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-c7c9c6a4-750a-4c34-b1ef-6ecb78af4351 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:01.090688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c7c9c6a4-750a-4c34-b1ef-6ecb78af4351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:01.091074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17573f8e-6a93-4743-b265-df40e882982f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.091688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17573f8e-6a93-4743-b265-df40e882982f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.091985 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17573f8e-6a93-4743-b265-df40e882982f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.092255 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17573f8e-6a93-4743-b265-df40e882982f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.099561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 200/398] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:01.100249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9c6a4-750a-4c34-b1ef-6ecb78af4351 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.100766 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17573f8e-6a93-4743-b265-df40e882982f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.102653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17573f8e-6a93-4743-b265-df40e882982f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.114214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 199/399] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:01.115212 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9c6a4-750a-4c34-b1ef-6ecb78af4351 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.115525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ebd28-47da-423d-a725-07bfa6a6ff0c None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.115837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ebd28-47da-423d-a725-07bfa6a6ff0c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.116109 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ebd28-47da-423d-a725-07bfa6a6ff0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.120606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8d3ec-5f17-4be1-8fdb-eb87c8f46df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.121589 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8d3ec-5f17-4be1-8fdb-eb87c8f46df2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.122314 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8d3ec-5f17-4be1-8fdb-eb87c8f46df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.123778 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8d3ec-5f17-4be1-8fdb-eb87c8f46df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.124601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8d3ec-5f17-4be1-8fdb-eb87c8f46df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.124967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8d3ec-5f17-4be1-8fdb-eb87c8f46df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.126668 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8d3ec-5f17-4be1-8fdb-eb87c8f46df2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.134026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-4d4ebd28-47da-423d-a725-07bfa6a6ff0c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:01.135035 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4d4ebd28-47da-423d-a725-07bfa6a6ff0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:01.139193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 201/400] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:01.143898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8d3ec-5f17-4be1-8fdb-eb87c8f46df2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.146310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 200/401] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:01.146975 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ebd28-47da-423d-a725-07bfa6a6ff0c None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.154664 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8d3ec-5f17-4be1-8fdb-eb87c8f46df2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.156432 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ebd28-47da-423d-a725-07bfa6a6ff0c None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.160381 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88554d-60a6-4c4e-9453-e1c2ae7da925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.161206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4208ec-99e7-49bf-81f1-44be40ab7437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.161328 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88554d-60a6-4c4e-9453-e1c2ae7da925 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.161600 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88554d-60a6-4c4e-9453-e1c2ae7da925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.161885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88554d-60a6-4c4e-9453-e1c2ae7da925 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.162705 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4208ec-99e7-49bf-81f1-44be40ab7437 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.163080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4208ec-99e7-49bf-81f1-44be40ab7437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.163472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4208ec-99e7-49bf-81f1-44be40ab7437 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.174856 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4208ec-99e7-49bf-81f1-44be40ab7437 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:01.175978 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88554d-60a6-4c4e-9453-e1c2ae7da925 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.177952 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88554d-60a6-4c4e-9453-e1c2ae7da925 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.181828 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-0e4208ec-99e7-49bf-81f1-44be40ab7437 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:01.183244 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 201/402] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:01.183992 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4208ec-99e7-49bf-81f1-44be40ab7437 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.195505 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4208ec-99e7-49bf-81f1-44be40ab7437 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.199798 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-7f88554d-60a6-4c4e-9453-e1c2ae7da925 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:01.200012 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabac80-1817-49a1-8ef8-c6428b567896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.200768 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabac80-1817-49a1-8ef8-c6428b567896 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.201017 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 202/403] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:01.201191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabac80-1817-49a1-8ef8-c6428b567896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.201297 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabac80-1817-49a1-8ef8-c6428b567896 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.201786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88554d-60a6-4c4e-9453-e1c2ae7da925 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.211928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88554d-60a6-4c4e-9453-e1c2ae7da925 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.214246 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabac80-1817-49a1-8ef8-c6428b567896 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.216405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848b71a-a091-40c7-8c29-225b69c44adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.216525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabac80-1817-49a1-8ef8-c6428b567896 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.217228 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848b71a-a091-40c7-8c29-225b69c44adf admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.217509 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848b71a-a091-40c7-8c29-225b69c44adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.217784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848b71a-a091-40c7-8c29-225b69c44adf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.229134 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848b71a-a091-40c7-8c29-225b69c44adf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:01.230728 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-faabac80-1817-49a1-8ef8-c6428b567896 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:01.237858 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 202/404] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:01.237858 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabac80-1817-49a1-8ef8-c6428b567896 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.238065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-e848b71a-a091-40c7-8c29-225b69c44adf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:01.238228 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 203/405] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:01.239036 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848b71a-a091-40c7-8c29-225b69c44adf admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.247646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabac80-1817-49a1-8ef8-c6428b567896 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.253325 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec439f-20c0-46ee-958f-a9426cbb067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.253750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848b71a-a091-40c7-8c29-225b69c44adf admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.253971 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec439f-20c0-46ee-958f-a9426cbb067f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.254247 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec439f-20c0-46ee-958f-a9426cbb067f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.254512 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec439f-20c0-46ee-958f-a9426cbb067f admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.255269 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec439f-20c0-46ee-958f-a9426cbb067f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.255565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec439f-20c0-46ee-958f-a9426cbb067f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.257216 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec439f-20c0-46ee-958f-a9426cbb067f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.258787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6f94d-f42e-42b5-8306-f4f3b0b4e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.259170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6f94d-f42e-42b5-8306-f4f3b0b4e85c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.259759 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6f94d-f42e-42b5-8306-f4f3b0b4e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.259759 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6f94d-f42e-42b5-8306-f4f3b0b4e85c admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.260624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6f94d-f42e-42b5-8306-f4f3b0b4e85c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.260967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6f94d-f42e-42b5-8306-f4f3b0b4e85c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.262854 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6f94d-f42e-42b5-8306-f4f3b0b4e85c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.266866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 203/406] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:01.272740 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec439f-20c0-46ee-958f-a9426cbb067f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.280304 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 204/407] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:01.280304 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6f94d-f42e-42b5-8306-f4f3b0b4e85c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.282148 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec439f-20c0-46ee-958f-a9426cbb067f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.286590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1667d1f-de0b-4a0e-bf74-9f89ddd5f22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.287365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1667d1f-de0b-4a0e-bf74-9f89ddd5f22f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.287561 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1667d1f-de0b-4a0e-bf74-9f89ddd5f22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.287893 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1667d1f-de0b-4a0e-bf74-9f89ddd5f22f admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.288744 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1667d1f-de0b-4a0e-bf74-9f89ddd5f22f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.289091 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1667d1f-de0b-4a0e-bf74-9f89ddd5f22f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.290156 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-d1667d1f-de0b-4a0e-bf74-9f89ddd5f22f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:01.290156 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:11:01.290156 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:11:01.290582 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6f94d-f42e-42b5-8306-f4f3b0b4e85c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.291452 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1667d1f-de0b-4a0e-bf74-9f89ddd5f22f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.295022 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20146e7-056e-4774-b89c-634ca84a4eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.295681 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20146e7-056e-4774-b89c-634ca84a4eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.295967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20146e7-056e-4774-b89c-634ca84a4eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.296232 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20146e7-056e-4774-b89c-634ca84a4eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.297997 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20146e7-056e-4774-b89c-634ca84a4eb8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.297997 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20146e7-056e-4774-b89c-634ca84a4eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.299362 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20146e7-056e-4774-b89c-634ca84a4eb8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.314425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 205/408] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:01.314425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20146e7-056e-4774-b89c-634ca84a4eb8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.318038 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 204/409] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:01.319360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1667d1f-de0b-4a0e-bf74-9f89ddd5f22f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.320618 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20146e7-056e-4774-b89c-634ca84a4eb8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.327576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65bc83-3937-4955-b3d2-1623cc155abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.328568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65bc83-3937-4955-b3d2-1623cc155abd admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.328954 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65bc83-3937-4955-b3d2-1623cc155abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.329226 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65bc83-3937-4955-b3d2-1623cc155abd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.334074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1667d1f-de0b-4a0e-bf74-9f89ddd5f22f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.338759 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0afc2-7368-4c5e-ba3c-d4e7dbf8e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.339683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0afc2-7368-4c5e-ba3c-d4e7dbf8e414 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.339811 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65bc83-3937-4955-b3d2-1623cc155abd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.340021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0afc2-7368-4c5e-ba3c-d4e7dbf8e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.345879 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0afc2-7368-4c5e-ba3c-d4e7dbf8e414 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.345995 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65bc83-3937-4955-b3d2-1623cc155abd admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.348576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0afc2-7368-4c5e-ba3c-d4e7dbf8e414 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.351128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0afc2-7368-4c5e-ba3c-d4e7dbf8e414 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.358751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-bf65bc83-3937-4955-b3d2-1623cc155abd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:01.360758 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 206/410] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:01.362435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65bc83-3937-4955-b3d2-1623cc155abd admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.366938 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-cac0afc2-7368-4c5e-ba3c-d4e7dbf8e414 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:01.368142 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 205/411] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:01.368902 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0afc2-7368-4c5e-ba3c-d4e7dbf8e414 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.378002 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65bc83-3937-4955-b3d2-1623cc155abd admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.379550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0afc2-7368-4c5e-ba3c-d4e7dbf8e414 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.382526 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448c88d-e11e-492c-a6e0-3634f46d0af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.383287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448c88d-e11e-492c-a6e0-3634f46d0af5 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.383574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448c88d-e11e-492c-a6e0-3634f46d0af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.383896 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448c88d-e11e-492c-a6e0-3634f46d0af5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.384108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07c605-7871-432c-8cb5-e5e3df9528a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.384714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07c605-7871-432c-8cb5-e5e3df9528a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.384991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07c605-7871-432c-8cb5-e5e3df9528a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.385255 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07c605-7871-432c-8cb5-e5e3df9528a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.386087 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07c605-7871-432c-8cb5-e5e3df9528a7 admin admin] RBAC: Adding query filter params (role.id=0811ae5a177643f9b2b86ec5feb7b163, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=0998dd32ba8648cfb7f43797a9266d81) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.386379 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07c605-7871-432c-8cb5-e5e3df9528a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.388243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07c605-7871-432c-8cb5-e5e3df9528a7 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.404057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 206/412] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/role_assignments?user.id=0998dd32ba8648cfb7f43797a9266d81&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=0811ae5a177643f9b2b86ec5feb7b163 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:01.404057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07c605-7871-432c-8cb5-e5e3df9528a7 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.404667 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07c605-7871-432c-8cb5-e5e3df9528a7 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.406008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448c88d-e11e-492c-a6e0-3634f46d0af5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.408194 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448c88d-e11e-492c-a6e0-3634f46d0af5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.409983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde9c95-2ec9-40e7-8169-87501ad87101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.410690 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde9c95-2ec9-40e7-8169-87501ad87101 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.410974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde9c95-2ec9-40e7-8169-87501ad87101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.411576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde9c95-2ec9-40e7-8169-87501ad87101 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.412043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde9c95-2ec9-40e7-8169-87501ad87101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.412342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde9c95-2ec9-40e7-8169-87501ad87101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.414153 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde9c95-2ec9-40e7-8169-87501ad87101 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.428501 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 207/413] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:01.429701 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-4448c88d-e11e-492c-a6e0-3634f46d0af5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:01.430968 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 207/414] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:01.434700 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde9c95-2ec9-40e7-8169-87501ad87101 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.437868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448c88d-e11e-492c-a6e0-3634f46d0af5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.447428 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde9c95-2ec9-40e7-8169-87501ad87101 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.450552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448c88d-e11e-492c-a6e0-3634f46d0af5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.452206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b399e-d268-4931-beee-881e3588a490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.453021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b399e-d268-4931-beee-881e3588a490 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.453815 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b399e-d268-4931-beee-881e3588a490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.453815 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b399e-d268-4931-beee-881e3588a490 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.454853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b399e-d268-4931-beee-881e3588a490 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.454853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b399e-d268-4931-beee-881e3588a490 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.455639 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266d2a9-7563-4a6d-a3f4-a9ef4f69b8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.456472 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266d2a9-7563-4a6d-a3f4-a9ef4f69b8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.456730 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b399e-d268-4931-beee-881e3588a490 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.456882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266d2a9-7563-4a6d-a3f4-a9ef4f69b8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.457023 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266d2a9-7563-4a6d-a3f4-a9ef4f69b8d9 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.467442 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266d2a9-7563-4a6d-a3f4-a9ef4f69b8d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.470155 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266d2a9-7563-4a6d-a3f4-a9ef4f69b8d9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.470711 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 208/415] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:01.476900 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b399e-d268-4931-beee-881e3588a490 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.490496 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b399e-d268-4931-beee-881e3588a490 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.490834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-a266d2a9-7563-4a6d-a3f4-a9ef4f69b8d9 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 29 01:11:01.492563 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 208/416] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/users/neutron => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:01.493444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266d2a9-7563-4a6d-a3f4-a9ef4f69b8d9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.504415 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd44536-0bfd-408e-b830-c933405e9606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.505096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd44536-0bfd-408e-b830-c933405e9606 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.505377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd44536-0bfd-408e-b830-c933405e9606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.505649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd44536-0bfd-408e-b830-c933405e9606 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.506452 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd44536-0bfd-408e-b830-c933405e9606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.506755 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd44536-0bfd-408e-b830-c933405e9606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.508416 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd44536-0bfd-408e-b830-c933405e9606 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.510765 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266d2a9-7563-4a6d-a3f4-a9ef4f69b8d9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.516495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66352d67-27dc-4883-acf5-f80fdba2239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.517623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66352d67-27dc-4883-acf5-f80fdba2239f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.518152 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66352d67-27dc-4883-acf5-f80fdba2239f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.518658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66352d67-27dc-4883-acf5-f80fdba2239f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.519819 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66352d67-27dc-4883-acf5-f80fdba2239f admin admin] RBAC: Adding query filter params (role.id=0811ae5a177643f9b2b86ec5feb7b163, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=28d331f2997547968c51fec87598420f) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.520396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66352d67-27dc-4883-acf5-f80fdba2239f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.522624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66352d67-27dc-4883-acf5-f80fdba2239f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.527979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 209/417] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:01.534332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd44536-0bfd-408e-b830-c933405e9606 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.535098 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 209/418] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/role_assignments?user.id=28d331f2997547968c51fec87598420f&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=0811ae5a177643f9b2b86ec5feb7b163 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:01.536283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66352d67-27dc-4883-acf5-f80fdba2239f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.545924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd44536-0bfd-408e-b830-c933405e9606 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.552008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66352d67-27dc-4883-acf5-f80fdba2239f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.557577 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f9259-b686-4f7f-835a-520a7d54768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.558880 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f9259-b686-4f7f-835a-520a7d54768b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.559505 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f9259-b686-4f7f-835a-520a7d54768b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.560006 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f9259-b686-4f7f-835a-520a7d54768b admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.569127 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adaa8c-fc3f-469b-a2c4-c95efe6bff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.569830 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adaa8c-fc3f-469b-a2c4-c95efe6bff27 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.570112 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adaa8c-fc3f-469b-a2c4-c95efe6bff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.570387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adaa8c-fc3f-469b-a2c4-c95efe6bff27 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.571340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adaa8c-fc3f-469b-a2c4-c95efe6bff27 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.571650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adaa8c-fc3f-469b-a2c4-c95efe6bff27 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.572947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f9259-b686-4f7f-835a-520a7d54768b admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.573632 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adaa8c-fc3f-469b-a2c4-c95efe6bff27 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.575643 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f9259-b686-4f7f-835a-520a7d54768b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.591467 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-8f3f9259-b686-4f7f-835a-520a7d54768b admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 01:11:01.593105 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 210/419] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/users/cinder => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:01.601126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f9259-b686-4f7f-835a-520a7d54768b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.604923 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 210/420] 10.222.0.87 () {56 vars in 1160 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:01.610391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adaa8c-fc3f-469b-a2c4-c95efe6bff27 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.616924 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f9259-b686-4f7f-835a-520a7d54768b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.622125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722872ea-31d8-47ea-8bc7-ebad58f84969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.623152 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722872ea-31d8-47ea-8bc7-ebad58f84969 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.623653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722872ea-31d8-47ea-8bc7-ebad58f84969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.624214 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722872ea-31d8-47ea-8bc7-ebad58f84969 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.625348 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722872ea-31d8-47ea-8bc7-ebad58f84969 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.625769 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adaa8c-fc3f-469b-a2c4-c95efe6bff27 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.626152 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722872ea-31d8-47ea-8bc7-ebad58f84969 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.628541 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722872ea-31d8-47ea-8bc7-ebad58f84969 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.644590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76df05f-607b-44fd-9f75-daec5d969d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.645330 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76df05f-607b-44fd-9f75-daec5d969d59 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.645614 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76df05f-607b-44fd-9f75-daec5d969d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.645893 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76df05f-607b-44fd-9f75-daec5d969d59 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.652370 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 211/421] 10.222.0.87 () {56 vars in 1158 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:01.655431 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76df05f-607b-44fd-9f75-daec5d969d59 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.660822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76df05f-607b-44fd-9f75-daec5d969d59 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.661424 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722872ea-31d8-47ea-8bc7-ebad58f84969 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.671151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 211/422] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:11:01.673923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722872ea-31d8-47ea-8bc7-ebad58f84969 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.679494 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76df05f-607b-44fd-9f75-daec5d969d59 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.680160 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b8a8c-70dd-48c1-80ae-d40a0783186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.681106 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b8a8c-70dd-48c1-80ae-d40a0783186b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.681638 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b8a8c-70dd-48c1-80ae-d40a0783186b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.682133 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b8a8c-70dd-48c1-80ae-d40a0783186b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.691445 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76df05f-607b-44fd-9f75-daec5d969d59 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.694932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b8a8c-70dd-48c1-80ae-d40a0783186b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.696361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377cf1b-b027-40ff-bd3c-50d8adfbf332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.697240 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377cf1b-b027-40ff-bd3c-50d8adfbf332 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.697618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377cf1b-b027-40ff-bd3c-50d8adfbf332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.697900 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b8a8c-70dd-48c1-80ae-d40a0783186b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.698001 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377cf1b-b027-40ff-bd3c-50d8adfbf332 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.710323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 212/423] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:01.715797 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377cf1b-b027-40ff-bd3c-50d8adfbf332 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.715983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377cf1b-b027-40ff-bd3c-50d8adfbf332 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.717134 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b8a8c-70dd-48c1-80ae-d40a0783186b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.728695 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b8a8c-70dd-48c1-80ae-d40a0783186b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.734605 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121617a-9379-4cb3-86bf-44704fb5641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.735797 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121617a-9379-4cb3-86bf-44704fb5641b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.736280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121617a-9379-4cb3-86bf-44704fb5641b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.736745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121617a-9379-4cb3-86bf-44704fb5641b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.738260 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-a377cf1b-b027-40ff-bd3c-50d8adfbf332 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:01.745990 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 212/424] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:01.747079 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377cf1b-b027-40ff-bd3c-50d8adfbf332 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.755405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121617a-9379-4cb3-86bf-44704fb5641b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.757889 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121617a-9379-4cb3-86bf-44704fb5641b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.772913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377cf1b-b027-40ff-bd3c-50d8adfbf332 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.785757 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ce422-679b-4836-93ab-29e34576e11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.786930 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ce422-679b-4836-93ab-29e34576e11c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.787463 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ce422-679b-4836-93ab-29e34576e11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.788009 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ce422-679b-4836-93ab-29e34576e11c admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.789056 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ce422-679b-4836-93ab-29e34576e11c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.789606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ce422-679b-4836-93ab-29e34576e11c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.794137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ce422-679b-4836-93ab-29e34576e11c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.798120 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-7121617a-9379-4cb3-86bf-44704fb5641b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:01.800829 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 213/425] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:01.812978 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121617a-9379-4cb3-86bf-44704fb5641b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.823931 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 213/426] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:01.832570 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121617a-9379-4cb3-86bf-44704fb5641b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.833713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ce422-679b-4836-93ab-29e34576e11c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.837340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cf741-d8e6-492f-bcf3-5c17fe74ea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.838062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cf741-d8e6-492f-bcf3-5c17fe74ea27 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.838341 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cf741-d8e6-492f-bcf3-5c17fe74ea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.838668 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cf741-d8e6-492f-bcf3-5c17fe74ea27 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.839423 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cf741-d8e6-492f-bcf3-5c17fe74ea27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.839819 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cf741-d8e6-492f-bcf3-5c17fe74ea27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.841576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cf741-d8e6-492f-bcf3-5c17fe74ea27 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.846010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ce422-679b-4836-93ab-29e34576e11c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.851666 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61d542-bec2-4c04-9c1a-a8c20a046ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.852879 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61d542-bec2-4c04-9c1a-a8c20a046ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.853440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61d542-bec2-4c04-9c1a-a8c20a046ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.853963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61d542-bec2-4c04-9c1a-a8c20a046ff0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.859801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 214/427] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:01.871130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cf741-d8e6-492f-bcf3-5c17fe74ea27 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.878055 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61d542-bec2-4c04-9c1a-a8c20a046ff0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.880386 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61d542-bec2-4c04-9c1a-a8c20a046ff0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.882370 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cf741-d8e6-492f-bcf3-5c17fe74ea27 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.888651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9de2d-d880-40b0-b58f-18be78b93bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.888651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9de2d-d880-40b0-b58f-18be78b93bef admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.888651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9de2d-d880-40b0-b58f-18be78b93bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.888938 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9de2d-d880-40b0-b58f-18be78b93bef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.897444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9de2d-d880-40b0-b58f-18be78b93bef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.898771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-2b61d542-bec2-4c04-9c1a-a8c20a046ff0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:01.899434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9de2d-d880-40b0-b58f-18be78b93bef admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.900918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 214/428] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:01.908496 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61d542-bec2-4c04-9c1a-a8c20a046ff0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.918684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-44a9de2d-d880-40b0-b58f-18be78b93bef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:01.919865 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61d542-bec2-4c04-9c1a-a8c20a046ff0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.923882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 215/429] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:01.928722 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9de2d-d880-40b0-b58f-18be78b93bef admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:01.937204 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e6e18-ce95-42e3-b59c-140629a299e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.939437 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e6e18-ce95-42e3-b59c-140629a299e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.939968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e6e18-ce95-42e3-b59c-140629a299e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.940436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e6e18-ce95-42e3-b59c-140629a299e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.941494 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e6e18-ce95-42e3-b59c-140629a299e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.942963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e6e18-ce95-42e3-b59c-140629a299e6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.948736 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e6e18-ce95-42e3-b59c-140629a299e6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.951756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9de2d-d880-40b0-b58f-18be78b93bef admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:01.963813 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5a52f-1e4a-42a7-a0d4-eed9690688f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:01.964877 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5a52f-1e4a-42a7-a0d4-eed9690688f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:01.965347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5a52f-1e4a-42a7-a0d4-eed9690688f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:01.965806 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5a52f-1e4a-42a7-a0d4-eed9690688f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:01.968195 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5a52f-1e4a-42a7-a0d4-eed9690688f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:01.970084 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5a52f-1e4a-42a7-a0d4-eed9690688f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:01.972565 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-fca5a52f-1e4a-42a7-a0d4-eed9690688f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:01.972565 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:11:01.972565 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:11:01.974124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5a52f-1e4a-42a7-a0d4-eed9690688f7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:01.975387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 215/430] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:01.999340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 216/431] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:02.006357 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e6e18-ce95-42e3-b59c-140629a299e6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:02.013393 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5a52f-1e4a-42a7-a0d4-eed9690688f7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:02.018014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e6e18-ce95-42e3-b59c-140629a299e6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:02.026976 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8d84c-c367-46c6-96e5-039d0a3e1879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:02.028081 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8d84c-c367-46c6-96e5-039d0a3e1879 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:02.028557 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8d84c-c367-46c6-96e5-039d0a3e1879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:02.029158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8d84c-c367-46c6-96e5-039d0a3e1879 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:02.031277 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8d84c-c367-46c6-96e5-039d0a3e1879 admin admin] RBAC: Adding query filter params (role.id=0811ae5a177643f9b2b86ec5feb7b163, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=c6be4b7bef21492bad49e6b5a284f4f0) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:02.033626 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8d84c-c367-46c6-96e5-039d0a3e1879 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:02.038048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8d84c-c367-46c6-96e5-039d0a3e1879 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:02.038922 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5a52f-1e4a-42a7-a0d4-eed9690688f7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:02.053105 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acd90b-096a-468a-a5c5-44a925bfe979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:02.053751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 216/432] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:02 2021] GET /identity/v3/role_assignments?user.id=c6be4b7bef21492bad49e6b5a284f4f0&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=0811ae5a177643f9b2b86ec5feb7b163 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:02.054499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acd90b-096a-468a-a5c5-44a925bfe979 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:02.055082 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acd90b-096a-468a-a5c5-44a925bfe979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:02.055601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acd90b-096a-468a-a5c5-44a925bfe979 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:02.056830 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acd90b-096a-468a-a5c5-44a925bfe979 admin admin] RBAC: Adding query filter params (role.id=0811ae5a177643f9b2b86ec5feb7b163, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=48b92ce8a3bd4d1ebfd94249d525addb) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:02.057444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acd90b-096a-468a-a5c5-44a925bfe979 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:02.059872 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acd90b-096a-468a-a5c5-44a925bfe979 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:02.068472 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 217/433] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:02 2021] GET /identity/v3/role_assignments?user.id=48b92ce8a3bd4d1ebfd94249d525addb&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=0811ae5a177643f9b2b86ec5feb7b163 => generated 259 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:02.215299 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722cf9b-0025-44f7-8680-a99435ae5277 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:02.215663 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722cf9b-0025-44f7-8680-a99435ae5277 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:02.216076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722cf9b-0025-44f7-8680-a99435ae5277 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:02.218259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 217/434] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:02.225161 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd3175-7216-4e85-b1d1-bdfcc7e0940e None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:02.225682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd3175-7216-4e85-b1d1-bdfcc7e0940e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:02.226097 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd3175-7216-4e85-b1d1-bdfcc7e0940e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:02.245802 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-93fd3175-7216-4e85-b1d1-bdfcc7e0940e None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:02.247320 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-93fd3175-7216-4e85-b1d1-bdfcc7e0940e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:02.256435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 218/435] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:02.282881 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722cf9b-0025-44f7-8680-a99435ae5277 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:02.295770 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722cf9b-0025-44f7-8680-a99435ae5277 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:02.301569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed491e-5928-47eb-aa7b-38defa43b6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:02.302644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed491e-5928-47eb-aa7b-38defa43b6ba admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:02.303145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed491e-5928-47eb-aa7b-38defa43b6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:02.303609 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed491e-5928-47eb-aa7b-38defa43b6ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:02.325410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed491e-5928-47eb-aa7b-38defa43b6ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:02.327547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed491e-5928-47eb-aa7b-38defa43b6ba admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:02.351550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-1fed491e-5928-47eb-aa7b-38defa43b6ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:02.356635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 218/436] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:02.364080 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd3175-7216-4e85-b1d1-bdfcc7e0940e None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:02.377475 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd3175-7216-4e85-b1d1-bdfcc7e0940e None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:02.383078 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc405bf-e47d-4250-85ad-f81a42c59898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:02.384092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc405bf-e47d-4250-85ad-f81a42c59898 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:02.384576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc405bf-e47d-4250-85ad-f81a42c59898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:02.384988 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc405bf-e47d-4250-85ad-f81a42c59898 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:02.385901 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc405bf-e47d-4250-85ad-f81a42c59898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:02.386347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc405bf-e47d-4250-85ad-f81a42c59898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:02.388256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc405bf-e47d-4250-85ad-f81a42c59898 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:02.401884 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 219/437] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:02.409721 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed491e-5928-47eb-aa7b-38defa43b6ba admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:02.420567 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed491e-5928-47eb-aa7b-38defa43b6ba admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:02.426992 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895aabea-f4e9-4532-a550-146c6b2424bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:02.428001 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aabea-f4e9-4532-a550-146c6b2424bf admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:02.428540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aabea-f4e9-4532-a550-146c6b2424bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:02.428957 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aabea-f4e9-4532-a550-146c6b2424bf admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:02.429900 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895aabea-f4e9-4532-a550-146c6b2424bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:02.432204 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895aabea-f4e9-4532-a550-146c6b2424bf admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:02.582206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 219/438] 10.222.0.87 () {60 vars in 1153 bytes} [Fri Oct 29 01:11:02 2021] POST /identity/v3/users => generated 247 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:04.021880 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11046ab9-7289-4066-9933-057eafd2e193 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.022406 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11046ab9-7289-4066-9933-057eafd2e193 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.022714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11046ab9-7289-4066-9933-057eafd2e193 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.024856 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 220/439] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:04.032349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82ab7-6b6e-4f50-928c-3a2ac331b1ef None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.032782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82ab7-6b6e-4f50-928c-3a2ac331b1ef None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.032902 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82ab7-6b6e-4f50-928c-3a2ac331b1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.058920 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-b5e82ab7-6b6e-4f50-928c-3a2ac331b1ef None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:04.060425 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b5e82ab7-6b6e-4f50-928c-3a2ac331b1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:04.070085 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 220/440] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:04.113257 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11046ab9-7289-4066-9933-057eafd2e193 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:04.133183 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11046ab9-7289-4066-9933-057eafd2e193 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:04.137671 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9f988-eae3-4391-be3d-5f045b4804c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:04.138561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9f988-eae3-4391-be3d-5f045b4804c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.138936 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9f988-eae3-4391-be3d-5f045b4804c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.139303 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9f988-eae3-4391-be3d-5f045b4804c8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.151180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9f988-eae3-4391-be3d-5f045b4804c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:04.158756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-b3c9f988-eae3-4391-be3d-5f045b4804c8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:04.160381 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 221/441] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:04.166834 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e82ab7-6b6e-4f50-928c-3a2ac331b1ef None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:04.181161 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e82ab7-6b6e-4f50-928c-3a2ac331b1ef None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:04.192483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549fdb8-e854-43f1-888d-1779638f6195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:04.193154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549fdb8-e854-43f1-888d-1779638f6195 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.193440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549fdb8-e854-43f1-888d-1779638f6195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.193779 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549fdb8-e854-43f1-888d-1779638f6195 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.194928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549fdb8-e854-43f1-888d-1779638f6195 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:04.195242 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549fdb8-e854-43f1-888d-1779638f6195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:04.196972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549fdb8-e854-43f1-888d-1779638f6195 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:04.214159 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 221/442] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:04.220577 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9f988-eae3-4391-be3d-5f045b4804c8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:04.230642 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9f988-eae3-4391-be3d-5f045b4804c8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:04.243379 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4bcb5-6b93-409a-90af-ef834e22858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:04.244315 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4bcb5-6b93-409a-90af-ef834e22858e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.244708 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4bcb5-6b93-409a-90af-ef834e22858e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.245073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4bcb5-6b93-409a-90af-ef834e22858e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.265065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4bcb5-6b93-409a-90af-ef834e22858e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:04.267631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4bcb5-6b93-409a-90af-ef834e22858e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:04.291007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-f1c4bcb5-6b93-409a-90af-ef834e22858e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:04.292445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 222/443] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:04.298877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549fdb8-e854-43f1-888d-1779638f6195 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:04.319424 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549fdb8-e854-43f1-888d-1779638f6195 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:04.329559 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55c192-24cc-4bff-8fd9-d9457b4ef694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:04.330263 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55c192-24cc-4bff-8fd9-d9457b4ef694 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.330547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55c192-24cc-4bff-8fd9-d9457b4ef694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.330822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55c192-24cc-4bff-8fd9-d9457b4ef694 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.331562 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55c192-24cc-4bff-8fd9-d9457b4ef694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:04.331892 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55c192-24cc-4bff-8fd9-d9457b4ef694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:04.333494 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55c192-24cc-4bff-8fd9-d9457b4ef694 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:04.353548 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 222/444] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:04.359891 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4bcb5-6b93-409a-90af-ef834e22858e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:04.372849 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4bcb5-6b93-409a-90af-ef834e22858e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:04.383431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c50cda-e60b-4076-8624-4e42609d097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:04.384276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c50cda-e60b-4076-8624-4e42609d097d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.384620 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c50cda-e60b-4076-8624-4e42609d097d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.384960 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c50cda-e60b-4076-8624-4e42609d097d admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.393581 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c50cda-e60b-4076-8624-4e42609d097d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:04.395785 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c50cda-e60b-4076-8624-4e42609d097d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:04.410447 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-61c50cda-e60b-4076-8624-4e42609d097d admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 29 01:11:04.412201 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 223/445] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:04 2021] GET /identity/v3/users/glance => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:04.418311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55c192-24cc-4bff-8fd9-d9457b4ef694 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:04.431816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55c192-24cc-4bff-8fd9-d9457b4ef694 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:04.440353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637332e-88f7-4811-979c-5f969727da48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:04.441288 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637332e-88f7-4811-979c-5f969727da48 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.441735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637332e-88f7-4811-979c-5f969727da48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.442143 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637332e-88f7-4811-979c-5f969727da48 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.443180 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637332e-88f7-4811-979c-5f969727da48 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:04.443634 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637332e-88f7-4811-979c-5f969727da48 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:04.445953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637332e-88f7-4811-979c-5f969727da48 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:04.475160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 223/446] 10.222.0.87 () {56 vars in 1158 bytes} [Fri Oct 29 01:11:04 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:04.481315 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c50cda-e60b-4076-8624-4e42609d097d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:04.493377 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c50cda-e60b-4076-8624-4e42609d097d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:04.503425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740be71-5a00-4301-8fbb-7bbef29eb106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:04.504382 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740be71-5a00-4301-8fbb-7bbef29eb106 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.504756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740be71-5a00-4301-8fbb-7bbef29eb106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.505125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740be71-5a00-4301-8fbb-7bbef29eb106 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.520732 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740be71-5a00-4301-8fbb-7bbef29eb106 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:04.522581 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740be71-5a00-4301-8fbb-7bbef29eb106 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:04.550288 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-1740be71-5a00-4301-8fbb-7bbef29eb106 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:04.551555 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 224/447] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:04.558043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637332e-88f7-4811-979c-5f969727da48 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:04.575647 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637332e-88f7-4811-979c-5f969727da48 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:04.585186 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416df48-ed3d-4175-a4c5-53e7cb50a294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:04.585935 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416df48-ed3d-4175-a4c5-53e7cb50a294 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.586272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416df48-ed3d-4175-a4c5-53e7cb50a294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.586552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416df48-ed3d-4175-a4c5-53e7cb50a294 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.587314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416df48-ed3d-4175-a4c5-53e7cb50a294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:04.587617 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416df48-ed3d-4175-a4c5-53e7cb50a294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:04.589374 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416df48-ed3d-4175-a4c5-53e7cb50a294 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:04.610237 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 224/448] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:04.615902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740be71-5a00-4301-8fbb-7bbef29eb106 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:04.629394 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740be71-5a00-4301-8fbb-7bbef29eb106 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:04.640703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f782c23-80c4-4e4e-befc-b6f97dcd039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:04.640703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f782c23-80c4-4e4e-befc-b6f97dcd039b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.641272 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f782c23-80c4-4e4e-befc-b6f97dcd039b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.641272 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f782c23-80c4-4e4e-befc-b6f97dcd039b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.657510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f782c23-80c4-4e4e-befc-b6f97dcd039b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:04.659479 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f782c23-80c4-4e4e-befc-b6f97dcd039b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:04.676000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-9f782c23-80c4-4e4e-befc-b6f97dcd039b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:04.677575 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 225/449] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:04.683884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416df48-ed3d-4175-a4c5-53e7cb50a294 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:04.700842 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416df48-ed3d-4175-a4c5-53e7cb50a294 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:04.709678 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908d77e-a358-4a5b-b921-cccccd0c7174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:04.710345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908d77e-a358-4a5b-b921-cccccd0c7174 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.710683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908d77e-a358-4a5b-b921-cccccd0c7174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.710961 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908d77e-a358-4a5b-b921-cccccd0c7174 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.711894 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908d77e-a358-4a5b-b921-cccccd0c7174 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:04.712208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908d77e-a358-4a5b-b921-cccccd0c7174 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:04.714384 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908d77e-a358-4a5b-b921-cccccd0c7174 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:04.719075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151012e0-b0af-4b2c-8544-2c588a85a2bf None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.719362 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151012e0-b0af-4b2c-8544-2c588a85a2bf None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.719639 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151012e0-b0af-4b2c-8544-2c588a85a2bf None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.721705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 226/450] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:11:04.729246 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f0d00-2ae9-4503-ac96-b97ce41ca6ff None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.729527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f0d00-2ae9-4503-ac96-b97ce41ca6ff None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.730312 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f0d00-2ae9-4503-ac96-b97ce41ca6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.733464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 225/451] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:04.739701 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908d77e-a358-4a5b-b921-cccccd0c7174 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:04.757626 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908d77e-a358-4a5b-b921-cccccd0c7174 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:04.766248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635e4ef-0b62-4fac-9722-4202978fce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:04.767493 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-243f0d00-2ae9-4503-ac96-b97ce41ca6ff None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:04.768832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-243f0d00-2ae9-4503-ac96-b97ce41ca6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:04.769823 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635e4ef-0b62-4fac-9722-4202978fce44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.770191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635e4ef-0b62-4fac-9722-4202978fce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.771370 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635e4ef-0b62-4fac-9722-4202978fce44 admin admin] PATH_INFO: `/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/0998dd32ba8648cfb7f43797a9266d81/roles/0811ae5a177643f9b2b86ec5feb7b163` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.786750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 227/452] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:04.793887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635e4ef-0b62-4fac-9722-4202978fce44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579ca0c9e3d480ab7b4f64d199c403b, user_id=0998dd32ba8648cfb7f43797a9266d81, role_id=0811ae5a177643f9b2b86ec5feb7b163)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:04.796979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635e4ef-0b62-4fac-9722-4202978fce44 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:04.820790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f0d00-2ae9-4503-ac96-b97ce41ca6ff None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:04.830685 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f0d00-2ae9-4503-ac96-b97ce41ca6ff None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:04.835429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f324a81-440b-477e-89ad-7b2384123904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:04.836243 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324a81-440b-477e-89ad-7b2384123904 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.836521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324a81-440b-477e-89ad-7b2384123904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.836789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324a81-440b-477e-89ad-7b2384123904 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.849092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f324a81-440b-477e-89ad-7b2384123904 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:04.856291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-8f324a81-440b-477e-89ad-7b2384123904 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:04.857568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 228/453] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:04.864879 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f324a81-440b-477e-89ad-7b2384123904 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:04.889303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 226/454] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:11:04 2021] PUT /identity/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/0998dd32ba8648cfb7f43797a9266d81/roles/0811ae5a177643f9b2b86ec5feb7b163 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:11:04.895425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f324a81-440b-477e-89ad-7b2384123904 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:04.962296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f164c-ce33-4427-af71-603716f4a3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:04.962969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f164c-ce33-4427-af71-603716f4a3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:04.963245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f164c-ce33-4427-af71-603716f4a3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:04.963514 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f164c-ce33-4427-af71-603716f4a3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:04.964359 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f164c-ce33-4427-af71-603716f4a3b9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:04.964661 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f164c-ce33-4427-af71-603716f4a3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:04.966297 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f164c-ce33-4427-af71-603716f4a3b9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:04.978144 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 229/455] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:04.985457 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635e4ef-0b62-4fac-9722-4202978fce44 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:04.995692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635e4ef-0b62-4fac-9722-4202978fce44 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.001062 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91029f-ad1b-45ce-9149-87c3df939d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.001924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91029f-ad1b-45ce-9149-87c3df939d9e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.002210 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91029f-ad1b-45ce-9149-87c3df939d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.002506 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91029f-ad1b-45ce-9149-87c3df939d9e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.006413 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cc821-e1b4-4697-b42a-b22b94176059 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.006700 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cc821-e1b4-4697-b42a-b22b94176059 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.006970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cc821-e1b4-4697-b42a-b22b94176059 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.009127 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 230/456] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:11:05.023866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91029f-ad1b-45ce-9149-87c3df939d9e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.026187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91029f-ad1b-45ce-9149-87c3df939d9e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.029914 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce286e2-5850-49ab-b2cb-5a4c7c488904 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.030433 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce286e2-5850-49ab-b2cb-5a4c7c488904 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.030433 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce286e2-5850-49ab-b2cb-5a4c7c488904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.059179 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-0e91029f-ad1b-45ce-9149-87c3df939d9e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:05.060490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 227/457] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:05.065495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-3ce286e2-5850-49ab-b2cb-5a4c7c488904 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:05.066706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3ce286e2-5850-49ab-b2cb-5a4c7c488904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:05.069095 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91029f-ad1b-45ce-9149-87c3df939d9e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.083944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91029f-ad1b-45ce-9149-87c3df939d9e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.087236 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 231/458] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:05.095976 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40c1e7-070c-4727-8aba-3827cb5bbb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.096653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40c1e7-070c-4727-8aba-3827cb5bbb75 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.096931 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40c1e7-070c-4727-8aba-3827cb5bbb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.097204 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40c1e7-070c-4727-8aba-3827cb5bbb75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.097953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40c1e7-070c-4727-8aba-3827cb5bbb75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:05.098259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40c1e7-070c-4727-8aba-3827cb5bbb75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.099903 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40c1e7-070c-4727-8aba-3827cb5bbb75 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.119431 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 228/459] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:05.125417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce286e2-5850-49ab-b2cb-5a4c7c488904 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.142266 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce286e2-5850-49ab-b2cb-5a4c7c488904 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.143970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40c1e7-070c-4727-8aba-3827cb5bbb75 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.156286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40c1e7-070c-4727-8aba-3827cb5bbb75 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.158705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c4945-5ee5-42f8-aa1d-f0f87387437c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.159516 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c4945-5ee5-42f8-aa1d-f0f87387437c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.159820 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c4945-5ee5-42f8-aa1d-f0f87387437c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.160095 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c4945-5ee5-42f8-aa1d-f0f87387437c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.169949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c4945-5ee5-42f8-aa1d-f0f87387437c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.172627 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c4945-5ee5-42f8-aa1d-f0f87387437c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.173689 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39a59a-fb0a-4716-95d2-212917494a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.174562 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39a59a-fb0a-4716-95d2-212917494a34 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.174839 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39a59a-fb0a-4716-95d2-212917494a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.175149 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39a59a-fb0a-4716-95d2-212917494a34 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.187926 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-ea1c4945-5ee5-42f8-aa1d-f0f87387437c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 01:11:05.189740 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 232/460] 10.222.0.87 () {56 vars in 1114 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/users/nova => generated 82 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:05.201475 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddff136-cbc1-46d2-adae-7576c0ac3870 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.201766 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddff136-cbc1-46d2-adae-7576c0ac3870 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.202043 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddff136-cbc1-46d2-adae-7576c0ac3870 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.204860 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 233/461] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:05.205241 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39a59a-fb0a-4716-95d2-212917494a34 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:05.205673 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddff136-cbc1-46d2-adae-7576c0ac3870 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.213600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-dc39a59a-fb0a-4716-95d2-212917494a34 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:05.215507 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 229/462] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:05.217118 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17231bae-6178-4aa0-a8ec-838ab4670ab5 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.217645 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17231bae-6178-4aa0-a8ec-838ab4670ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.218111 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17231bae-6178-4aa0-a8ec-838ab4670ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.224210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddff136-cbc1-46d2-adae-7576c0ac3870 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.230825 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60127ea6-1745-4a14-8788-82a6392bd2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.231863 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60127ea6-1745-4a14-8788-82a6392bd2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.232146 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60127ea6-1745-4a14-8788-82a6392bd2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.232421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60127ea6-1745-4a14-8788-82a6392bd2b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.233285 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60127ea6-1745-4a14-8788-82a6392bd2b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:05.233594 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60127ea6-1745-4a14-8788-82a6392bd2b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.235958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60127ea6-1745-4a14-8788-82a6392bd2b6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.239192 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-17231bae-6178-4aa0-a8ec-838ab4670ab5 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:05.241397 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-17231bae-6178-4aa0-a8ec-838ab4670ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:05.249619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 230/463] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:05.250503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17231bae-6178-4aa0-a8ec-838ab4670ab5 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.261947 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17231bae-6178-4aa0-a8ec-838ab4670ab5 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.266704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 234/464] 10.222.0.87 () {56 vars in 1154 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:05.272457 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610b44-30c6-4b7c-8216-f9cbb9b1b2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.273142 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610b44-30c6-4b7c-8216-f9cbb9b1b2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.273421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610b44-30c6-4b7c-8216-f9cbb9b1b2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.273691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610b44-30c6-4b7c-8216-f9cbb9b1b2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.274453 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55610b44-30c6-4b7c-8216-f9cbb9b1b2e0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:05.274757 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55610b44-30c6-4b7c-8216-f9cbb9b1b2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.276390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55610b44-30c6-4b7c-8216-f9cbb9b1b2e0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.279963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60127ea6-1745-4a14-8788-82a6392bd2b6 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.291434 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 231/465] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:05.292901 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610b44-30c6-4b7c-8216-f9cbb9b1b2e0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.293497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60127ea6-1745-4a14-8788-82a6392bd2b6 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.307318 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f31669-c087-40e5-86b4-aa06834aebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.308643 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f31669-c087-40e5-86b4-aa06834aebaa admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.309124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f31669-c087-40e5-86b4-aa06834aebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.309595 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f31669-c087-40e5-86b4-aa06834aebaa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.311174 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610b44-30c6-4b7c-8216-f9cbb9b1b2e0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.317139 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523a32e-f901-45bd-b93b-a15fa82cedae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.318122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a32e-f901-45bd-b93b-a15fa82cedae admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.318559 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a32e-f901-45bd-b93b-a15fa82cedae admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.319153 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a32e-f901-45bd-b93b-a15fa82cedae admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.330180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f31669-c087-40e5-86b4-aa06834aebaa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.331970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523a32e-f901-45bd-b93b-a15fa82cedae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:05.333699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f31669-c087-40e5-86b4-aa06834aebaa admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.339969 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-3523a32e-f901-45bd-b93b-a15fa82cedae admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:05.341535 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 232/466] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:05.342363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523a32e-f901-45bd-b93b-a15fa82cedae admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.360199 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523a32e-f901-45bd-b93b-a15fa82cedae admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.362122 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-78f31669-c087-40e5-86b4-aa06834aebaa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:05.364163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 235/467] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:05.364961 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f31669-c087-40e5-86b4-aa06834aebaa admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.370203 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28d658-5d83-4321-8281-e2423fd5e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.371012 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28d658-5d83-4321-8281-e2423fd5e536 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.371296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28d658-5d83-4321-8281-e2423fd5e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.371571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28d658-5d83-4321-8281-e2423fd5e536 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.376629 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f31669-c087-40e5-86b4-aa06834aebaa admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.381517 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b282d8c-b5a2-4e48-be01-95e9be87224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.382568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b282d8c-b5a2-4e48-be01-95e9be87224d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.383124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b282d8c-b5a2-4e48-be01-95e9be87224d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.383408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b282d8c-b5a2-4e48-be01-95e9be87224d admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.383936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28d658-5d83-4321-8281-e2423fd5e536 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.384203 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b282d8c-b5a2-4e48-be01-95e9be87224d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:05.384507 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b282d8c-b5a2-4e48-be01-95e9be87224d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.385927 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28d658-5d83-4321-8281-e2423fd5e536 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.386122 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b282d8c-b5a2-4e48-be01-95e9be87224d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.397020 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 236/468] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:05.397858 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b282d8c-b5a2-4e48-be01-95e9be87224d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.405510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-2b28d658-5d83-4321-8281-e2423fd5e536 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:05.407825 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 233/469] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:05.408566 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28d658-5d83-4321-8281-e2423fd5e536 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.418008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b282d8c-b5a2-4e48-be01-95e9be87224d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.423121 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89209108-fcf2-4a4d-9269-bf3deb8cf8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.423851 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89209108-fcf2-4a4d-9269-bf3deb8cf8af admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.424185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89209108-fcf2-4a4d-9269-bf3deb8cf8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.424503 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89209108-fcf2-4a4d-9269-bf3deb8cf8af admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.425016 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28d658-5d83-4321-8281-e2423fd5e536 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.425246 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89209108-fcf2-4a4d-9269-bf3deb8cf8af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:05.425560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89209108-fcf2-4a4d-9269-bf3deb8cf8af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.427594 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89209108-fcf2-4a4d-9269-bf3deb8cf8af admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.429750 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba18af-081c-4783-9823-bc80d0c66716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.430518 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba18af-081c-4783-9823-bc80d0c66716 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.430798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba18af-081c-4783-9823-bc80d0c66716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.431070 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba18af-081c-4783-9823-bc80d0c66716 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.441908 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 237/470] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:05.442741 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89209108-fcf2-4a4d-9269-bf3deb8cf8af admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.449922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba18af-081c-4783-9823-bc80d0c66716 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.451913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba18af-081c-4783-9823-bc80d0c66716 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.453561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89209108-fcf2-4a4d-9269-bf3deb8cf8af admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.458305 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ba0c0-19e8-47c8-8284-a3668ee471cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.458947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ba0c0-19e8-47c8-8284-a3668ee471cc admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.459267 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ba0c0-19e8-47c8-8284-a3668ee471cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.459546 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ba0c0-19e8-47c8-8284-a3668ee471cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.460314 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ba0c0-19e8-47c8-8284-a3668ee471cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:05.460668 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ba0c0-19e8-47c8-8284-a3668ee471cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.462329 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ba0c0-19e8-47c8-8284-a3668ee471cc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.471284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-dbba18af-081c-4783-9823-bc80d0c66716 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:05.472848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 234/471] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:05.473757 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba18af-081c-4783-9823-bc80d0c66716 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.477013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 238/472] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:05.482740 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ba0c0-19e8-47c8-8284-a3668ee471cc admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.493736 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba18af-081c-4783-9823-bc80d0c66716 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.497459 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ba0c0-19e8-47c8-8284-a3668ee471cc admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.498547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca3ae2-5f92-49cd-a00a-4e3be344311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.499955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca3ae2-5f92-49cd-a00a-4e3be344311c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.500480 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca3ae2-5f92-49cd-a00a-4e3be344311c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.501195 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca3ae2-5f92-49cd-a00a-4e3be344311c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.502736 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaac041-7247-4fab-bcf6-10f5857abde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.503617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac041-7247-4fab-bcf6-10f5857abde2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.503933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac041-7247-4fab-bcf6-10f5857abde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.504209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac041-7247-4fab-bcf6-10f5857abde2 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.509008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca3ae2-5f92-49cd-a00a-4e3be344311c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.510983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca3ae2-5f92-49cd-a00a-4e3be344311c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.512670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaac041-7247-4fab-bcf6-10f5857abde2 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.514774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaac041-7247-4fab-bcf6-10f5857abde2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.525787 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-17ca3ae2-5f92-49cd-a00a-4e3be344311c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:05.527011 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 235/473] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:05.529472 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-beaac041-7247-4fab-bcf6-10f5857abde2 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 29 01:11:05.534684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca3ae2-5f92-49cd-a00a-4e3be344311c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.535820 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 239/474] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/users/neutron => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:05.536663 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaac041-7247-4fab-bcf6-10f5857abde2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.548542 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca3ae2-5f92-49cd-a00a-4e3be344311c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.550047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaac041-7247-4fab-bcf6-10f5857abde2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.553725 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef631935-6b1c-433a-9122-6613d7e2e793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.554526 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef631935-6b1c-433a-9122-6613d7e2e793 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.554922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef631935-6b1c-433a-9122-6613d7e2e793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.555332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef631935-6b1c-433a-9122-6613d7e2e793 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.556257 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8229885-3468-47f2-9521-248dc96da58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.556439 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef631935-6b1c-433a-9122-6613d7e2e793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:05.556895 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef631935-6b1c-433a-9122-6613d7e2e793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.557565 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8229885-3468-47f2-9521-248dc96da58f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.558033 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8229885-3468-47f2-9521-248dc96da58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.558478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8229885-3468-47f2-9521-248dc96da58f admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.559042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef631935-6b1c-433a-9122-6613d7e2e793 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.559693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8229885-3468-47f2-9521-248dc96da58f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:05.560234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8229885-3468-47f2-9521-248dc96da58f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.562853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8229885-3468-47f2-9521-248dc96da58f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.583772 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 236/475] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:05.584284 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 240/476] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:05.585259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef631935-6b1c-433a-9122-6613d7e2e793 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.585835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8229885-3468-47f2-9521-248dc96da58f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.596615 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8229885-3468-47f2-9521-248dc96da58f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.597046 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef631935-6b1c-433a-9122-6613d7e2e793 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.601852 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e03b91-7540-4d26-a204-4b9fc13e61f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.602624 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e03b91-7540-4d26-a204-4b9fc13e61f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.602885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031112b4-2026-4280-bb2f-4343d7895500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.603000 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e03b91-7540-4d26-a204-4b9fc13e61f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.603160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e03b91-7540-4d26-a204-4b9fc13e61f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.604160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e03b91-7540-4d26-a204-4b9fc13e61f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:05.604488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031112b4-2026-4280-bb2f-4343d7895500 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.604590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e03b91-7540-4d26-a204-4b9fc13e61f3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.605052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031112b4-2026-4280-bb2f-4343d7895500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.605513 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031112b4-2026-4280-bb2f-4343d7895500 admin admin] PATH_INFO: `/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/28d331f2997547968c51fec87598420f/roles/0811ae5a177643f9b2b86ec5feb7b163` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.606526 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e03b91-7540-4d26-a204-4b9fc13e61f3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.622306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031112b4-2026-4280-bb2f-4343d7895500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579ca0c9e3d480ab7b4f64d199c403b, user_id=28d331f2997547968c51fec87598420f, role_id=0811ae5a177643f9b2b86ec5feb7b163)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.625996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031112b4-2026-4280-bb2f-4343d7895500 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.632218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 237/477] 10.222.0.87 () {56 vars in 1160 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:05.632218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e03b91-7540-4d26-a204-4b9fc13e61f3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.643471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e03b91-7540-4d26-a204-4b9fc13e61f3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.648019 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a8dc8-114f-4170-9b26-c45930324b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.648798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8dc8-114f-4170-9b26-c45930324b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.650210 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8dc8-114f-4170-9b26-c45930324b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.650210 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8dc8-114f-4170-9b26-c45930324b36 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.657774 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a8dc8-114f-4170-9b26-c45930324b36 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.659991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a8dc8-114f-4170-9b26-c45930324b36 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.674732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-601a8dc8-114f-4170-9b26-c45930324b36 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 01:11:05.676104 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 238/478] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:05.681329 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a8dc8-114f-4170-9b26-c45930324b36 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.691288 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a8dc8-114f-4170-9b26-c45930324b36 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.697693 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9f3c6-c0b7-49d9-bb85-f30b4d2657d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.698449 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f3c6-c0b7-49d9-bb85-f30b4d2657d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.698729 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f3c6-c0b7-49d9-bb85-f30b4d2657d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.698997 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f3c6-c0b7-49d9-bb85-f30b4d2657d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.706805 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 241/479] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:11:05 2021] PUT /identity/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/28d331f2997547968c51fec87598420f/roles/0811ae5a177643f9b2b86ec5feb7b163 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:11:05.707651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031112b4-2026-4280-bb2f-4343d7895500 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.711836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9f3c6-c0b7-49d9-bb85-f30b4d2657d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.713820 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9f3c6-c0b7-49d9-bb85-f30b4d2657d5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.736949 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-c3f9f3c6-c0b7-49d9-bb85-f30b4d2657d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:05.738219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 239/480] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:05.747161 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff33a71-8c0d-4aeb-9d5c-d08fc36f111a None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.747478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff33a71-8c0d-4aeb-9d5c-d08fc36f111a None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.747703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff33a71-8c0d-4aeb-9d5c-d08fc36f111a None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.750802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 240/481] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:05 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:05.756481 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff33a71-8c0d-4aeb-9d5c-d08fc36f111a None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.799744 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031112b4-2026-4280-bb2f-4343d7895500 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.805550 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a72ad6-ee24-45d9-a191-a6547b120e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.806597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72ad6-ee24-45d9-a191-a6547b120e6d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.807079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72ad6-ee24-45d9-a191-a6547b120e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.807567 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72ad6-ee24-45d9-a191-a6547b120e6d admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.808763 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a72ad6-ee24-45d9-a191-a6547b120e6d admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:05.809307 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a72ad6-ee24-45d9-a191-a6547b120e6d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.811547 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a72ad6-ee24-45d9-a191-a6547b120e6d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.826927 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff33a71-8c0d-4aeb-9d5c-d08fc36f111a None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.831522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540b859-b549-4d4b-8bf6-b22231a40cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.832227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540b859-b549-4d4b-8bf6-b22231a40cce admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.832490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540b859-b549-4d4b-8bf6-b22231a40cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.832759 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540b859-b549-4d4b-8bf6-b22231a40cce admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.833511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540b859-b549-4d4b-8bf6-b22231a40cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:05.833812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540b859-b549-4d4b-8bf6-b22231a40cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.834745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 242/482] 10.222.0.87 () {56 vars in 1158 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:05.835545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540b859-b549-4d4b-8bf6-b22231a40cce admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.836790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f8918-6b2d-4f93-b97e-dfaf247080e3 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.837298 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f8918-6b2d-4f93-b97e-dfaf247080e3 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.837803 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f8918-6b2d-4f93-b97e-dfaf247080e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.849645 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 241/483] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:05.855425 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540b859-b549-4d4b-8bf6-b22231a40cce admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.859617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d58f8918-6b2d-4f93-b97e-dfaf247080e3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:05.861456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d58f8918-6b2d-4f93-b97e-dfaf247080e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:05.867507 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540b859-b549-4d4b-8bf6-b22231a40cce admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.870826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 243/484] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:05.871958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f8918-6b2d-4f93-b97e-dfaf247080e3 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.877390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd5571-38ec-47e2-8794-216d439f0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.878208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd5571-38ec-47e2-8794-216d439f0ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.878483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd5571-38ec-47e2-8794-216d439f0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.878753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd5571-38ec-47e2-8794-216d439f0ae7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.888578 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f8918-6b2d-4f93-b97e-dfaf247080e3 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.903271 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280414d-c9db-4dee-af36-8587cb2551c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.904497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280414d-c9db-4dee-af36-8587cb2551c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.905786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280414d-c9db-4dee-af36-8587cb2551c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.906325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280414d-c9db-4dee-af36-8587cb2551c9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.906802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd5571-38ec-47e2-8794-216d439f0ae7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.911545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd5571-38ec-47e2-8794-216d439f0ae7 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.917723 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280414d-c9db-4dee-af36-8587cb2551c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.920016 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280414d-c9db-4dee-af36-8587cb2551c9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.935550 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-1280414d-c9db-4dee-af36-8587cb2551c9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:05.936281 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-18dd5571-38ec-47e2-8794-216d439f0ae7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:05.939172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 244/485] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:05.939301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 242/486] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:05.939655 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd5571-38ec-47e2-8794-216d439f0ae7 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.945613 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280414d-c9db-4dee-af36-8587cb2551c9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.950922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd5571-38ec-47e2-8794-216d439f0ae7 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.957319 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da052f3-57ae-4ebf-b105-582c56ca1c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.957630 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280414d-c9db-4dee-af36-8587cb2551c9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:05.958331 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da052f3-57ae-4ebf-b105-582c56ca1c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.958731 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da052f3-57ae-4ebf-b105-582c56ca1c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.959103 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da052f3-57ae-4ebf-b105-582c56ca1c69 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.962256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f167d6d-ef93-440e-8803-eb5503c162aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:05.962902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f167d6d-ef93-440e-8803-eb5503c162aa admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:05.963438 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f167d6d-ef93-440e-8803-eb5503c162aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:05.963438 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f167d6d-ef93-440e-8803-eb5503c162aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:05.964404 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f167d6d-ef93-440e-8803-eb5503c162aa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:05.964663 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f167d6d-ef93-440e-8803-eb5503c162aa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:05.966498 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f167d6d-ef93-440e-8803-eb5503c162aa admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:05.973834 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da052f3-57ae-4ebf-b105-582c56ca1c69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:05.980807 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-5da052f3-57ae-4ebf-b105-582c56ca1c69 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:05.982384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 245/487] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:05.982384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f167d6d-ef93-440e-8803-eb5503c162aa admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.982677 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 243/488] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:05.989013 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da052f3-57ae-4ebf-b105-582c56ca1c69 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:05.999357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f167d6d-ef93-440e-8803-eb5503c162aa admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.002929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da052f3-57ae-4ebf-b105-582c56ca1c69 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.004762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ac53c-83ca-4348-beb8-60709db9eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.005419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ac53c-83ca-4348-beb8-60709db9eee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.005701 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ac53c-83ca-4348-beb8-60709db9eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.005974 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ac53c-83ca-4348-beb8-60709db9eee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.006719 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ac53c-83ca-4348-beb8-60709db9eee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:06.007021 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ac53c-83ca-4348-beb8-60709db9eee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.008634 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ac53c-83ca-4348-beb8-60709db9eee8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.014358 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e3d84-2cad-4019-8fde-3e1cd5282e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.016342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e3d84-2cad-4019-8fde-3e1cd5282e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.016864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e3d84-2cad-4019-8fde-3e1cd5282e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.017362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e3d84-2cad-4019-8fde-3e1cd5282e56 admin admin] PATH_INFO: `/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/48b92ce8a3bd4d1ebfd94249d525addb/roles/0811ae5a177643f9b2b86ec5feb7b163` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.026093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 246/489] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:06.026093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ac53c-83ca-4348-beb8-60709db9eee8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:06.038065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ac53c-83ca-4348-beb8-60709db9eee8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.040904 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e3d84-2cad-4019-8fde-3e1cd5282e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579ca0c9e3d480ab7b4f64d199c403b, user_id=48b92ce8a3bd4d1ebfd94249d525addb, role_id=0811ae5a177643f9b2b86ec5feb7b163)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.043840 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e3d84-2cad-4019-8fde-3e1cd5282e56 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.043994 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad78635-44cc-49b8-93da-b09625955dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.044819 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78635-44cc-49b8-93da-b09625955dce admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.045231 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78635-44cc-49b8-93da-b09625955dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.045643 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78635-44cc-49b8-93da-b09625955dce admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.047268 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad78635-44cc-49b8-93da-b09625955dce admin admin] RBAC: Adding query filter params (name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:06.047842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad78635-44cc-49b8-93da-b09625955dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.050220 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad78635-44cc-49b8-93da-b09625955dce admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.058874 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 247/490] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:06.059936 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad78635-44cc-49b8-93da-b09625955dce admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:06.071302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad78635-44cc-49b8-93da-b09625955dce admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.075825 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ca70a-49d0-40b9-b202-6121812882e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.076598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ca70a-49d0-40b9-b202-6121812882e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.076879 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ca70a-49d0-40b9-b202-6121812882e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.077151 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ca70a-49d0-40b9-b202-6121812882e9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.085454 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ca70a-49d0-40b9-b202-6121812882e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.090231 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ca70a-49d0-40b9-b202-6121812882e9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.101727 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-f66ca70a-49d0-40b9-b202-6121812882e9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:06.103076 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 248/491] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:06.103655 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ca70a-49d0-40b9-b202-6121812882e9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:06.119241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ca70a-49d0-40b9-b202-6121812882e9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.123548 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1b8e1-0242-4446-aff6-f06d31fe6c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.124319 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1b8e1-0242-4446-aff6-f06d31fe6c12 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.124639 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1b8e1-0242-4446-aff6-f06d31fe6c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.124899 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1b8e1-0242-4446-aff6-f06d31fe6c12 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.135129 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1b8e1-0242-4446-aff6-f06d31fe6c12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.136958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1b8e1-0242-4446-aff6-f06d31fe6c12 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.154984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-c5a1b8e1-0242-4446-aff6-f06d31fe6c12 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:06.157179 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 249/493] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:06.157296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 244/493] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:11:05 2021] PUT /identity/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/48b92ce8a3bd4d1ebfd94249d525addb/roles/0811ae5a177643f9b2b86ec5feb7b163 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:11:06.163100 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1b8e1-0242-4446-aff6-f06d31fe6c12 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:06.164981 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e3d84-2cad-4019-8fde-3e1cd5282e56 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:06.177132 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1b8e1-0242-4446-aff6-f06d31fe6c12 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.249451 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb1f85-3b0d-4407-a273-efa2ee0324e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.252045 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb1f85-3b0d-4407-a273-efa2ee0324e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.252570 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb1f85-3b0d-4407-a273-efa2ee0324e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.253075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb1f85-3b0d-4407-a273-efa2ee0324e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.254126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb1f85-3b0d-4407-a273-efa2ee0324e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:06.254653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb1f85-3b0d-4407-a273-efa2ee0324e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.257504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb1f85-3b0d-4407-a273-efa2ee0324e8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.276511 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 250/494] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:06.285060 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb1f85-3b0d-4407-a273-efa2ee0324e8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:06.288049 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e3d84-2cad-4019-8fde-3e1cd5282e56 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.300590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522941c-206b-4e74-ac99-008e54701eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.301452 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522941c-206b-4e74-ac99-008e54701eee admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.301775 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522941c-206b-4e74-ac99-008e54701eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.302048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522941c-206b-4e74-ac99-008e54701eee admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.302930 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522941c-206b-4e74-ac99-008e54701eee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:06.303235 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522941c-206b-4e74-ac99-008e54701eee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.305181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522941c-206b-4e74-ac99-008e54701eee admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.309570 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb1f85-3b0d-4407-a273-efa2ee0324e8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.322296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590e871-7770-4451-9338-9a29624388a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.323203 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590e871-7770-4451-9338-9a29624388a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.323482 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590e871-7770-4451-9338-9a29624388a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.323775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590e871-7770-4451-9338-9a29624388a6 admin admin] PATH_INFO: `/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/c6be4b7bef21492bad49e6b5a284f4f0/roles/0811ae5a177643f9b2b86ec5feb7b163` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.330874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 245/495] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:06.339287 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522941c-206b-4e74-ac99-008e54701eee admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:06.358565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522941c-206b-4e74-ac99-008e54701eee admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.360887 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590e871-7770-4451-9338-9a29624388a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579ca0c9e3d480ab7b4f64d199c403b, user_id=c6be4b7bef21492bad49e6b5a284f4f0, role_id=0811ae5a177643f9b2b86ec5feb7b163)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.366240 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590e871-7770-4451-9338-9a29624388a6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.370984 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fc9ab-93e9-40c8-8922-8fac53e3c43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.371964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fc9ab-93e9-40c8-8922-8fac53e3c43a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.372247 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fc9ab-93e9-40c8-8922-8fac53e3c43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.373376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fc9ab-93e9-40c8-8922-8fac53e3c43a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.384586 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fc9ab-93e9-40c8-8922-8fac53e3c43a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.388213 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fc9ab-93e9-40c8-8922-8fac53e3c43a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.403219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-d67fc9ab-93e9-40c8-8922-8fac53e3c43a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 01:11:06.404808 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 246/496] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:06 2021] GET /identity/v3/users/swift => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:06.412601 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fc9ab-93e9-40c8-8922-8fac53e3c43a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:06.439652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fc9ab-93e9-40c8-8922-8fac53e3c43a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.439652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a69fff-a7ea-4b5c-a8bb-50e4c50357f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.439652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69fff-a7ea-4b5c-a8bb-50e4c50357f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.439652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69fff-a7ea-4b5c-a8bb-50e4c50357f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.440120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69fff-a7ea-4b5c-a8bb-50e4c50357f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.440120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a69fff-a7ea-4b5c-a8bb-50e4c50357f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:06.440120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a69fff-a7ea-4b5c-a8bb-50e4c50357f6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.440120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a69fff-a7ea-4b5c-a8bb-50e4c50357f6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.454914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 247/497] 10.222.0.87 () {56 vars in 1156 bytes} [Fri Oct 29 01:11:06 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:06.463032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a69fff-a7ea-4b5c-a8bb-50e4c50357f6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:06.473386 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a69fff-a7ea-4b5c-a8bb-50e4c50357f6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.478132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0183a16-2126-4f58-9e14-714a8d848f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.478877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0183a16-2126-4f58-9e14-714a8d848f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.479168 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0183a16-2126-4f58-9e14-714a8d848f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.479485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0183a16-2126-4f58-9e14-714a8d848f79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.489521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0183a16-2126-4f58-9e14-714a8d848f79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.491530 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0183a16-2126-4f58-9e14-714a8d848f79 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.501914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 248/498] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:11:06.509095 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0183a16-2126-4f58-9e14-714a8d848f79 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:06.518083 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 251/499] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:11:06 2021] PUT /identity/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/c6be4b7bef21492bad49e6b5a284f4f0/roles/0811ae5a177643f9b2b86ec5feb7b163 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:11:06.521602 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0183a16-2126-4f58-9e14-714a8d848f79 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.593652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cbe8d-0935-42f3-b3db-d55d153dfb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.594502 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbe8d-0935-42f3-b3db-d55d153dfb5a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.594792 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbe8d-0935-42f3-b3db-d55d153dfb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.595069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbe8d-0935-42f3-b3db-d55d153dfb5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.606343 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cbe8d-0935-42f3-b3db-d55d153dfb5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.608238 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cbe8d-0935-42f3-b3db-d55d153dfb5a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.631321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-5b3cbe8d-0935-42f3-b3db-d55d153dfb5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:06.632686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 249/500] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:06.638921 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590e871-7770-4451-9338-9a29624388a6 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:06.650016 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590e871-7770-4451-9338-9a29624388a6 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.659511 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b0811-e43b-44dc-9bb7-150bba931438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.660266 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b0811-e43b-44dc-9bb7-150bba931438 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.660549 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b0811-e43b-44dc-9bb7-150bba931438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.660822 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b0811-e43b-44dc-9bb7-150bba931438 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.661678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b0811-e43b-44dc-9bb7-150bba931438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:06.661985 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b0811-e43b-44dc-9bb7-150bba931438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.663677 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b0811-e43b-44dc-9bb7-150bba931438 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.682270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 252/501] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:06.688648 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cbe8d-0935-42f3-b3db-d55d153dfb5a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:06.699228 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cbe8d-0935-42f3-b3db-d55d153dfb5a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.707211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e7742-abf3-402b-ae13-bb8c35a70bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.708084 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e7742-abf3-402b-ae13-bb8c35a70bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.708365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e7742-abf3-402b-ae13-bb8c35a70bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.708638 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e7742-abf3-402b-ae13-bb8c35a70bd4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.721386 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e7742-abf3-402b-ae13-bb8c35a70bd4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.723393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e7742-abf3-402b-ae13-bb8c35a70bd4 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.742938 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-aa3e7742-abf3-402b-ae13-bb8c35a70bd4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:06.744239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 250/502] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:06.751129 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b0811-e43b-44dc-9bb7-150bba931438 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:06.761563 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b0811-e43b-44dc-9bb7-150bba931438 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.766585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c751aa4-40ad-48e7-b6c3-b54b0a6e4825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.767311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c751aa4-40ad-48e7-b6c3-b54b0a6e4825 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.767693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c751aa4-40ad-48e7-b6c3-b54b0a6e4825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.767993 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c751aa4-40ad-48e7-b6c3-b54b0a6e4825 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.768909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c751aa4-40ad-48e7-b6c3-b54b0a6e4825 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:06.769218 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c751aa4-40ad-48e7-b6c3-b54b0a6e4825 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.771096 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c751aa4-40ad-48e7-b6c3-b54b0a6e4825 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.785472 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 253/503] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:06.791989 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e7742-abf3-402b-ae13-bb8c35a70bd4 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:06.805606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e7742-abf3-402b-ae13-bb8c35a70bd4 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:06.810304 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50704718-0803-436f-ae86-5bb502fb68cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:06.811016 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50704718-0803-436f-ae86-5bb502fb68cd admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:06.811303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50704718-0803-436f-ae86-5bb502fb68cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:06.811571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50704718-0803-436f-ae86-5bb502fb68cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:06.813224 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50704718-0803-436f-ae86-5bb502fb68cd admin admin] RBAC: Adding query filter params (role.id=0811ae5a177643f9b2b86ec5feb7b163, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=7e9153b864b44f5dbbfd6f33ddb253c0) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:06.813586 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50704718-0803-436f-ae86-5bb502fb68cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:06.815553 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50704718-0803-436f-ae86-5bb502fb68cd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:06.822515 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 251/504] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:06 2021] GET /identity/v3/role_assignments?user.id=7e9153b864b44f5dbbfd6f33ddb253c0&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=0811ae5a177643f9b2b86ec5feb7b163 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:07.533414 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf33212-395d-49b5-8e65-5ab85d71e690 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:07.534115 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf33212-395d-49b5-8e65-5ab85d71e690 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:07.534115 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf33212-395d-49b5-8e65-5ab85d71e690 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:07.536017 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 254/505] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:07.541795 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb955-7cd2-4641-9a05-322c767b0ec5 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:07.542266 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb955-7cd2-4641-9a05-322c767b0ec5 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:07.542429 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb955-7cd2-4641-9a05-322c767b0ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:07.568687 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-9adfb955-7cd2-4641-9a05-322c767b0ec5 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:07.570135 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-9adfb955-7cd2-4641-9a05-322c767b0ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:07.577941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 252/506] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:07.615170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf33212-395d-49b5-8e65-5ab85d71e690 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:07.629239 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf33212-395d-49b5-8e65-5ab85d71e690 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:07.636589 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3572ee-06d2-4ff2-a03f-066a8f5fc0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:07.637373 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3572ee-06d2-4ff2-a03f-066a8f5fc0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:07.637645 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3572ee-06d2-4ff2-a03f-066a8f5fc0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:07.637919 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3572ee-06d2-4ff2-a03f-066a8f5fc0c9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:07.652856 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3572ee-06d2-4ff2-a03f-066a8f5fc0c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:07.660435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-ff3572ee-06d2-4ff2-a03f-066a8f5fc0c9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:07.662002 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 255/507] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:07.668184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfb955-7cd2-4641-9a05-322c767b0ec5 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:07.687547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfb955-7cd2-4641-9a05-322c767b0ec5 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:07.697324 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63f7b4-0e47-49bb-8e9b-9798430fb19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:07.698208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63f7b4-0e47-49bb-8e9b-9798430fb19b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:07.698491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63f7b4-0e47-49bb-8e9b-9798430fb19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:07.698772 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63f7b4-0e47-49bb-8e9b-9798430fb19b admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:07.699550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63f7b4-0e47-49bb-8e9b-9798430fb19b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:07.699884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63f7b4-0e47-49bb-8e9b-9798430fb19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:07.702147 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63f7b4-0e47-49bb-8e9b-9798430fb19b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:07.720828 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 253/508] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:07.727269 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3572ee-06d2-4ff2-a03f-066a8f5fc0c9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:07.743787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3572ee-06d2-4ff2-a03f-066a8f5fc0c9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:07.751182 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc58dd-1fb4-4fd9-aa1b-4f7dbc784a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:07.752093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc58dd-1fb4-4fd9-aa1b-4f7dbc784a40 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:07.752432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc58dd-1fb4-4fd9-aa1b-4f7dbc784a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:07.752712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc58dd-1fb4-4fd9-aa1b-4f7dbc784a40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:07.766595 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc58dd-1fb4-4fd9-aa1b-4f7dbc784a40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:07.768540 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc58dd-1fb4-4fd9-aa1b-4f7dbc784a40 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:07.794526 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-8cdc58dd-1fb4-4fd9-aa1b-4f7dbc784a40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:07.796038 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 256/509] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:07.802830 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63f7b4-0e47-49bb-8e9b-9798430fb19b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:07.818750 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63f7b4-0e47-49bb-8e9b-9798430fb19b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:07.833917 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fed63-bc1f-428c-a3b0-ba372260989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:07.834591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fed63-bc1f-428c-a3b0-ba372260989e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:07.834875 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fed63-bc1f-428c-a3b0-ba372260989e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:07.835148 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fed63-bc1f-428c-a3b0-ba372260989e admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:07.835917 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fed63-bc1f-428c-a3b0-ba372260989e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:07.836222 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fed63-bc1f-428c-a3b0-ba372260989e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:07.837817 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fed63-bc1f-428c-a3b0-ba372260989e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:07.850727 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 254/510] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:07.856792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc58dd-1fb4-4fd9-aa1b-4f7dbc784a40 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:07.875910 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc58dd-1fb4-4fd9-aa1b-4f7dbc784a40 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:07.883416 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416d5f6-5463-435b-838a-e9974e780ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:07.884519 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416d5f6-5463-435b-838a-e9974e780ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:07.885098 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416d5f6-5463-435b-838a-e9974e780ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:07.885577 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416d5f6-5463-435b-838a-e9974e780ae7 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:07.900905 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416d5f6-5463-435b-838a-e9974e780ae7 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:07.903269 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416d5f6-5463-435b-838a-e9974e780ae7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:07.923334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-0416d5f6-5463-435b-838a-e9974e780ae7 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 29 01:11:07.929303 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 257/511] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:07 2021] GET /identity/v3/users/glance => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:07.935252 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fed63-bc1f-428c-a3b0-ba372260989e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:07.949517 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fed63-bc1f-428c-a3b0-ba372260989e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:07.957823 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef9dfd-d609-4780-b815-0f7ff66cf1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:07.958550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef9dfd-d609-4780-b815-0f7ff66cf1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:07.958830 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef9dfd-d609-4780-b815-0f7ff66cf1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:07.959105 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef9dfd-d609-4780-b815-0f7ff66cf1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:07.960090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef9dfd-d609-4780-b815-0f7ff66cf1d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:07.960451 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef9dfd-d609-4780-b815-0f7ff66cf1d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:07.962463 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef9dfd-d609-4780-b815-0f7ff66cf1d3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:07.987211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 255/512] 10.222.0.87 () {56 vars in 1158 bytes} [Fri Oct 29 01:11:07 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:07.993396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416d5f6-5463-435b-838a-e9974e780ae7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:08.009122 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416d5f6-5463-435b-838a-e9974e780ae7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:08.014560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1f1e7-7480-4cc5-8421-5becc6effc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:08.015313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1f1e7-7480-4cc5-8421-5becc6effc27 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:08.015644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1f1e7-7480-4cc5-8421-5becc6effc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:08.015993 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1f1e7-7480-4cc5-8421-5becc6effc27 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:08.026727 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1f1e7-7480-4cc5-8421-5becc6effc27 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:08.028489 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1f1e7-7480-4cc5-8421-5becc6effc27 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:08.041163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 258/513] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:08.048436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef9dfd-d609-4780-b815-0f7ff66cf1d3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:08.062989 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef9dfd-d609-4780-b815-0f7ff66cf1d3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:08.072179 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d025f-832d-490f-b605-458c422e1e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:08.072982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d025f-832d-490f-b605-458c422e1e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:08.073265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d025f-832d-490f-b605-458c422e1e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:08.073540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d025f-832d-490f-b605-458c422e1e24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:08.088817 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d025f-832d-490f-b605-458c422e1e24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:08.090665 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d025f-832d-490f-b605-458c422e1e24 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:08.118019 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-af5d025f-832d-490f-b605-458c422e1e24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:08.119553 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 256/514] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:08.125562 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1f1e7-7480-4cc5-8421-5becc6effc27 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:08.143130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1f1e7-7480-4cc5-8421-5becc6effc27 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:08.154436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa4b7c-91d1-41d6-ac8f-466ab4223d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:08.155106 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa4b7c-91d1-41d6-ac8f-466ab4223d2a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:08.155383 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa4b7c-91d1-41d6-ac8f-466ab4223d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:08.156356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa4b7c-91d1-41d6-ac8f-466ab4223d2a admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:08.157159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa4b7c-91d1-41d6-ac8f-466ab4223d2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:08.157461 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa4b7c-91d1-41d6-ac8f-466ab4223d2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:08.159200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa4b7c-91d1-41d6-ac8f-466ab4223d2a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:08.182927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 259/515] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:08.189569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d025f-832d-490f-b605-458c422e1e24 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:08.205529 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d025f-832d-490f-b605-458c422e1e24 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:08.215958 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df20ecc-7c99-4bfa-b63a-5e827c08177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:08.216756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df20ecc-7c99-4bfa-b63a-5e827c08177a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:08.217034 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df20ecc-7c99-4bfa-b63a-5e827c08177a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:08.217303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df20ecc-7c99-4bfa-b63a-5e827c08177a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:08.231915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df20ecc-7c99-4bfa-b63a-5e827c08177a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:08.234812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df20ecc-7c99-4bfa-b63a-5e827c08177a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:08.259029 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-6df20ecc-7c99-4bfa-b63a-5e827c08177a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:08.260603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 257/516] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:08.267588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa4b7c-91d1-41d6-ac8f-466ab4223d2a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:08.284970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa4b7c-91d1-41d6-ac8f-466ab4223d2a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:08.294902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89670f-e93c-4a84-ad5c-2687ea67e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:08.295558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89670f-e93c-4a84-ad5c-2687ea67e5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:08.295915 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89670f-e93c-4a84-ad5c-2687ea67e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:08.296745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89670f-e93c-4a84-ad5c-2687ea67e5f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:08.297556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89670f-e93c-4a84-ad5c-2687ea67e5f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:08.297861 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89670f-e93c-4a84-ad5c-2687ea67e5f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:08.299877 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89670f-e93c-4a84-ad5c-2687ea67e5f8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:08.325369 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 260/517] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:08.332070 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df20ecc-7c99-4bfa-b63a-5e827c08177a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:08.349033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df20ecc-7c99-4bfa-b63a-5e827c08177a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:08.356432 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188a9a8-e9f6-400a-b9cf-501a287010bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:08.357063 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188a9a8-e9f6-400a-b9cf-501a287010bf admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:08.357345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188a9a8-e9f6-400a-b9cf-501a287010bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:08.357618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188a9a8-e9f6-400a-b9cf-501a287010bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:08.358460 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188a9a8-e9f6-400a-b9cf-501a287010bf admin admin] RBAC: Adding query filter params (role.id=0811ae5a177643f9b2b86ec5feb7b163, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=0998dd32ba8648cfb7f43797a9266d81) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:08.358892 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188a9a8-e9f6-400a-b9cf-501a287010bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:08.361703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188a9a8-e9f6-400a-b9cf-501a287010bf admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:08.372695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 258/518] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:08 2021] GET /identity/v3/role_assignments?user.id=0998dd32ba8648cfb7f43797a9266d81&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=0811ae5a177643f9b2b86ec5feb7b163 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:08.748881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a82dd-6f94-4399-8471-f2800b6b9868 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:08.750157 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a82dd-6f94-4399-8471-f2800b6b9868 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:08.750157 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a82dd-6f94-4399-8471-f2800b6b9868 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:08.752075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 261/519] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:08.758369 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22455454-78e7-4ddb-ab7c-19ca4caa7ba1 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:08.758924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22455454-78e7-4ddb-ab7c-19ca4caa7ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:08.758924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22455454-78e7-4ddb-ab7c-19ca4caa7ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:08.782334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-22455454-78e7-4ddb-ab7c-19ca4caa7ba1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:08.783535 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-22455454-78e7-4ddb-ab7c-19ca4caa7ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:08.792804 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 259/520] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:08.818400 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a82dd-6f94-4399-8471-f2800b6b9868 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:08.832868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a82dd-6f94-4399-8471-f2800b6b9868 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:08.839467 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fdf22-6876-42e5-a489-5740cf832bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:08.840278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fdf22-6876-42e5-a489-5740cf832bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:08.840558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fdf22-6876-42e5-a489-5740cf832bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:08.840832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fdf22-6876-42e5-a489-5740cf832bc9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:08.855622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64fdf22-6876-42e5-a489-5740cf832bc9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:08.863388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-a64fdf22-6876-42e5-a489-5740cf832bc9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:08.864714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 262/521] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:08.882917 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22455454-78e7-4ddb-ab7c-19ca4caa7ba1 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:08.893121 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22455454-78e7-4ddb-ab7c-19ca4caa7ba1 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:08.897743 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b263c-1cdf-473a-b980-2036f3d8c5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:08.898409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b263c-1cdf-473a-b980-2036f3d8c5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:08.898765 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b263c-1cdf-473a-b980-2036f3d8c5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:08.899036 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b263c-1cdf-473a-b980-2036f3d8c5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:08.899828 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b263c-1cdf-473a-b980-2036f3d8c5e9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:08.900170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b263c-1cdf-473a-b980-2036f3d8c5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:08.901773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b263c-1cdf-473a-b980-2036f3d8c5e9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:08.911907 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 260/522] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:08.918134 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fdf22-6876-42e5-a489-5740cf832bc9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:08.929137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fdf22-6876-42e5-a489-5740cf832bc9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:08.933661 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7450421-5f22-4e1d-ac12-9c9778b8e180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:08.934432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7450421-5f22-4e1d-ac12-9c9778b8e180 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:08.934710 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7450421-5f22-4e1d-ac12-9c9778b8e180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:08.934979 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7450421-5f22-4e1d-ac12-9c9778b8e180 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:08.946324 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7450421-5f22-4e1d-ac12-9c9778b8e180 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:08.948174 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7450421-5f22-4e1d-ac12-9c9778b8e180 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:08.965548 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-f7450421-5f22-4e1d-ac12-9c9778b8e180 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:08.967164 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 263/523] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:08.973591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b263c-1cdf-473a-b980-2036f3d8c5e9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:08.984660 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b263c-1cdf-473a-b980-2036f3d8c5e9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:08.989687 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5af39c-4f96-4e02-9af6-2d41a433f90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:08.990367 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5af39c-4f96-4e02-9af6-2d41a433f90e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:08.990647 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5af39c-4f96-4e02-9af6-2d41a433f90e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:08.990965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5af39c-4f96-4e02-9af6-2d41a433f90e admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:08.991746 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5af39c-4f96-4e02-9af6-2d41a433f90e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:08.992147 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5af39c-4f96-4e02-9af6-2d41a433f90e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:08.993844 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5af39c-4f96-4e02-9af6-2d41a433f90e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.008108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 261/524] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:09.014040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7450421-5f22-4e1d-ac12-9c9778b8e180 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.025029 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7450421-5f22-4e1d-ac12-9c9778b8e180 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.030490 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79335d5-dc5b-4cc8-a875-8d50a991cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.031712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79335d5-dc5b-4cc8-a875-8d50a991cc47 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.032018 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79335d5-dc5b-4cc8-a875-8d50a991cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.032291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79335d5-dc5b-4cc8-a875-8d50a991cc47 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.040348 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79335d5-dc5b-4cc8-a875-8d50a991cc47 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.042481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79335d5-dc5b-4cc8-a875-8d50a991cc47 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.058362 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-c79335d5-dc5b-4cc8-a875-8d50a991cc47 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 01:11:09.059951 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 264/525] 10.222.0.87 () {56 vars in 1114 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:09.066732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5af39c-4f96-4e02-9af6-2d41a433f90e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.079053 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5af39c-4f96-4e02-9af6-2d41a433f90e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.083868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667ed86-430a-4af2-972d-c810e116cfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.084544 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667ed86-430a-4af2-972d-c810e116cfbb admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.084882 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667ed86-430a-4af2-972d-c810e116cfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.085157 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667ed86-430a-4af2-972d-c810e116cfbb admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.086067 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667ed86-430a-4af2-972d-c810e116cfbb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:09.086380 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667ed86-430a-4af2-972d-c810e116cfbb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.088368 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667ed86-430a-4af2-972d-c810e116cfbb admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.109465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 262/526] 10.222.0.87 () {56 vars in 1154 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:09.115599 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79335d5-dc5b-4cc8-a875-8d50a991cc47 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.126331 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79335d5-dc5b-4cc8-a875-8d50a991cc47 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.131183 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39e075-3e75-403a-a762-d13aa6cdb5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.131908 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39e075-3e75-403a-a762-d13aa6cdb5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.132188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39e075-3e75-403a-a762-d13aa6cdb5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.132460 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39e075-3e75-403a-a762-d13aa6cdb5b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.135453 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadccbbb-9b29-41ce-b76f-cee2384983da None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.135817 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadccbbb-9b29-41ce-b76f-cee2384983da None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.136090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadccbbb-9b29-41ce-b76f-cee2384983da None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.138287 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 263/527] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:11:09.145940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd974c-8cb2-409a-89cc-702e0d565bfc None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.146344 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd974c-8cb2-409a-89cc-702e0d565bfc None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.146986 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd974c-8cb2-409a-89cc-702e0d565bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.147497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39e075-3e75-403a-a762-d13aa6cdb5b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.149312 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39e075-3e75-403a-a762-d13aa6cdb5b2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.161635 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 265/528] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:09.170469 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39e075-3e75-403a-a762-d13aa6cdb5b2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.172959 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-65fd974c-8cb2-409a-89cc-702e0d565bfc None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:09.174449 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-65fd974c-8cb2-409a-89cc-702e0d565bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:09.180389 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39e075-3e75-403a-a762-d13aa6cdb5b2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.184819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 264/529] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:09.194595 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be493dd2-8a14-4fc7-b328-7941bd4e8858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.195467 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be493dd2-8a14-4fc7-b328-7941bd4e8858 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.195889 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be493dd2-8a14-4fc7-b328-7941bd4e8858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.196229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be493dd2-8a14-4fc7-b328-7941bd4e8858 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.207431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be493dd2-8a14-4fc7-b328-7941bd4e8858 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.209361 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be493dd2-8a14-4fc7-b328-7941bd4e8858 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.216911 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd974c-8cb2-409a-89cc-702e0d565bfc None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.227120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd974c-8cb2-409a-89cc-702e0d565bfc None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.232018 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b93ba-6643-495c-87b1-5059fe4ad583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.233082 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b93ba-6643-495c-87b1-5059fe4ad583 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.233516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b93ba-6643-495c-87b1-5059fe4ad583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.234059 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b93ba-6643-495c-87b1-5059fe4ad583 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.241510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-be493dd2-8a14-4fc7-b328-7941bd4e8858 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:09.242903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 266/530] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:09.251464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b93ba-6643-495c-87b1-5059fe4ad583 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:09.251678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be493dd2-8a14-4fc7-b328-7941bd4e8858 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.259654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-930b93ba-6643-495c-87b1-5059fe4ad583 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:09.261556 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 265/531] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:09.266835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be493dd2-8a14-4fc7-b328-7941bd4e8858 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.269589 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b93ba-6643-495c-87b1-5059fe4ad583 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.286912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b93ba-6643-495c-87b1-5059fe4ad583 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.288633 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddcdb0-70db-414c-b8b5-054b748001bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.289335 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddcdb0-70db-414c-b8b5-054b748001bb admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.289581 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddcdb0-70db-414c-b8b5-054b748001bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.289867 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddcdb0-70db-414c-b8b5-054b748001bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.290595 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feddcdb0-70db-414c-b8b5-054b748001bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:09.290903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feddcdb0-70db-414c-b8b5-054b748001bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.292516 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feddcdb0-70db-414c-b8b5-054b748001bb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.293344 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289c885-4569-4f30-99c3-fd27faea4fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.294206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289c885-4569-4f30-99c3-fd27faea4fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.294692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289c885-4569-4f30-99c3-fd27faea4fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.295114 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289c885-4569-4f30-99c3-fd27faea4fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.296140 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289c885-4569-4f30-99c3-fd27faea4fdb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:09.296641 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289c885-4569-4f30-99c3-fd27faea4fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.298522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289c885-4569-4f30-99c3-fd27faea4fdb admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.308960 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 266/532] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:09.316933 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289c885-4569-4f30-99c3-fd27faea4fdb admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.322288 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 267/533] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:09.331909 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289c885-4569-4f30-99c3-fd27faea4fdb admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.335857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddcdb0-70db-414c-b8b5-054b748001bb admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.338894 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338d450-b553-443f-8dea-f7fd964f562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.340021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338d450-b553-443f-8dea-f7fd964f562d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.340450 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338d450-b553-443f-8dea-f7fd964f562d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.340860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338d450-b553-443f-8dea-f7fd964f562d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.353735 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddcdb0-70db-414c-b8b5-054b748001bb admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.354074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338d450-b553-443f-8dea-f7fd964f562d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.356469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338d450-b553-443f-8dea-f7fd964f562d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.376603 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac8fe5-1f0f-4275-a7d8-b32c28f1ecdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.377419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac8fe5-1f0f-4275-a7d8-b32c28f1ecdf admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.377683 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac8fe5-1f0f-4275-a7d8-b32c28f1ecdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.377952 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac8fe5-1f0f-4275-a7d8-b32c28f1ecdf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.379421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-0338d450-b553-443f-8dea-f7fd964f562d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:09.381594 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 267/534] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:09.388468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338d450-b553-443f-8dea-f7fd964f562d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.399948 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338d450-b553-443f-8dea-f7fd964f562d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.401097 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac8fe5-1f0f-4275-a7d8-b32c28f1ecdf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.403184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac8fe5-1f0f-4275-a7d8-b32c28f1ecdf admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.405547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b66f3-d8a2-49f0-8459-1973a4d87b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.406402 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b66f3-d8a2-49f0-8459-1973a4d87b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.406923 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b66f3-d8a2-49f0-8459-1973a4d87b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.407339 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b66f3-d8a2-49f0-8459-1973a4d87b23 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.408392 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b66f3-d8a2-49f0-8459-1973a4d87b23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:09.408838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b66f3-d8a2-49f0-8459-1973a4d87b23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.410918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b66f3-d8a2-49f0-8459-1973a4d87b23 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.424532 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 268/535] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:09.430835 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85187f-9d4b-4a8f-b59f-9e501cfe629b None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.431389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85187f-9d4b-4a8f-b59f-9e501cfe629b None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.431839 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85187f-9d4b-4a8f-b59f-9e501cfe629b None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.433657 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-d8ac8fe5-1f0f-4275-a7d8-b32c28f1ecdf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:09.433837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 269/536] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:09 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:09.434675 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85187f-9d4b-4a8f-b59f-9e501cfe629b None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.435254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 268/537] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:09.441694 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b50cf-4b4c-4262-92e9-1f41ad9fe17c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.441983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b50cf-4b4c-4262-92e9-1f41ad9fe17c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.442261 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b50cf-4b4c-4262-92e9-1f41ad9fe17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.456215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85187f-9d4b-4a8f-b59f-9e501cfe629b None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.462171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cf587-ecde-45d5-ad44-8fda68ae0312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.463208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cf587-ecde-45d5-ad44-8fda68ae0312 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.463827 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cf587-ecde-45d5-ad44-8fda68ae0312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.464268 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cf587-ecde-45d5-ad44-8fda68ae0312 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.464912 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-123b50cf-4b4c-4262-92e9-1f41ad9fe17c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:09.466376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-123b50cf-4b4c-4262-92e9-1f41ad9fe17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:09.475466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cf587-ecde-45d5-ad44-8fda68ae0312 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.477837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cf587-ecde-45d5-ad44-8fda68ae0312 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.479805 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 269/538] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:09.481076 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b50cf-4b4c-4262-92e9-1f41ad9fe17c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.501165 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b50cf-4b4c-4262-92e9-1f41ad9fe17c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.505439 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-df1cf587-ecde-45d5-ad44-8fda68ae0312 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 29 01:11:09.506968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 270/539] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/users/neutron => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:09.507768 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe08398-21dd-423b-9ce7-08fe33a2f8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.507963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cf587-ecde-45d5-ad44-8fda68ae0312 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.508885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe08398-21dd-423b-9ce7-08fe33a2f8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.509325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe08398-21dd-423b-9ce7-08fe33a2f8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.509541 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe08398-21dd-423b-9ce7-08fe33a2f8c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.510405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe08398-21dd-423b-9ce7-08fe33a2f8c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:09.510663 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe08398-21dd-423b-9ce7-08fe33a2f8c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.512679 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe08398-21dd-423b-9ce7-08fe33a2f8c1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.519575 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cf587-ecde-45d5-ad44-8fda68ae0312 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.524278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8b61e-37ea-4b15-af77-3d5d5983d979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.525098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8b61e-37ea-4b15-af77-3d5d5983d979 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.525377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8b61e-37ea-4b15-af77-3d5d5983d979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.530898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 270/540] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:09.531043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8b61e-37ea-4b15-af77-3d5d5983d979 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.531138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff162d-9e95-4072-9e73-3debc8c1c6dd None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.531138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff162d-9e95-4072-9e73-3debc8c1c6dd None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.531138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff162d-9e95-4072-9e73-3debc8c1c6dd None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.531138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 271/541] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:09.534600 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff162d-9e95-4072-9e73-3debc8c1c6dd None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.542095 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8b61e-37ea-4b15-af77-3d5d5983d979 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:09.548699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff162d-9e95-4072-9e73-3debc8c1c6dd None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.549521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-bae8b61e-37ea-4b15-af77-3d5d5983d979 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:09.550841 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 271/542] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:09.555814 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8b61e-37ea-4b15-af77-3d5d5983d979 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.557902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc92eb-6082-4812-849b-a64398ce5a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.558653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc92eb-6082-4812-849b-a64398ce5a7f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.559017 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc92eb-6082-4812-849b-a64398ce5a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.559358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc92eb-6082-4812-849b-a64398ce5a7f admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.560315 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc92eb-6082-4812-849b-a64398ce5a7f admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:09.560695 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc92eb-6082-4812-849b-a64398ce5a7f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.563509 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc92eb-6082-4812-849b-a64398ce5a7f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.567505 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8b61e-37ea-4b15-af77-3d5d5983d979 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.572273 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a18b3b-4754-43af-a1dd-f8cab4ed68c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.573013 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18b3b-4754-43af-a1dd-f8cab4ed68c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.573302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18b3b-4754-43af-a1dd-f8cab4ed68c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.573573 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18b3b-4754-43af-a1dd-f8cab4ed68c0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.574398 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a18b3b-4754-43af-a1dd-f8cab4ed68c0 admin admin] RBAC: Adding query filter params (role.id=0811ae5a177643f9b2b86ec5feb7b163, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=28d331f2997547968c51fec87598420f) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:09.574708 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a18b3b-4754-43af-a1dd-f8cab4ed68c0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.576531 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a18b3b-4754-43af-a1dd-f8cab4ed68c0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.582245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 272/543] 10.222.0.87 () {56 vars in 1160 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:09.592037 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 272/544] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/role_assignments?user.id=28d331f2997547968c51fec87598420f&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=0811ae5a177643f9b2b86ec5feb7b163 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:09.592037 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a18b3b-4754-43af-a1dd-f8cab4ed68c0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.592310 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b3e60-e15d-4d14-bf4a-a7d19e837fb3 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.592310 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b3e60-e15d-4d14-bf4a-a7d19e837fb3 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.592310 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b3e60-e15d-4d14-bf4a-a7d19e837fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.602020 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a18b3b-4754-43af-a1dd-f8cab4ed68c0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.606876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266b35e-8322-4d96-b858-021faf77b8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.607705 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266b35e-8322-4d96-b858-021faf77b8fe admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.608133 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266b35e-8322-4d96-b858-021faf77b8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.608506 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266b35e-8322-4d96-b858-021faf77b8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.609900 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266b35e-8322-4d96-b858-021faf77b8fe admin admin] RBAC: Adding query filter params (name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:09.610194 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-a49b3e60-e15d-4d14-bf4a-a7d19e837fb3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:09.610365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266b35e-8322-4d96-b858-021faf77b8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.611402 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a49b3e60-e15d-4d14-bf4a-a7d19e837fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:09.612231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266b35e-8322-4d96-b858-021faf77b8fe admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.621174 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 273/545] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:09.621845 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b3e60-e15d-4d14-bf4a-a7d19e837fb3 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.631769 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 273/546] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:09.636791 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266b35e-8322-4d96-b858-021faf77b8fe admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.638221 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b3e60-e15d-4d14-bf4a-a7d19e837fb3 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.649241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd287e2-0fcc-486f-8312-6921e0d3421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.649970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd287e2-0fcc-486f-8312-6921e0d3421a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.650287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd287e2-0fcc-486f-8312-6921e0d3421a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.650605 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd287e2-0fcc-486f-8312-6921e0d3421a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.659172 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266b35e-8322-4d96-b858-021faf77b8fe admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.661981 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd287e2-0fcc-486f-8312-6921e0d3421a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.664378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd287e2-0fcc-486f-8312-6921e0d3421a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.664717 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ffb74-6873-42b2-8631-ded850f8aba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.665739 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ffb74-6873-42b2-8631-ded850f8aba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.666156 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ffb74-6873-42b2-8631-ded850f8aba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.666547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ffb74-6873-42b2-8631-ded850f8aba2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.678045 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 274/547] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:09.679218 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd287e2-0fcc-486f-8312-6921e0d3421a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.684949 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ffb74-6873-42b2-8631-ded850f8aba2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.687798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ffb74-6873-42b2-8631-ded850f8aba2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.692275 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd287e2-0fcc-486f-8312-6921e0d3421a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.697789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075b055-92f9-44f9-93a9-fb7eec0ca46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.699413 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075b055-92f9-44f9-93a9-fb7eec0ca46f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.699876 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075b055-92f9-44f9-93a9-fb7eec0ca46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.700286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075b055-92f9-44f9-93a9-fb7eec0ca46f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.709536 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-754ffb74-6873-42b2-8631-ded850f8aba2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:09.711138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 274/548] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:09.715838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ffb74-6873-42b2-8631-ded850f8aba2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.718174 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075b055-92f9-44f9-93a9-fb7eec0ca46f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:09.726399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-f075b055-92f9-44f9-93a9-fb7eec0ca46f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:09.727259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ffb74-6873-42b2-8631-ded850f8aba2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.733399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 275/549] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:09.733399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075b055-92f9-44f9-93a9-fb7eec0ca46f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.740392 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2e262-2955-49bd-b064-ec48fa8247b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.740621 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075b055-92f9-44f9-93a9-fb7eec0ca46f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.741735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2e262-2955-49bd-b064-ec48fa8247b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.742265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2e262-2955-49bd-b064-ec48fa8247b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.742985 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2e262-2955-49bd-b064-ec48fa8247b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.745325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f78dba-bede-4709-aa59-65a28bdc80fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.746242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f78dba-bede-4709-aa59-65a28bdc80fb admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.746522 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f78dba-bede-4709-aa59-65a28bdc80fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.746794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f78dba-bede-4709-aa59-65a28bdc80fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.747972 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f78dba-bede-4709-aa59-65a28bdc80fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:09.748286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f78dba-bede-4709-aa59-65a28bdc80fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.750088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f78dba-bede-4709-aa59-65a28bdc80fb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.758370 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2e262-2955-49bd-b064-ec48fa8247b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.761069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2e262-2955-49bd-b064-ec48fa8247b1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.764186 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 276/550] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:09.767977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f78dba-bede-4709-aa59-65a28bdc80fb admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.786401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-fff2e262-2955-49bd-b064-ec48fa8247b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:09.787126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f78dba-bede-4709-aa59-65a28bdc80fb admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.788284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 275/551] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:09.794182 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2e262-2955-49bd-b064-ec48fa8247b1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.801954 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7851c83-e1e7-4fd8-9efb-078ff58e5c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.803032 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7851c83-e1e7-4fd8-9efb-078ff58e5c10 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.803678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7851c83-e1e7-4fd8-9efb-078ff58e5c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.805488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7851c83-e1e7-4fd8-9efb-078ff58e5c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.805675 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2e262-2955-49bd-b064-ec48fa8247b1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.806843 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7851c83-e1e7-4fd8-9efb-078ff58e5c10 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:09.807471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7851c83-e1e7-4fd8-9efb-078ff58e5c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.809912 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7851c83-e1e7-4fd8-9efb-078ff58e5c10 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.810346 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d982d-e558-49da-91cb-885245a4add1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.811141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d982d-e558-49da-91cb-885245a4add1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.811417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d982d-e558-49da-91cb-885245a4add1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.812109 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d982d-e558-49da-91cb-885245a4add1 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.821129 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 277/552] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:09.821479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d982d-e558-49da-91cb-885245a4add1 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.822456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7851c83-e1e7-4fd8-9efb-078ff58e5c10 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.823616 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d982d-e558-49da-91cb-885245a4add1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.833624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7851c83-e1e7-4fd8-9efb-078ff58e5c10 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.838278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4252d7e-d856-482a-b138-e55c5c9c41ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.839050 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4252d7e-d856-482a-b138-e55c5c9c41ca admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.839429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4252d7e-d856-482a-b138-e55c5c9c41ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.839838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4252d7e-d856-482a-b138-e55c5c9c41ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.840736 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4252d7e-d856-482a-b138-e55c5c9c41ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:09.841143 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4252d7e-d856-482a-b138-e55c5c9c41ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.841524 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-d42d982d-e558-49da-91cb-885245a4add1 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 01:11:09.842949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4252d7e-d856-482a-b138-e55c5c9c41ca admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.847676 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 276/553] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/users/cinder => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:09.848984 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d982d-e558-49da-91cb-885245a4add1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.857798 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 278/554] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:09.859455 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4252d7e-d856-482a-b138-e55c5c9c41ca admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.866491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d982d-e558-49da-91cb-885245a4add1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.872236 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba364f3c-a5f3-40e0-a676-116166c3b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.873225 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba364f3c-a5f3-40e0-a676-116166c3b8aa admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.873509 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba364f3c-a5f3-40e0-a676-116166c3b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.873782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba364f3c-a5f3-40e0-a676-116166c3b8aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.880494 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4252d7e-d856-482a-b138-e55c5c9c41ca admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.885749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1b7f8-4224-4ef9-8f30-3c2271da81e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.886802 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1b7f8-4224-4ef9-8f30-3c2271da81e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.886802 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1b7f8-4224-4ef9-8f30-3c2271da81e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.887220 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1b7f8-4224-4ef9-8f30-3c2271da81e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.888243 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1b7f8-4224-4ef9-8f30-3c2271da81e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:09.889200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1b7f8-4224-4ef9-8f30-3c2271da81e0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.889374 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba364f3c-a5f3-40e0-a676-116166c3b8aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.891055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1b7f8-4224-4ef9-8f30-3c2271da81e0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.891266 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba364f3c-a5f3-40e0-a676-116166c3b8aa admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.912611 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-ba364f3c-a5f3-40e0-a676-116166c3b8aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:09.913675 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 279/555] 10.222.0.87 () {56 vars in 1158 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:09.915332 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1b7f8-4224-4ef9-8f30-3c2271da81e0 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.916403 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 277/556] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:09.920495 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba364f3c-a5f3-40e0-a676-116166c3b8aa admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.933966 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1b7f8-4224-4ef9-8f30-3c2271da81e0 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.936627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba364f3c-a5f3-40e0-a676-116166c3b8aa admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.941691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a3888-f74c-478c-9bef-9199a60ab268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.942486 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac705d35-aa22-4c06-a9b0-c5f2676f0abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.942605 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a3888-f74c-478c-9bef-9199a60ab268 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.942839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a3888-f74c-478c-9bef-9199a60ab268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.943105 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a3888-f74c-478c-9bef-9199a60ab268 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.943198 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac705d35-aa22-4c06-a9b0-c5f2676f0abb admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.943443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac705d35-aa22-4c06-a9b0-c5f2676f0abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.944057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac705d35-aa22-4c06-a9b0-c5f2676f0abb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.951107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a3888-f74c-478c-9bef-9199a60ab268 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.952621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac705d35-aa22-4c06-a9b0-c5f2676f0abb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.953492 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a3888-f74c-478c-9bef-9199a60ab268 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.954399 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac705d35-aa22-4c06-a9b0-c5f2676f0abb admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.964664 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 278/557] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:09.965549 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac705d35-aa22-4c06-a9b0-c5f2676f0abb admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.973846 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-5a3a3888-f74c-478c-9bef-9199a60ab268 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:09.974970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac705d35-aa22-4c06-a9b0-c5f2676f0abb admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.975714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 280/558] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:09.976877 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a3888-f74c-478c-9bef-9199a60ab268 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:09.979883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b6c21-5c14-48a0-ac93-42ef5bbeb038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.980725 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6c21-5c14-48a0-ac93-42ef5bbeb038 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.981150 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6c21-5c14-48a0-ac93-42ef5bbeb038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.981577 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6c21-5c14-48a0-ac93-42ef5bbeb038 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.982573 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b6c21-5c14-48a0-ac93-42ef5bbeb038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:09.983023 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b6c21-5c14-48a0-ac93-42ef5bbeb038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:09.984837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b6c21-5c14-48a0-ac93-42ef5bbeb038 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:09.989020 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a3888-f74c-478c-9bef-9199a60ab268 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:09.994574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9064d-62d3-4590-ba61-257a360f53a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:09.995639 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9064d-62d3-4590-ba61-257a360f53a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:09.995945 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9064d-62d3-4590-ba61-257a360f53a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:09.996219 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9064d-62d3-4590-ba61-257a360f53a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:09.998082 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 279/559] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:09.999138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b6c21-5c14-48a0-ac93-42ef5bbeb038 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:10.008799 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9064d-62d3-4590-ba61-257a360f53a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:10.009608 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b6c21-5c14-48a0-ac93-42ef5bbeb038 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:10.010738 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9064d-62d3-4590-ba61-257a360f53a5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:10.015396 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cb118-35e2-45db-a93d-da0344fd33fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:10.016301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cb118-35e2-45db-a93d-da0344fd33fb admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:10.016780 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cb118-35e2-45db-a93d-da0344fd33fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:10.017198 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cb118-35e2-45db-a93d-da0344fd33fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:10.018695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cb118-35e2-45db-a93d-da0344fd33fb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:10.019153 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cb118-35e2-45db-a93d-da0344fd33fb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:10.021939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cb118-35e2-45db-a93d-da0344fd33fb admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:10.029272 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-d6a9064d-62d3-4590-ba61-257a360f53a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:10.031534 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 281/560] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:10.032440 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9064d-62d3-4590-ba61-257a360f53a5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:10.036293 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 280/561] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:10.044725 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cb118-35e2-45db-a93d-da0344fd33fb admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:10.046908 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9064d-62d3-4590-ba61-257a360f53a5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:10.052722 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b171e-f392-40a5-80c3-306f86501943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:10.053643 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b171e-f392-40a5-80c3-306f86501943 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:10.054239 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b171e-f392-40a5-80c3-306f86501943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:10.054520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b171e-f392-40a5-80c3-306f86501943 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:10.056384 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cb118-35e2-45db-a93d-da0344fd33fb admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:10.061518 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8ecd3-992a-4793-8cb8-5836c1366347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:10.062578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8ecd3-992a-4793-8cb8-5836c1366347 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:10.063030 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8ecd3-992a-4793-8cb8-5836c1366347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:10.063144 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b171e-f392-40a5-80c3-306f86501943 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:10.063467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8ecd3-992a-4793-8cb8-5836c1366347 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:10.064454 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8ecd3-992a-4793-8cb8-5836c1366347 admin admin] RBAC: Adding query filter params (role.id=0811ae5a177643f9b2b86ec5feb7b163, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=48b92ce8a3bd4d1ebfd94249d525addb) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:10.064863 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8ecd3-992a-4793-8cb8-5836c1366347 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:10.065292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b171e-f392-40a5-80c3-306f86501943 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:10.067069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8ecd3-992a-4793-8cb8-5836c1366347 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:10.074668 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 281/562] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:10 2021] GET /identity/v3/role_assignments?user.id=48b92ce8a3bd4d1ebfd94249d525addb&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=0811ae5a177643f9b2b86ec5feb7b163 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:10.080775 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8ecd3-992a-4793-8cb8-5836c1366347 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:10.081972 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-7d9b171e-f392-40a5-80c3-306f86501943 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 01:11:10.083511 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 282/563] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:10 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:10.094000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b171e-f392-40a5-80c3-306f86501943 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:10.105904 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b171e-f392-40a5-80c3-306f86501943 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:10.106108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8ecd3-992a-4793-8cb8-5836c1366347 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:10.121841 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c4b08-1889-4f4a-aa6b-03c81174c929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:10.122521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4b08-1889-4f4a-aa6b-03c81174c929 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:10.123505 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a83f8-49cb-4bbd-9748-13da92214ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:10.124285 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4b08-1889-4f4a-aa6b-03c81174c929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:10.124775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4b08-1889-4f4a-aa6b-03c81174c929 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:10.125737 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a83f8-49cb-4bbd-9748-13da92214ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:10.126021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a83f8-49cb-4bbd-9748-13da92214ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:10.126288 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a83f8-49cb-4bbd-9748-13da92214ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:10.127165 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c4b08-1889-4f4a-aa6b-03c81174c929 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:10.127471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c4b08-1889-4f4a-aa6b-03c81174c929 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:10.128612 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a83f8-49cb-4bbd-9748-13da92214ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:10.128969 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a83f8-49cb-4bbd-9748-13da92214ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:10.130634 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a83f8-49cb-4bbd-9748-13da92214ea2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:10.131807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c4b08-1889-4f4a-aa6b-03c81174c929 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:10.158775 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 282/564] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:10.167541 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a83f8-49cb-4bbd-9748-13da92214ea2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:10.174053 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 283/565] 10.222.0.87 () {56 vars in 1156 bytes} [Fri Oct 29 01:11:10 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:10.178611 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a83f8-49cb-4bbd-9748-13da92214ea2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:10.180685 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c4b08-1889-4f4a-aa6b-03c81174c929 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:10.195497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c4b08-1889-4f4a-aa6b-03c81174c929 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:10.196417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb60f7-984b-4ef3-a0c5-0b3dfdf7edd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:10.197300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb60f7-984b-4ef3-a0c5-0b3dfdf7edd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:10.197680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb60f7-984b-4ef3-a0c5-0b3dfdf7edd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:10.198052 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb60f7-984b-4ef3-a0c5-0b3dfdf7edd5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:10.209972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb60f7-984b-4ef3-a0c5-0b3dfdf7edd5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:10.212468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb60f7-984b-4ef3-a0c5-0b3dfdf7edd5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:10.213825 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d9797-a685-4062-91fb-171689479277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:10.214840 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d9797-a685-4062-91fb-171689479277 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:10.215225 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d9797-a685-4062-91fb-171689479277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:10.215609 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d9797-a685-4062-91fb-171689479277 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:10.228959 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d9797-a685-4062-91fb-171689479277 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:10.231188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d9797-a685-4062-91fb-171689479277 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:10.244649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-cacb60f7-984b-4ef3-a0c5-0b3dfdf7edd5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:10.245905 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 283/566] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:10.251691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-974d9797-a685-4062-91fb-171689479277 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:10.253366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 284/567] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:10.256820 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb60f7-984b-4ef3-a0c5-0b3dfdf7edd5 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:10.260098 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d9797-a685-4062-91fb-171689479277 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:10.281893 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb60f7-984b-4ef3-a0c5-0b3dfdf7edd5 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:10.284597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d9797-a685-4062-91fb-171689479277 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:10.292982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a07ce6-2b79-467c-a0a2-e650577ad492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:10.294047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae884b2c-c281-4412-b2af-47e40e5c81c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:10.294871 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a07ce6-2b79-467c-a0a2-e650577ad492 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:10.295654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae884b2c-c281-4412-b2af-47e40e5c81c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:10.296621 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a07ce6-2b79-467c-a0a2-e650577ad492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:10.297171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae884b2c-c281-4412-b2af-47e40e5c81c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:10.297580 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae884b2c-c281-4412-b2af-47e40e5c81c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:10.297975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a07ce6-2b79-467c-a0a2-e650577ad492 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:10.298920 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae884b2c-c281-4412-b2af-47e40e5c81c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:10.299834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a07ce6-2b79-467c-a0a2-e650577ad492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:10.300319 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae884b2c-c281-4412-b2af-47e40e5c81c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:10.300730 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a07ce6-2b79-467c-a0a2-e650577ad492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:10.302747 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae884b2c-c281-4412-b2af-47e40e5c81c2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:10.304672 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a07ce6-2b79-467c-a0a2-e650577ad492 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:10.323001 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 284/568] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:10.325388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 285/569] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:10.330117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae884b2c-c281-4412-b2af-47e40e5c81c2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:10.333263 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a07ce6-2b79-467c-a0a2-e650577ad492 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:10.340724 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae884b2c-c281-4412-b2af-47e40e5c81c2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:10.346802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75310465-3332-4855-b8fe-04f2f1d749e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:10.347040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a07ce6-2b79-467c-a0a2-e650577ad492 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:10.347751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75310465-3332-4855-b8fe-04f2f1d749e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:10.348151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75310465-3332-4855-b8fe-04f2f1d749e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:10.348532 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75310465-3332-4855-b8fe-04f2f1d749e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:10.349514 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75310465-3332-4855-b8fe-04f2f1d749e5 admin admin] RBAC: Adding query filter params (role.id=0811ae5a177643f9b2b86ec5feb7b163, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=c6be4b7bef21492bad49e6b5a284f4f0) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:10.349941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75310465-3332-4855-b8fe-04f2f1d749e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:10.352461 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75310465-3332-4855-b8fe-04f2f1d749e5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:10.360539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4177d-99be-426b-b9ce-5433124a315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:10.361441 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 285/570] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:10 2021] GET /identity/v3/role_assignments?user.id=c6be4b7bef21492bad49e6b5a284f4f0&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=0811ae5a177643f9b2b86ec5feb7b163 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:10.361580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4177d-99be-426b-b9ce-5433124a315a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:10.361580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4177d-99be-426b-b9ce-5433124a315a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:10.361850 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4177d-99be-426b-b9ce-5433124a315a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:10.375664 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4177d-99be-426b-b9ce-5433124a315a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:10.377333 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4177d-99be-426b-b9ce-5433124a315a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:10.393174 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-5ed4177d-99be-426b-b9ce-5433124a315a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:10.394805 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 286/571] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:10.401407 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75310465-3332-4855-b8fe-04f2f1d749e5 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:10.416287 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75310465-3332-4855-b8fe-04f2f1d749e5 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:10.424299 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091daf1-a6e7-4804-be60-289f1410eaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:10.424976 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091daf1-a6e7-4804-be60-289f1410eaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:10.425300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091daf1-a6e7-4804-be60-289f1410eaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:10.425570 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091daf1-a6e7-4804-be60-289f1410eaf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:10.426419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091daf1-a6e7-4804-be60-289f1410eaf9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:10.426724 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091daf1-a6e7-4804-be60-289f1410eaf9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:10.428725 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091daf1-a6e7-4804-be60-289f1410eaf9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:10.450013 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 286/572] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:10.457419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4177d-99be-426b-b9ce-5433124a315a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:10.468708 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4177d-99be-426b-b9ce-5433124a315a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:10.475126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320c6e4-8e48-4703-8bc1-9a6aaa2ee7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:10.476080 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320c6e4-8e48-4703-8bc1-9a6aaa2ee7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:10.476363 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320c6e4-8e48-4703-8bc1-9a6aaa2ee7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:10.476640 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320c6e4-8e48-4703-8bc1-9a6aaa2ee7bf admin admin] PATH_INFO: `/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/7e9153b864b44f5dbbfd6f33ddb253c0/roles/0811ae5a177643f9b2b86ec5feb7b163` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:10.492718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320c6e4-8e48-4703-8bc1-9a6aaa2ee7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579ca0c9e3d480ab7b4f64d199c403b, user_id=7e9153b864b44f5dbbfd6f33ddb253c0, role_id=0811ae5a177643f9b2b86ec5feb7b163)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:10.495380 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320c6e4-8e48-4703-8bc1-9a6aaa2ee7bf admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:10.600446 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 287/573] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:11:10 2021] PUT /identity/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/7e9153b864b44f5dbbfd6f33ddb253c0/roles/0811ae5a177643f9b2b86ec5feb7b163 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:11:11.620936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310c2fd-ded9-41b0-98a4-c64c906b56f7 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:11.621479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310c2fd-ded9-41b0-98a4-c64c906b56f7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:11.621479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310c2fd-ded9-41b0-98a4-c64c906b56f7 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:11.623576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 287/574] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:11.630355 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8f94b-4a33-4edc-99a9-fc478ff8d297 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:11.631236 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8f94b-4a33-4edc-99a9-fc478ff8d297 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:11.631655 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8f94b-4a33-4edc-99a9-fc478ff8d297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:11.656924 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-35c8f94b-4a33-4edc-99a9-fc478ff8d297 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:11.658403 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-35c8f94b-4a33-4edc-99a9-fc478ff8d297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:11.729842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 288/575] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:11.775118 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310c2fd-ded9-41b0-98a4-c64c906b56f7 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:11.789418 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310c2fd-ded9-41b0-98a4-c64c906b56f7 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:11.793965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9752e80-72f4-49dc-a0e0-ecb3aa534a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:11.794881 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9752e80-72f4-49dc-a0e0-ecb3aa534a75 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:11.795278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9752e80-72f4-49dc-a0e0-ecb3aa534a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:11.795666 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9752e80-72f4-49dc-a0e0-ecb3aa534a75 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:11.813761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9752e80-72f4-49dc-a0e0-ecb3aa534a75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:11.815792 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9752e80-72f4-49dc-a0e0-ecb3aa534a75 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:11.838028 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-a9752e80-72f4-49dc-a0e0-ecb3aa534a75 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:11.839973 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 288/576] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:11.846644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8f94b-4a33-4edc-99a9-fc478ff8d297 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:11.861733 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8f94b-4a33-4edc-99a9-fc478ff8d297 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:11.873088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3c10c-f498-4982-bd44-ae7d1395e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:11.873691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c10c-f498-4982-bd44-ae7d1395e937 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:11.873970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c10c-f498-4982-bd44-ae7d1395e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:11.874307 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c10c-f498-4982-bd44-ae7d1395e937 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:11.876407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3c10c-f498-4982-bd44-ae7d1395e937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:11.876562 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3c10c-f498-4982-bd44-ae7d1395e937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:11.878175 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3c10c-f498-4982-bd44-ae7d1395e937 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:11.897111 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 289/577] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:11.903128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9752e80-72f4-49dc-a0e0-ecb3aa534a75 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:11.918279 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9752e80-72f4-49dc-a0e0-ecb3aa534a75 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:11.923107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e063584-7469-4eed-a379-6a4768f00993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:11.923799 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e063584-7469-4eed-a379-6a4768f00993 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:11.924083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e063584-7469-4eed-a379-6a4768f00993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:11.924360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e063584-7469-4eed-a379-6a4768f00993 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:11.925086 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e063584-7469-4eed-a379-6a4768f00993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:11.927003 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e063584-7469-4eed-a379-6a4768f00993 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:12.038805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 289/578] 10.222.0.87 () {60 vars in 1153 bytes} [Fri Oct 29 01:11:11 2021] POST /identity/v3/users => generated 254 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:12.678064 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d91c50-e815-4838-ad24-9fe234d6e185 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:12.679449 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d91c50-e815-4838-ad24-9fe234d6e185 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:12.680202 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d91c50-e815-4838-ad24-9fe234d6e185 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:12.683118 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 290/579] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:12 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:12.690465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e6b5d-bac6-4c49-ad5b-3ef8e01c5687 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:12.691415 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e6b5d-bac6-4c49-ad5b-3ef8e01c5687 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:12.691929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e6b5d-bac6-4c49-ad5b-3ef8e01c5687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:12.720087 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-050e6b5d-bac6-4c49-ad5b-3ef8e01c5687 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:12.721668 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-050e6b5d-bac6-4c49-ad5b-3ef8e01c5687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:12.730097 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 290/580] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:12.756509 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d91c50-e815-4838-ad24-9fe234d6e185 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:12.771709 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d91c50-e815-4838-ad24-9fe234d6e185 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:12.776933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c410d-daff-40e2-8828-a04bdd474f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:12.778249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c410d-daff-40e2-8828-a04bdd474f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:12.778787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c410d-daff-40e2-8828-a04bdd474f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:12.779363 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c410d-daff-40e2-8828-a04bdd474f22 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:12.794979 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c410d-daff-40e2-8828-a04bdd474f22 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:12.802508 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-b65c410d-daff-40e2-8828-a04bdd474f22 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:11:12.804411 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 291/581] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:12.812646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e6b5d-bac6-4c49-ad5b-3ef8e01c5687 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:12.822340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e6b5d-bac6-4c49-ad5b-3ef8e01c5687 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:12.828031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce34e5f-c9e5-4e82-93c1-021e66b16a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:12.829001 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34e5f-c9e5-4e82-93c1-021e66b16a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:12.829511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34e5f-c9e5-4e82-93c1-021e66b16a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:12.829986 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34e5f-c9e5-4e82-93c1-021e66b16a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:12.830973 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce34e5f-c9e5-4e82-93c1-021e66b16a21 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:12.831480 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce34e5f-c9e5-4e82-93c1-021e66b16a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:12.833306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce34e5f-c9e5-4e82-93c1-021e66b16a21 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:12.844717 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 291/582] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:12.852998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c410d-daff-40e2-8828-a04bdd474f22 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:12.864287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c410d-daff-40e2-8828-a04bdd474f22 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:12.872908 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6a66f-326f-426a-a93f-97c7b2844d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:12.874024 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6a66f-326f-426a-a93f-97c7b2844d4f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:12.875017 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6a66f-326f-426a-a93f-97c7b2844d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:12.875480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6a66f-326f-426a-a93f-97c7b2844d4f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:12.895865 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6a66f-326f-426a-a93f-97c7b2844d4f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:12.898095 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6a66f-326f-426a-a93f-97c7b2844d4f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:12.928188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-d2a6a66f-326f-426a-a93f-97c7b2844d4f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:12.929737 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 292/583] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:12.937503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce34e5f-c9e5-4e82-93c1-021e66b16a21 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:12.950878 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce34e5f-c9e5-4e82-93c1-021e66b16a21 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:12.958356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e151f-fdf3-46a9-8fbf-773d1f7790f8 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:12.958976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e151f-fdf3-46a9-8fbf-773d1f7790f8 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:12.959445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e151f-fdf3-46a9-8fbf-773d1f7790f8 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:12.965787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 293/584] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:12 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:12.968508 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd0f6-3c9f-4cef-8588-6c4bdc7b9c19 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:12.969498 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd0f6-3c9f-4cef-8588-6c4bdc7b9c19 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:12.970329 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd0f6-3c9f-4cef-8588-6c4bdc7b9c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:12.973215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf00ced-4046-49c2-bcdd-33f9c68d57a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:12.974183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf00ced-4046-49c2-bcdd-33f9c68d57a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:12.974659 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf00ced-4046-49c2-bcdd-33f9c68d57a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:12.975128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf00ced-4046-49c2-bcdd-33f9c68d57a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:12.976130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf00ced-4046-49c2-bcdd-33f9c68d57a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:12.981163 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf00ced-4046-49c2-bcdd-33f9c68d57a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:12.984211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf00ced-4046-49c2-bcdd-33f9c68d57a2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.017171 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-fe3bd0f6-3c9f-4cef-8588-6c4bdc7b9c19 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:13.018712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-fe3bd0f6-3c9f-4cef-8588-6c4bdc7b9c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:13.030204 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 292/585] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:13.039135 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf00ced-4046-49c2-bcdd-33f9c68d57a2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.045533 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 294/586] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:13.066752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf00ced-4046-49c2-bcdd-33f9c68d57a2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.082241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bd0f6-3c9f-4cef-8588-6c4bdc7b9c19 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.093320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b139b54-4105-4b9f-81df-2ad088e85819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.094485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139b54-4105-4b9f-81df-2ad088e85819 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.094969 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139b54-4105-4b9f-81df-2ad088e85819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.095468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139b54-4105-4b9f-81df-2ad088e85819 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.097435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bd0f6-3c9f-4cef-8588-6c4bdc7b9c19 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.109497 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b139b54-4105-4b9f-81df-2ad088e85819 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.110471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7097238-9a6c-4895-8136-b2e93dcb746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.111797 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7097238-9a6c-4895-8136-b2e93dcb746f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.113663 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7097238-9a6c-4895-8136-b2e93dcb746f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.114158 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7097238-9a6c-4895-8136-b2e93dcb746f admin admin] PATH_INFO: `/v3/services/network` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.115848 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7097238-9a6c-4895-8136-b2e93dcb746f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.116062 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b139b54-4105-4b9f-81df-2ad088e85819 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.118792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-b7097238-9a6c-4895-8136-b2e93dcb746f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:13.118792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:11:13.118792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:11:13.120140 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7097238-9a6c-4895-8136-b2e93dcb746f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.148448 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-9b139b54-4105-4b9f-81df-2ad088e85819 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 01:11:13.150799 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-b7097238-9a6c-4895-8136-b2e93dcb746f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 01:11:13.151653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 293/587] 10.222.0.87 () {56 vars in 1114 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/users/nova => generated 82 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:13.153046 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 295/588] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/services/network => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:13.157944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b139b54-4105-4b9f-81df-2ad088e85819 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.170230 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b139b54-4105-4b9f-81df-2ad088e85819 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.174140 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7097238-9a6c-4895-8136-b2e93dcb746f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.184712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7097238-9a6c-4895-8136-b2e93dcb746f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.191713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04392f-e1e1-48df-80b8-42663dee3abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.194318 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04392f-e1e1-48df-80b8-42663dee3abc admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.194880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04392f-e1e1-48df-80b8-42663dee3abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.195648 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99318ad4-9ee1-429e-bd67-d241eeb06825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.196564 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99318ad4-9ee1-429e-bd67-d241eeb06825 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.197037 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99318ad4-9ee1-429e-bd67-d241eeb06825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.197538 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99318ad4-9ee1-429e-bd67-d241eeb06825 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.198471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99318ad4-9ee1-429e-bd67-d241eeb06825 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:13.199012 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99318ad4-9ee1-429e-bd67-d241eeb06825 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.200145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04392f-e1e1-48df-80b8-42663dee3abc admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.200502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-99318ad4-9ee1-429e-bd67-d241eeb06825 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:13.200502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:11:13.200502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:11:13.201061 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04392f-e1e1-48df-80b8-42663dee3abc admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:13.201378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04392f-e1e1-48df-80b8-42663dee3abc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.202883 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99318ad4-9ee1-429e-bd67-d241eeb06825 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.203790 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04392f-e1e1-48df-80b8-42663dee3abc admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.208806 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 296/589] 10.222.0.87 () {56 vars in 1133 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/services?name=network => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:13.216047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99318ad4-9ee1-429e-bd67-d241eeb06825 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.236606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99318ad4-9ee1-429e-bd67-d241eeb06825 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.247321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 294/590] 10.222.0.87 () {56 vars in 1154 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:13.250154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04392f-e1e1-48df-80b8-42663dee3abc admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.253138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085b2ca-cb8f-448c-b384-8660ad702ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.254225 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085b2ca-cb8f-448c-b384-8660ad702ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.255427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085b2ca-cb8f-448c-b384-8660ad702ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.255427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085b2ca-cb8f-448c-b384-8660ad702ad3 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.255654 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085b2ca-cb8f-448c-b384-8660ad702ad3 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:13.256771 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085b2ca-cb8f-448c-b384-8660ad702ad3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.262366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085b2ca-cb8f-448c-b384-8660ad702ad3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.269817 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04392f-e1e1-48df-80b8-42663dee3abc admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.275672 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 297/591] 10.222.0.87 () {56 vars in 1133 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/services?type=network => generated 124 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:13.280239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014281e6-27a9-40b0-9425-dabd33b0b3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.282272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014281e6-27a9-40b0-9425-dabd33b0b3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.282272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014281e6-27a9-40b0-9425-dabd33b0b3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.282272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014281e6-27a9-40b0-9425-dabd33b0b3d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.305390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014281e6-27a9-40b0-9425-dabd33b0b3d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.307515 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014281e6-27a9-40b0-9425-dabd33b0b3d6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.324497 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 295/592] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:13.330630 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085b2ca-cb8f-448c-b384-8660ad702ad3 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.346838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085b2ca-cb8f-448c-b384-8660ad702ad3 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.355670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e39bf5-7f89-4f33-bc19-09e0bc886b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.361262 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e39bf5-7f89-4f33-bc19-09e0bc886b2a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.362249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e39bf5-7f89-4f33-bc19-09e0bc886b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.362249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e39bf5-7f89-4f33-bc19-09e0bc886b2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.378796 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e39bf5-7f89-4f33-bc19-09e0bc886b2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.380969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e39bf5-7f89-4f33-bc19-09e0bc886b2a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.415405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-a3e39bf5-7f89-4f33-bc19-09e0bc886b2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:13.416697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 298/593] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:13.432897 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014281e6-27a9-40b0-9425-dabd33b0b3d6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.451405 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014281e6-27a9-40b0-9425-dabd33b0b3d6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.464773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2b599-a7dd-4d3b-855b-b6987963c97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.465639 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2b599-a7dd-4d3b-855b-b6987963c97d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.466009 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2b599-a7dd-4d3b-855b-b6987963c97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.466407 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2b599-a7dd-4d3b-855b-b6987963c97d admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.467279 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2b599-a7dd-4d3b-855b-b6987963c97d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:13.467686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2b599-a7dd-4d3b-855b-b6987963c97d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.470115 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2b599-a7dd-4d3b-855b-b6987963c97d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.500796 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 296/594] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:13.507440 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e39bf5-7f89-4f33-bc19-09e0bc886b2a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.521092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e39bf5-7f89-4f33-bc19-09e0bc886b2a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.529777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6767a-4d10-4f10-b92b-a1be660c5ec7 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.530411 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6767a-4d10-4f10-b92b-a1be660c5ec7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.531284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6767a-4d10-4f10-b92b-a1be660c5ec7 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.533385 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 297/595] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:11:13.539460 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aec033-56cc-4c19-8e5e-cf581dc1caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.540290 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec033-56cc-4c19-8e5e-cf581dc1caa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.540567 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec033-56cc-4c19-8e5e-cf581dc1caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.540835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec033-56cc-4c19-8e5e-cf581dc1caa2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.541186 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e4e63-451f-438f-a60d-122bf99956b0 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.541744 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e4e63-451f-438f-a60d-122bf99956b0 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.542127 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e4e63-451f-438f-a60d-122bf99956b0 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.544644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 298/596] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:13.546683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47923f-3e3a-4357-8465-a83409435739 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.547096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47923f-3e3a-4357-8465-a83409435739 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.547476 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47923f-3e3a-4357-8465-a83409435739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.554294 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aec033-56cc-4c19-8e5e-cf581dc1caa2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.556278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aec033-56cc-4c19-8e5e-cf581dc1caa2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.567592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-9f47923f-3e3a-4357-8465-a83409435739 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:13.570718 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-9f47923f-3e3a-4357-8465-a83409435739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:13.581272 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-c9aec033-56cc-4c19-8e5e-cf581dc1caa2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:13.583072 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 299/597] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:13.584499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af430c-d6e3-4395-98c4-40b03a6ac8a8 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.584984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af430c-d6e3-4395-98c4-40b03a6ac8a8 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.585495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af430c-d6e3-4395-98c4-40b03a6ac8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.588654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 299/598] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:13.592873 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47923f-3e3a-4357-8465-a83409435739 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.617497 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47923f-3e3a-4357-8465-a83409435739 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.625660 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-e9af430c-d6e3-4395-98c4-40b03a6ac8a8 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:13.627906 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e9af430c-d6e3-4395-98c4-40b03a6ac8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:13.629587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7464c1-edaa-4965-ba1d-5acd950bb5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.630307 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7464c1-edaa-4965-ba1d-5acd950bb5fc admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.630642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7464c1-edaa-4965-ba1d-5acd950bb5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.630915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7464c1-edaa-4965-ba1d-5acd950bb5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.633054 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7464c1-edaa-4965-ba1d-5acd950bb5fc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:13.633433 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7464c1-edaa-4965-ba1d-5acd950bb5fc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.635365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7464c1-edaa-4965-ba1d-5acd950bb5fc admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.637675 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 300/599] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:13.639330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af430c-d6e3-4395-98c4-40b03a6ac8a8 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.652051 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af430c-d6e3-4395-98c4-40b03a6ac8a8 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.658415 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 300/600] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:13.660869 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2c3d3-c6ba-47a5-9c30-4582fc6fd0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.661922 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2c3d3-c6ba-47a5-9c30-4582fc6fd0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.662762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2c3d3-c6ba-47a5-9c30-4582fc6fd0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.663205 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2c3d3-c6ba-47a5-9c30-4582fc6fd0c8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.666779 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7464c1-edaa-4965-ba1d-5acd950bb5fc admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.681604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2c3d3-c6ba-47a5-9c30-4582fc6fd0c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:13.682889 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7464c1-edaa-4965-ba1d-5acd950bb5fc admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.693123 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147ad07-858f-4b91-ba8b-ada33095e023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.694030 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147ad07-858f-4b91-ba8b-ada33095e023 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.694309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147ad07-858f-4b91-ba8b-ada33095e023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.694579 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147ad07-858f-4b91-ba8b-ada33095e023 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.695198 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-55c2c3d3-c6ba-47a5-9c30-4582fc6fd0c8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:13.695421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147ad07-858f-4b91-ba8b-ada33095e023 admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=28d331f2997547968c51fec87598420f) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:13.695749 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147ad07-858f-4b91-ba8b-ada33095e023 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.697315 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 301/601] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:13.699051 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2c3d3-c6ba-47a5-9c30-4582fc6fd0c8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.701850 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147ad07-858f-4b91-ba8b-ada33095e023 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.715275 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 301/602] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/role_assignments?user.id=28d331f2997547968c51fec87598420f&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:13.716773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147ad07-858f-4b91-ba8b-ada33095e023 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.720762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2c3d3-c6ba-47a5-9c30-4582fc6fd0c8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.725441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004538d-abd9-4e4b-82d4-43689f6f33b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.726571 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004538d-abd9-4e4b-82d4-43689f6f33b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.726861 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004538d-abd9-4e4b-82d4-43689f6f33b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.727136 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004538d-abd9-4e4b-82d4-43689f6f33b6 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.727837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004538d-abd9-4e4b-82d4-43689f6f33b6 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.728305 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147ad07-858f-4b91-ba8b-ada33095e023 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.729706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004538d-abd9-4e4b-82d4-43689f6f33b6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.733045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83c5c6-20c1-4c78-9870-91c915ca8ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.734334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83c5c6-20c1-4c78-9870-91c915ca8ddf admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.734678 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83c5c6-20c1-4c78-9870-91c915ca8ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.735021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83c5c6-20c1-4c78-9870-91c915ca8ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.735948 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83c5c6-20c1-4c78-9870-91c915ca8ddf admin admin] RBAC: Adding query filter params (name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:13.736326 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83c5c6-20c1-4c78-9870-91c915ca8ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.737989 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83c5c6-20c1-4c78-9870-91c915ca8ddf admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.744810 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-e004538d-abd9-4e4b-82d4-43689f6f33b6 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 01:11:13.746443 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 302/603] 10.222.0.87 () {56 vars in 1150 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:13.756897 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004538d-abd9-4e4b-82d4-43689f6f33b6 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.762272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 302/604] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:13.767785 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004538d-abd9-4e4b-82d4-43689f6f33b6 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.771136 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83c5c6-20c1-4c78-9870-91c915ca8ddf admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.783468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83c5c6-20c1-4c78-9870-91c915ca8ddf admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.787162 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288aa03-7749-408c-9a06-6af32abe213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.788724 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288aa03-7749-408c-9a06-6af32abe213b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.790096 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288aa03-7749-408c-9a06-6af32abe213b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.790452 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288aa03-7749-408c-9a06-6af32abe213b admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.791795 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288aa03-7749-408c-9a06-6af32abe213b admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:13.793087 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288aa03-7749-408c-9a06-6af32abe213b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.793863 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b1b57-78c6-4376-8658-3e0972e39130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.795594 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288aa03-7749-408c-9a06-6af32abe213b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.797115 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b1b57-78c6-4376-8658-3e0972e39130 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.798807 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b1b57-78c6-4376-8658-3e0972e39130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.799168 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b1b57-78c6-4376-8658-3e0972e39130 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.805481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 303/605] 10.222.0.87 () {56 vars in 1145 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:13.815364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288aa03-7749-408c-9a06-6af32abe213b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.827812 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288aa03-7749-408c-9a06-6af32abe213b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.828315 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b1b57-78c6-4376-8658-3e0972e39130 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.830342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b1b57-78c6-4376-8658-3e0972e39130 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.832950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafa570-681c-4ea8-9560-36997aa4dea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.833768 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafa570-681c-4ea8-9560-36997aa4dea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.834146 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafa570-681c-4ea8-9560-36997aa4dea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.834542 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafa570-681c-4ea8-9560-36997aa4dea3 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.835614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafa570-681c-4ea8-9560-36997aa4dea3 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:13.836073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafa570-681c-4ea8-9560-36997aa4dea3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.837785 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafa570-681c-4ea8-9560-36997aa4dea3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.848479 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 304/606] 10.222.0.87 () {56 vars in 1145 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:13.864485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-177b1b57-78c6-4376-8658-3e0972e39130 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:13.875656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 303/607] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:13.883783 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafa570-681c-4ea8-9560-36997aa4dea3 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.894631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafa570-681c-4ea8-9560-36997aa4dea3 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.908797 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5c88d-b191-42c2-92e8-a73767df75c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.909684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5c88d-b191-42c2-92e8-a73767df75c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.910031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5c88d-b191-42c2-92e8-a73767df75c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.910402 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5c88d-b191-42c2-92e8-a73767df75c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.911251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5c88d-b191-42c2-92e8-a73767df75c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:13.911661 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5c88d-b191-42c2-92e8-a73767df75c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.913458 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5c88d-b191-42c2-92e8-a73767df75c7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:13.939237 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 305/608] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:13.940691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b1b57-78c6-4376-8658-3e0972e39130 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:13.963810 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b1b57-78c6-4376-8658-3e0972e39130 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:13.975287 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da157447-1499-4968-a31e-0a38b80d6b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:13.976115 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da157447-1499-4968-a31e-0a38b80d6b20 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:13.976393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da157447-1499-4968-a31e-0a38b80d6b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:13.976668 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da157447-1499-4968-a31e-0a38b80d6b20 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:13.993302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da157447-1499-4968-a31e-0a38b80d6b20 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:13.995459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da157447-1499-4968-a31e-0a38b80d6b20 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:14.020331 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-da157447-1499-4968-a31e-0a38b80d6b20 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 01:11:14.021897 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 304/609] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:13 2021] GET /identity/v3/users/swift => generated 83 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:14.028394 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5c88d-b191-42c2-92e8-a73767df75c7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:14.039141 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5c88d-b191-42c2-92e8-a73767df75c7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:14.044124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e599c3-6106-45ba-b974-c480c81f6427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:14.044812 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e599c3-6106-45ba-b974-c480c81f6427 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:14.045094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e599c3-6106-45ba-b974-c480c81f6427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:14.045372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e599c3-6106-45ba-b974-c480c81f6427 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:14.047295 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e599c3-6106-45ba-b974-c480c81f6427 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:14.047534 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e599c3-6106-45ba-b974-c480c81f6427 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:14.049512 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e599c3-6106-45ba-b974-c480c81f6427 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:14.070330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 306/610] 10.222.0.87 () {56 vars in 1156 bytes} [Fri Oct 29 01:11:14 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:14.077154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da157447-1499-4968-a31e-0a38b80d6b20 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:14.088935 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da157447-1499-4968-a31e-0a38b80d6b20 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:14.094133 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdae42-0b2c-4882-bd12-98ac69637d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:14.094797 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdae42-0b2c-4882-bd12-98ac69637d37 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:14.095078 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdae42-0b2c-4882-bd12-98ac69637d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:14.095349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdae42-0b2c-4882-bd12-98ac69637d37 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:14.104307 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdae42-0b2c-4882-bd12-98ac69637d37 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:14.106127 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdae42-0b2c-4882-bd12-98ac69637d37 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:14.120176 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 305/611] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:14.125055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e599c3-6106-45ba-b974-c480c81f6427 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:14.135348 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e599c3-6106-45ba-b974-c480c81f6427 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:14.140852 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f61bf9-bf4d-4be5-8ec5-ec996347a71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:14.141653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f61bf9-bf4d-4be5-8ec5-ec996347a71e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:14.141934 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f61bf9-bf4d-4be5-8ec5-ec996347a71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:14.142208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f61bf9-bf4d-4be5-8ec5-ec996347a71e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:14.153181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f61bf9-bf4d-4be5-8ec5-ec996347a71e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:14.155017 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f61bf9-bf4d-4be5-8ec5-ec996347a71e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:14.174026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-f0f61bf9-bf4d-4be5-8ec5-ec996347a71e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:14.179867 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 307/612] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:14.182011 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdae42-0b2c-4882-bd12-98ac69637d37 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:14.192059 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdae42-0b2c-4882-bd12-98ac69637d37 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:14.196832 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a7a7d-dbfc-4af9-a8e5-d1abf2793c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:14.197495 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a7a7d-dbfc-4af9-a8e5-d1abf2793c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:14.197774 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a7a7d-dbfc-4af9-a8e5-d1abf2793c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:14.198046 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a7a7d-dbfc-4af9-a8e5-d1abf2793c2f admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:14.198779 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a7a7d-dbfc-4af9-a8e5-d1abf2793c2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:14.199082 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a7a7d-dbfc-4af9-a8e5-d1abf2793c2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:14.200833 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a7a7d-dbfc-4af9-a8e5-d1abf2793c2f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:14.219464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 306/613] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:14.220854 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f61bf9-bf4d-4be5-8ec5-ec996347a71e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:14.230764 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f61bf9-bf4d-4be5-8ec5-ec996347a71e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:14.235910 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a0601-3d4a-4012-99c6-1dc9a97617bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:14.236691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a0601-3d4a-4012-99c6-1dc9a97617bf admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:14.236971 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a0601-3d4a-4012-99c6-1dc9a97617bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:14.237241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a0601-3d4a-4012-99c6-1dc9a97617bf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:14.244575 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a0601-3d4a-4012-99c6-1dc9a97617bf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:14.246524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a0601-3d4a-4012-99c6-1dc9a97617bf admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:14.260366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-675a0601-3d4a-4012-99c6-1dc9a97617bf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:14.267637 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 308/614] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:14.268991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a7a7d-dbfc-4af9-a8e5-d1abf2793c2f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:14.279347 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a7a7d-dbfc-4af9-a8e5-d1abf2793c2f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:14.284803 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfcd8b-7e2c-4737-803a-8f49af482e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:14.285464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfcd8b-7e2c-4737-803a-8f49af482e1d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:14.285794 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfcd8b-7e2c-4737-803a-8f49af482e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:14.286065 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfcd8b-7e2c-4737-803a-8f49af482e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:14.286924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfcd8b-7e2c-4737-803a-8f49af482e1d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:14.287231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfcd8b-7e2c-4737-803a-8f49af482e1d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:14.289252 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfcd8b-7e2c-4737-803a-8f49af482e1d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:14.307861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 307/615] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:14.309651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a0601-3d4a-4012-99c6-1dc9a97617bf admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:14.321647 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a0601-3d4a-4012-99c6-1dc9a97617bf admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:14.327718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c76c1-5086-4dc3-9c3e-9028eb4dcedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:14.328528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c76c1-5086-4dc3-9c3e-9028eb4dcedb admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:14.328806 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c76c1-5086-4dc3-9c3e-9028eb4dcedb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:14.329133 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c76c1-5086-4dc3-9c3e-9028eb4dcedb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:14.329968 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c76c1-5086-4dc3-9c3e-9028eb4dcedb admin admin] RBAC: Adding query filter params (role.id=0811ae5a177643f9b2b86ec5feb7b163, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=7e9153b864b44f5dbbfd6f33ddb253c0) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:14.330331 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c76c1-5086-4dc3-9c3e-9028eb4dcedb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:14.332332 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c76c1-5086-4dc3-9c3e-9028eb4dcedb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:14.343906 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 309/616] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:14 2021] GET /identity/v3/role_assignments?user.id=7e9153b864b44f5dbbfd6f33ddb253c0&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=0811ae5a177643f9b2b86ec5feb7b163 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:15.157971 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e15e6-69ee-4fd1-aaee-41f087c96ed7 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:15.158466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e15e6-69ee-4fd1-aaee-41f087c96ed7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:15.158466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e15e6-69ee-4fd1-aaee-41f087c96ed7 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:15.160378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 308/617] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:15.166526 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27060d1-8ef3-4e43-bc46-75e394a7dad7 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:15.166958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27060d1-8ef3-4e43-bc46-75e394a7dad7 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:15.167128 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27060d1-8ef3-4e43-bc46-75e394a7dad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:15.190372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-a27060d1-8ef3-4e43-bc46-75e394a7dad7 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:15.191919 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a27060d1-8ef3-4e43-bc46-75e394a7dad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:15.200438 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 310/618] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:15.225746 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e15e6-69ee-4fd1-aaee-41f087c96ed7 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:15.239099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e15e6-69ee-4fd1-aaee-41f087c96ed7 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:15.243815 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eff104-1725-4136-a1d4-8055779795b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:15.244857 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eff104-1725-4136-a1d4-8055779795b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:15.245348 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eff104-1725-4136-a1d4-8055779795b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:15.245812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eff104-1725-4136-a1d4-8055779795b8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:15.257222 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eff104-1725-4136-a1d4-8055779795b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:15.264811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-08eff104-1725-4136-a1d4-8055779795b8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:15.266603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 309/619] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:15 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:15.273090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27060d1-8ef3-4e43-bc46-75e394a7dad7 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:15.283181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27060d1-8ef3-4e43-bc46-75e394a7dad7 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:15.288054 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e4847-de16-4db9-ae51-c1ff89a7cdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:15.288950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e4847-de16-4db9-ae51-c1ff89a7cdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:15.289453 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e4847-de16-4db9-ae51-c1ff89a7cdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:15.289921 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e4847-de16-4db9-ae51-c1ff89a7cdd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:15.290880 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e4847-de16-4db9-ae51-c1ff89a7cdd6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:15.291376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e4847-de16-4db9-ae51-c1ff89a7cdd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:15.293179 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e4847-de16-4db9-ae51-c1ff89a7cdd6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:15.303003 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 311/620] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:15 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:15.309453 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eff104-1725-4136-a1d4-8055779795b8 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:15.320514 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eff104-1725-4136-a1d4-8055779795b8 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:15.325523 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805da38-b117-4958-ad5c-5f8a8a0ef669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:15.326575 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805da38-b117-4958-ad5c-5f8a8a0ef669 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:15.327103 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805da38-b117-4958-ad5c-5f8a8a0ef669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:15.327580 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805da38-b117-4958-ad5c-5f8a8a0ef669 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:15.338638 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805da38-b117-4958-ad5c-5f8a8a0ef669 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:15.340886 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805da38-b117-4958-ad5c-5f8a8a0ef669 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:15.361169 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-1805da38-b117-4958-ad5c-5f8a8a0ef669 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:15.363032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 310/621] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:15.369370 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e4847-de16-4db9-ae51-c1ff89a7cdd6 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:15.379967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e4847-de16-4db9-ae51-c1ff89a7cdd6 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:15.384987 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24da51-355e-4ee0-8c0c-8dacd4e00905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:15.385899 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24da51-355e-4ee0-8c0c-8dacd4e00905 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:15.386433 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24da51-355e-4ee0-8c0c-8dacd4e00905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:15.386916 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24da51-355e-4ee0-8c0c-8dacd4e00905 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:15.387923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24da51-355e-4ee0-8c0c-8dacd4e00905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:15.388427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24da51-355e-4ee0-8c0c-8dacd4e00905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:15.390580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24da51-355e-4ee0-8c0c-8dacd4e00905 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:15.404637 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 312/622] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:15.411628 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805da38-b117-4958-ad5c-5f8a8a0ef669 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:15.422866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805da38-b117-4958-ad5c-5f8a8a0ef669 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:15.427975 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff374a7-ec76-41e4-9141-7b12e460ee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:15.429081 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff374a7-ec76-41e4-9141-7b12e460ee7a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:15.429565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff374a7-ec76-41e4-9141-7b12e460ee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:15.430210 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff374a7-ec76-41e4-9141-7b12e460ee7a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:15.438666 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff374a7-ec76-41e4-9141-7b12e460ee7a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:15.441056 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff374a7-ec76-41e4-9141-7b12e460ee7a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:15.456857 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-7ff374a7-ec76-41e4-9141-7b12e460ee7a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 01:11:15.458714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 311/623] 10.222.0.87 () {56 vars in 1138 bytes} [Fri Oct 29 01:11:15 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:15.465057 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24da51-355e-4ee0-8c0c-8dacd4e00905 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:15.476373 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24da51-355e-4ee0-8c0c-8dacd4e00905 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:15.481415 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6c0df-721f-4a6b-93c4-96f22e3be1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:15.482402 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6c0df-721f-4a6b-93c4-96f22e3be1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:15.482928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6c0df-721f-4a6b-93c4-96f22e3be1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:15.483656 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6c0df-721f-4a6b-93c4-96f22e3be1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:15.484939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6c0df-721f-4a6b-93c4-96f22e3be1a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:15.485456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6c0df-721f-4a6b-93c4-96f22e3be1a1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:15.487543 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6c0df-721f-4a6b-93c4-96f22e3be1a1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:15.507571 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 313/624] 10.222.0.87 () {56 vars in 1170 bytes} [Fri Oct 29 01:11:15 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:15.514076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff374a7-ec76-41e4-9141-7b12e460ee7a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:15.525061 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff374a7-ec76-41e4-9141-7b12e460ee7a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:15.530035 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87679ef3-81e3-4c6b-8e8f-9d65b789e804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:15.531649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87679ef3-81e3-4c6b-8e8f-9d65b789e804 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:15.532436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87679ef3-81e3-4c6b-8e8f-9d65b789e804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:15.532929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87679ef3-81e3-4c6b-8e8f-9d65b789e804 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:15.541789 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87679ef3-81e3-4c6b-8e8f-9d65b789e804 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:15.543874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87679ef3-81e3-4c6b-8e8f-9d65b789e804 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:15.554107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 312/625] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:11:15.560430 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6c0df-721f-4a6b-93c4-96f22e3be1a1 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:15.571617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6c0df-721f-4a6b-93c4-96f22e3be1a1 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:15.578039 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5b661-6d3c-47af-9939-aaa0812ec64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:15.579335 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5b661-6d3c-47af-9939-aaa0812ec64e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:15.579962 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5b661-6d3c-47af-9939-aaa0812ec64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:15.580461 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5b661-6d3c-47af-9939-aaa0812ec64e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:15.594971 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5b661-6d3c-47af-9939-aaa0812ec64e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:15.597215 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5b661-6d3c-47af-9939-aaa0812ec64e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:15.615184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-cbd5b661-6d3c-47af-9939-aaa0812ec64e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:15.617091 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 314/626] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:15.623393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87679ef3-81e3-4c6b-8e8f-9d65b789e804 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:15.632792 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87679ef3-81e3-4c6b-8e8f-9d65b789e804 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:15.639474 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbaf1c-22ec-42ee-bc3b-f9b8fa3d8731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:15.640972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbaf1c-22ec-42ee-bc3b-f9b8fa3d8731 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:15.641472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbaf1c-22ec-42ee-bc3b-f9b8fa3d8731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:15.641941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbaf1c-22ec-42ee-bc3b-f9b8fa3d8731 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:15.642929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbaf1c-22ec-42ee-bc3b-f9b8fa3d8731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:15.643441 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbaf1c-22ec-42ee-bc3b-f9b8fa3d8731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:15.645246 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbaf1c-22ec-42ee-bc3b-f9b8fa3d8731 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:15.663145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 313/627] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:15.669541 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5b661-6d3c-47af-9939-aaa0812ec64e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:15.680481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5b661-6d3c-47af-9939-aaa0812ec64e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:15.689649 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318a1ef-9d68-43bc-8799-18b2e4db0629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:15.690769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318a1ef-9d68-43bc-8799-18b2e4db0629 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:15.691244 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318a1ef-9d68-43bc-8799-18b2e4db0629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:15.691808 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318a1ef-9d68-43bc-8799-18b2e4db0629 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:15.700080 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318a1ef-9d68-43bc-8799-18b2e4db0629 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:15.703015 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318a1ef-9d68-43bc-8799-18b2e4db0629 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:15.723448 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-5318a1ef-9d68-43bc-8799-18b2e4db0629 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:15.724698 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 315/628] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:15.731169 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbaf1c-22ec-42ee-bc3b-f9b8fa3d8731 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:15.747241 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbaf1c-22ec-42ee-bc3b-f9b8fa3d8731 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:15.753004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1ab86-8b24-4120-b2c0-2824731875dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:15.753899 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1ab86-8b24-4120-b2c0-2824731875dc admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:15.754458 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1ab86-8b24-4120-b2c0-2824731875dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:15.754924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1ab86-8b24-4120-b2c0-2824731875dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:15.756041 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1ab86-8b24-4120-b2c0-2824731875dc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:15.756569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1ab86-8b24-4120-b2c0-2824731875dc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:15.758743 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1ab86-8b24-4120-b2c0-2824731875dc admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:15.772826 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 314/629] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:15.779704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318a1ef-9d68-43bc-8799-18b2e4db0629 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:15.791164 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318a1ef-9d68-43bc-8799-18b2e4db0629 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:15.797101 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949c75-e262-448e-a531-9ab2f9f06775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:15.798040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949c75-e262-448e-a531-9ab2f9f06775 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:15.798538 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949c75-e262-448e-a531-9ab2f9f06775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:15.799038 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949c75-e262-448e-a531-9ab2f9f06775 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:15.800204 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949c75-e262-448e-a531-9ab2f9f06775 admin admin] RBAC: Adding query filter params (role.id=0811ae5a177643f9b2b86ec5feb7b163, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=28ed9da4224549d1a2efd82998c8a500) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:15.800713 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949c75-e262-448e-a531-9ab2f9f06775 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:15.803016 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949c75-e262-448e-a531-9ab2f9f06775 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:15.809931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 316/630] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:15 2021] GET /identity/v3/role_assignments?user.id=28ed9da4224549d1a2efd82998c8a500&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=0811ae5a177643f9b2b86ec5feb7b163 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:16.031944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c1190-4154-4644-8007-e1263b61899f None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.032583 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c1190-4154-4644-8007-e1263b61899f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.033061 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c1190-4154-4644-8007-e1263b61899f None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.035441 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 315/631] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:16.041699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8cb89-9c93-4bb2-9ab9-be33184c38ab None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.042323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8cb89-9c93-4bb2-9ab9-be33184c38ab None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.042794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8cb89-9c93-4bb2-9ab9-be33184c38ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.063486 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-fdb8cb89-9c93-4bb2-9ab9-be33184c38ab None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:16.065172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-fdb8cb89-9c93-4bb2-9ab9-be33184c38ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:16.076441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 317/632] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:16.102225 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c1190-4154-4644-8007-e1263b61899f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:16.117828 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c1190-4154-4644-8007-e1263b61899f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:16.123549 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c4de8-4060-41fc-aa6e-b7771d04f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:16.124344 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c4de8-4060-41fc-aa6e-b7771d04f69c admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.124618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c4de8-4060-41fc-aa6e-b7771d04f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.125129 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c4de8-4060-41fc-aa6e-b7771d04f69c admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.125945 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c4de8-4060-41fc-aa6e-b7771d04f69c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:16.126997 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-129c4de8-4060-41fc-aa6e-b7771d04f69c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:16.126997 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:11:16.126997 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:11:16.127912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c4de8-4060-41fc-aa6e-b7771d04f69c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:16.240621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 316/633] 10.222.0.87 () {60 vars in 1162 bytes} [Fri Oct 29 01:11:16 2021] POST /identity/v3/services => generated 240 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:16.468344 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cb26d-593d-4e52-ba70-8f4fd814863d None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.469057 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cb26d-593d-4e52-ba70-8f4fd814863d None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.469057 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cb26d-593d-4e52-ba70-8f4fd814863d None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.471166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 318/634] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:16.489884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaf33b-e2d7-49bd-9fbc-4f2fb3e95dad None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.490201 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaf33b-e2d7-49bd-9fbc-4f2fb3e95dad None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.490445 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaf33b-e2d7-49bd-9fbc-4f2fb3e95dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.516849 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-5aaaf33b-e2d7-49bd-9fbc-4f2fb3e95dad None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:16.518072 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-5aaaf33b-e2d7-49bd-9fbc-4f2fb3e95dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:16.539759 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 317/635] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:16 2021] POST /identity/v3/auth/tokens => generated 1166 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:16.585288 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cb26d-593d-4e52-ba70-8f4fd814863d None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:16.604375 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cb26d-593d-4e52-ba70-8f4fd814863d None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:16.609510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1c282-b7b9-4676-b67f-c7ba92184d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:16.610293 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1c282-b7b9-4676-b67f-c7ba92184d7f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.610565 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1c282-b7b9-4676-b67f-c7ba92184d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.610831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1c282-b7b9-4676-b67f-c7ba92184d7f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.622232 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1c282-b7b9-4676-b67f-c7ba92184d7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:16.629133 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-5df1c282-b7b9-4676-b67f-c7ba92184d7f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:11:16.630650 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 319/636] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:16.639697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaaf33b-e2d7-49bd-9fbc-4f2fb3e95dad None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:16.648862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaaf33b-e2d7-49bd-9fbc-4f2fb3e95dad None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:16.659477 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185343-6626-43e3-96ab-e344fd9b7104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:16.660190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185343-6626-43e3-96ab-e344fd9b7104 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.660469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185343-6626-43e3-96ab-e344fd9b7104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.660743 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185343-6626-43e3-96ab-e344fd9b7104 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.661518 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe185343-6626-43e3-96ab-e344fd9b7104 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:16.661820 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe185343-6626-43e3-96ab-e344fd9b7104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:16.663420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe185343-6626-43e3-96ab-e344fd9b7104 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:16.673767 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 318/637] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:16.680276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1c282-b7b9-4676-b67f-c7ba92184d7f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:16.691372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1c282-b7b9-4676-b67f-c7ba92184d7f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:16.696558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d72fbb-f720-469d-a617-ca63fbb41cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:16.697418 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d72fbb-f720-469d-a617-ca63fbb41cac admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.697692 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d72fbb-f720-469d-a617-ca63fbb41cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.698008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d72fbb-f720-469d-a617-ca63fbb41cac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.710953 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d72fbb-f720-469d-a617-ca63fbb41cac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:16.712896 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d72fbb-f720-469d-a617-ca63fbb41cac admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:16.731822 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-a5d72fbb-f720-469d-a617-ca63fbb41cac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:16.733423 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 320/638] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:16.739619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185343-6626-43e3-96ab-e344fd9b7104 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:16.750193 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185343-6626-43e3-96ab-e344fd9b7104 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:16.754817 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dd677-3024-4608-807b-ff09b6655b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:16.755469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dd677-3024-4608-807b-ff09b6655b53 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.755826 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dd677-3024-4608-807b-ff09b6655b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.756102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dd677-3024-4608-807b-ff09b6655b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.756886 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213dd677-3024-4608-807b-ff09b6655b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:16.757163 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213dd677-3024-4608-807b-ff09b6655b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:16.758799 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213dd677-3024-4608-807b-ff09b6655b53 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:16.772179 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 319/639] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:16.778292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d72fbb-f720-469d-a617-ca63fbb41cac admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:16.788636 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d72fbb-f720-469d-a617-ca63fbb41cac admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:16.793372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b03bb4-39aa-4d10-8d14-701d2b55fd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:16.794200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03bb4-39aa-4d10-8d14-701d2b55fd3e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.794474 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03bb4-39aa-4d10-8d14-701d2b55fd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.794742 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03bb4-39aa-4d10-8d14-701d2b55fd3e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.803564 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b03bb4-39aa-4d10-8d14-701d2b55fd3e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:16.805578 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b03bb4-39aa-4d10-8d14-701d2b55fd3e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:16.823321 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-20b03bb4-39aa-4d10-8d14-701d2b55fd3e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 01:11:16.824559 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 321/640] 10.222.0.87 () {56 vars in 1114 bytes} [Fri Oct 29 01:11:16 2021] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:16.831623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dd677-3024-4608-807b-ff09b6655b53 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:16.843935 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dd677-3024-4608-807b-ff09b6655b53 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:16.849616 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e34838-d911-4969-abb3-b8f2866a3c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:16.850329 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e34838-d911-4969-abb3-b8f2866a3c68 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.850605 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e34838-d911-4969-abb3-b8f2866a3c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.850870 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e34838-d911-4969-abb3-b8f2866a3c68 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.851802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e34838-d911-4969-abb3-b8f2866a3c68 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:16.852109 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e34838-d911-4969-abb3-b8f2866a3c68 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:16.853983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e34838-d911-4969-abb3-b8f2866a3c68 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:16.877847 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1793a9-b5de-452b-9393-350daf05edda None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.878131 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1793a9-b5de-452b-9393-350daf05edda None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.878404 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1793a9-b5de-452b-9393-350daf05edda None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.878565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 320/641] 10.222.0.87 () {56 vars in 1154 bytes} [Fri Oct 29 01:11:16 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:16.883159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 322/642] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:16 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:16.884042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e34838-d911-4969-abb3-b8f2866a3c68 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:16.894927 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e34838-d911-4969-abb3-b8f2866a3c68 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:16.897392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ef7a1-f871-4ee8-a1f4-8b3c1d801206 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.897674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ef7a1-f871-4ee8-a1f4-8b3c1d801206 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.897950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ef7a1-f871-4ee8-a1f4-8b3c1d801206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.899880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b114a9c-75ac-45af-be5b-d0b5290260e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:16.900660 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b114a9c-75ac-45af-be5b-d0b5290260e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.900935 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b114a9c-75ac-45af-be5b-d0b5290260e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.901202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b114a9c-75ac-45af-be5b-d0b5290260e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.912462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b114a9c-75ac-45af-be5b-d0b5290260e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:16.914319 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b114a9c-75ac-45af-be5b-d0b5290260e6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:16.931834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-655ef7a1-f871-4ee8-a1f4-8b3c1d801206 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:16.932218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-1b114a9c-75ac-45af-be5b-d0b5290260e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:16.933030 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-655ef7a1-f871-4ee8-a1f4-8b3c1d801206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:16.938921 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 321/643] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:16.940122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b114a9c-75ac-45af-be5b-d0b5290260e6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:16.949253 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 323/644] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:16 2021] POST /identity/v3/auth/tokens => generated 1166 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:16.955256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b114a9c-75ac-45af-be5b-d0b5290260e6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:16.962926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc38b2-460a-4ff3-a4c3-104fe9b287c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:16.963577 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc38b2-460a-4ff3-a4c3-104fe9b287c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:16.963888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc38b2-460a-4ff3-a4c3-104fe9b287c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:16.964163 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc38b2-460a-4ff3-a4c3-104fe9b287c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:16.964904 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc38b2-460a-4ff3-a4c3-104fe9b287c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:16.965208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc38b2-460a-4ff3-a4c3-104fe9b287c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:16.966790 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc38b2-460a-4ff3-a4c3-104fe9b287c2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:16.985895 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 322/645] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:16.991962 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ef7a1-f871-4ee8-a1f4-8b3c1d801206 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:17.002503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc38b2-460a-4ff3-a4c3-104fe9b287c2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:17.006419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ef7a1-f871-4ee8-a1f4-8b3c1d801206 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:17.012423 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc38b2-460a-4ff3-a4c3-104fe9b287c2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:17.014149 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d98474-abd0-4810-bb03-20aa24b7f08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:17.015497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d98474-abd0-4810-bb03-20aa24b7f08d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:17.015811 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d98474-abd0-4810-bb03-20aa24b7f08d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:17.016082 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d98474-abd0-4810-bb03-20aa24b7f08d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:17.017916 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50be446-a71b-42ba-ab45-1ae920f4f7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:17.018568 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50be446-a71b-42ba-ab45-1ae920f4f7de admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:17.018848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50be446-a71b-42ba-ab45-1ae920f4f7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:17.019120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50be446-a71b-42ba-ab45-1ae920f4f7de admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:17.019885 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50be446-a71b-42ba-ab45-1ae920f4f7de admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:17.021470 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50be446-a71b-42ba-ab45-1ae920f4f7de admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:17.029007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d98474-abd0-4810-bb03-20aa24b7f08d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:17.031761 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d98474-abd0-4810-bb03-20aa24b7f08d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:17.045313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-22d98474-abd0-4810-bb03-20aa24b7f08d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:17.047268 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 324/646] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:17.053725 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d98474-abd0-4810-bb03-20aa24b7f08d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:17.065097 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d98474-abd0-4810-bb03-20aa24b7f08d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:17.070044 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d4c43-ce25-4151-8e3b-070588763005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:17.070662 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d4c43-ce25-4151-8e3b-070588763005 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:17.070998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d4c43-ce25-4151-8e3b-070588763005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:17.071319 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d4c43-ce25-4151-8e3b-070588763005 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:17.072280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d4c43-ce25-4151-8e3b-070588763005 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:17.072585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d4c43-ce25-4151-8e3b-070588763005 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:17.074441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d4c43-ce25-4151-8e3b-070588763005 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:17.088438 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 325/647] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:17.096015 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d4c43-ce25-4151-8e3b-070588763005 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:17.106238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d4c43-ce25-4151-8e3b-070588763005 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:17.111815 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f77a84-b737-40e0-8ceb-cad3ac700156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:17.112764 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f77a84-b737-40e0-8ceb-cad3ac700156 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:17.113047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f77a84-b737-40e0-8ceb-cad3ac700156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:17.113371 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f77a84-b737-40e0-8ceb-cad3ac700156 admin admin] PATH_INFO: `/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/28d331f2997547968c51fec87598420f/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:17.115442 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f77a84-b737-40e0-8ceb-cad3ac700156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579ca0c9e3d480ab7b4f64d199c403b, user_id=28d331f2997547968c51fec87598420f, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:17.125965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 323/648] 10.222.0.87 () {60 vars in 1162 bytes} [Fri Oct 29 01:11:17 2021] POST /identity/v3/services => generated 251 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:11:17.126308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f77a84-b737-40e0-8ceb-cad3ac700156 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:17.211495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 326/649] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:11:17 2021] PUT /identity/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/28d331f2997547968c51fec87598420f/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:11:18.073895 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38b2e-f436-4337-922a-182b5adc0d8b None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.074615 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38b2e-f436-4337-922a-182b5adc0d8b None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.074615 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38b2e-f436-4337-922a-182b5adc0d8b None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.076535 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 324/650] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:18.083069 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e5393-fa0b-499d-b132-9aba2015b950 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.083596 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e5393-fa0b-499d-b132-9aba2015b950 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.083596 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e5393-fa0b-499d-b132-9aba2015b950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.102619 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-991e5393-fa0b-499d-b132-9aba2015b950 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:18.103818 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-991e5393-fa0b-499d-b132-9aba2015b950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:18.199957 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 327/651] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:18 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:18.242999 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f38b2e-f436-4337-922a-182b5adc0d8b None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.262010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f38b2e-f436-4337-922a-182b5adc0d8b None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.269550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c5f08-1090-4e06-a56c-6cb9c5ee3250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.270431 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c5f08-1090-4e06-a56c-6cb9c5ee3250 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.270740 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c5f08-1090-4e06-a56c-6cb9c5ee3250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.271038 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c5f08-1090-4e06-a56c-6cb9c5ee3250 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.288578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c5f08-1090-4e06-a56c-6cb9c5ee3250 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:18.295720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-d25c5f08-1090-4e06-a56c-6cb9c5ee3250 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:11:18.302669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 325/652] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:18.304203 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e5393-fa0b-499d-b132-9aba2015b950 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.313806 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e5393-fa0b-499d-b132-9aba2015b950 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.318491 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedb839-2b63-4400-b37e-b899df1f89df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.327368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedb839-2b63-4400-b37e-b899df1f89df admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.327368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedb839-2b63-4400-b37e-b899df1f89df admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.327368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedb839-2b63-4400-b37e-b899df1f89df admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.327368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedb839-2b63-4400-b37e-b899df1f89df admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:18.327368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedb839-2b63-4400-b37e-b899df1f89df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.327368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedb839-2b63-4400-b37e-b899df1f89df admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.335863 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 328/653] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:18.338189 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c5f08-1090-4e06-a56c-6cb9c5ee3250 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.348801 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c5f08-1090-4e06-a56c-6cb9c5ee3250 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.353410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0312901-d546-45f4-9a98-5825124dd3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.354242 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0312901-d546-45f4-9a98-5825124dd3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.354528 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0312901-d546-45f4-9a98-5825124dd3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.354800 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0312901-d546-45f4-9a98-5825124dd3c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.365483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0312901-d546-45f4-9a98-5825124dd3c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.368200 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0312901-d546-45f4-9a98-5825124dd3c9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.385433 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-b0312901-d546-45f4-9a98-5825124dd3c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:18.390259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 326/654] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:18.394128 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedb839-2b63-4400-b37e-b899df1f89df admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.404109 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedb839-2b63-4400-b37e-b899df1f89df admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.408937 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32659250-26ca-4e5d-a895-dfe35d0bad92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.409595 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32659250-26ca-4e5d-a895-dfe35d0bad92 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.409872 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32659250-26ca-4e5d-a895-dfe35d0bad92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.410142 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32659250-26ca-4e5d-a895-dfe35d0bad92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.410870 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32659250-26ca-4e5d-a895-dfe35d0bad92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:18.411233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32659250-26ca-4e5d-a895-dfe35d0bad92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.412919 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32659250-26ca-4e5d-a895-dfe35d0bad92 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.428102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade57c-ad92-4ac2-be0d-a28ace98e780 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.428391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade57c-ad92-4ac2-be0d-a28ace98e780 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.428656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade57c-ad92-4ac2-be0d-a28ace98e780 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.430473 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 329/655] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:18.430585 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 327/656] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:11:18.437293 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1e14d-f4be-415a-bf4e-e2582719e080 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.437568 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade57c-ad92-4ac2-be0d-a28ace98e780 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.437733 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1e14d-f4be-415a-bf4e-e2582719e080 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.437967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1e14d-f4be-415a-bf4e-e2582719e080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.453407 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade57c-ad92-4ac2-be0d-a28ace98e780 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.458705 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c655a-0784-4c3d-893d-ec2394b39185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.459495 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c655a-0784-4c3d-893d-ec2394b39185 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.459813 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c655a-0784-4c3d-893d-ec2394b39185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.460092 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c655a-0784-4c3d-893d-ec2394b39185 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.462305 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-aad1e14d-f4be-415a-bf4e-e2582719e080 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:18.464038 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-aad1e14d-f4be-415a-bf4e-e2582719e080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:18.467986 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c655a-0784-4c3d-893d-ec2394b39185 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.469985 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c655a-0784-4c3d-893d-ec2394b39185 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.480969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 330/657] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:18 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:18.488769 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-8f3c655a-0784-4c3d-893d-ec2394b39185 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 01:11:18.495206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 328/658] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:18.496604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1e14d-f4be-415a-bf4e-e2582719e080 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.506716 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1e14d-f4be-415a-bf4e-e2582719e080 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.511170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05def2b-3b7f-42bc-89e4-e16136e4d0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.511912 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05def2b-3b7f-42bc-89e4-e16136e4d0ab admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.512193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05def2b-3b7f-42bc-89e4-e16136e4d0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.512469 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05def2b-3b7f-42bc-89e4-e16136e4d0ab admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.513320 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05def2b-3b7f-42bc-89e4-e16136e4d0ab admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:18.513623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05def2b-3b7f-42bc-89e4-e16136e4d0ab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.516048 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05def2b-3b7f-42bc-89e4-e16136e4d0ab admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.522345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c655a-0784-4c3d-893d-ec2394b39185 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.533321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c655a-0784-4c3d-893d-ec2394b39185 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.546449 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93266585-cc4d-47a8-84c6-a7b1c9552e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.547350 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93266585-cc4d-47a8-84c6-a7b1c9552e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.547632 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93266585-cc4d-47a8-84c6-a7b1c9552e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.547932 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93266585-cc4d-47a8-84c6-a7b1c9552e5f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.553873 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 331/659] 10.222.0.87 () {56 vars in 1156 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:18.562817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05def2b-3b7f-42bc-89e4-e16136e4d0ab admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.579047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05def2b-3b7f-42bc-89e4-e16136e4d0ab admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.580390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93266585-cc4d-47a8-84c6-a7b1c9552e5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:18.587222 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-93266585-cc4d-47a8-84c6-a7b1c9552e5f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:18.588452 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 329/660] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:18.593104 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7376e-a33e-4253-bd77-68851f053ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.593756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7376e-a33e-4253-bd77-68851f053ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.594032 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7376e-a33e-4253-bd77-68851f053ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.594303 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7376e-a33e-4253-bd77-68851f053ad1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.596191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93266585-cc4d-47a8-84c6-a7b1c9552e5f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.613517 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93266585-cc4d-47a8-84c6-a7b1c9552e5f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.614895 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7376e-a33e-4253-bd77-68851f053ad1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.616664 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7376e-a33e-4253-bd77-68851f053ad1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.627697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 332/661] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:18.634095 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7376e-a33e-4253-bd77-68851f053ad1 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.640683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858e641-c702-4629-84b7-f2718db46ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.641367 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858e641-c702-4629-84b7-f2718db46ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.641643 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858e641-c702-4629-84b7-f2718db46ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.641906 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858e641-c702-4629-84b7-f2718db46ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.642680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858e641-c702-4629-84b7-f2718db46ec2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:18.642983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858e641-c702-4629-84b7-f2718db46ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.644167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7376e-a33e-4253-bd77-68851f053ad1 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.644603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858e641-c702-4629-84b7-f2718db46ec2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.648725 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c96b06-7411-4743-8879-3299247e2de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.649500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c96b06-7411-4743-8879-3299247e2de0 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.649840 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c96b06-7411-4743-8879-3299247e2de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.650113 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c96b06-7411-4743-8879-3299247e2de0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.653551 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 330/662] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:18.659686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858e641-c702-4629-84b7-f2718db46ec2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.662165 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c96b06-7411-4743-8879-3299247e2de0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.664106 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c96b06-7411-4743-8879-3299247e2de0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.673580 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858e641-c702-4629-84b7-f2718db46ec2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.682345 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-b9c96b06-7411-4743-8879-3299247e2de0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:18.687957 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 333/663] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:18.690963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c96b06-7411-4743-8879-3299247e2de0 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.697404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c686ea-84e1-44e9-9498-d86ce4e800dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.698307 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c686ea-84e1-44e9-9498-d86ce4e800dc admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.698583 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c686ea-84e1-44e9-9498-d86ce4e800dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.698849 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c686ea-84e1-44e9-9498-d86ce4e800dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.701901 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c96b06-7411-4743-8879-3299247e2de0 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.707372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8565a01-4de9-4d37-bb19-cb2ffbcc83ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.708012 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8565a01-4de9-4d37-bb19-cb2ffbcc83ec admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.708347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8565a01-4de9-4d37-bb19-cb2ffbcc83ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.708620 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8565a01-4de9-4d37-bb19-cb2ffbcc83ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.709421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8565a01-4de9-4d37-bb19-cb2ffbcc83ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:18.709724 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8565a01-4de9-4d37-bb19-cb2ffbcc83ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.711363 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8565a01-4de9-4d37-bb19-cb2ffbcc83ec admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.721237 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c686ea-84e1-44e9-9498-d86ce4e800dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.723132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c686ea-84e1-44e9-9498-d86ce4e800dc admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.725580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 334/664] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:18.732300 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8565a01-4de9-4d37-bb19-cb2ffbcc83ec admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.743027 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8565a01-4de9-4d37-bb19-cb2ffbcc83ec admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.747536 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a3be5-5cff-4a8b-9ce0-ac209bb0ccfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.748387 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a3be5-5cff-4a8b-9ce0-ac209bb0ccfc admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.748665 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a3be5-5cff-4a8b-9ce0-ac209bb0ccfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.749049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a3be5-5cff-4a8b-9ce0-ac209bb0ccfc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.756366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a3be5-5cff-4a8b-9ce0-ac209bb0ccfc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.757813 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-b5c686ea-84e1-44e9-9498-d86ce4e800dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:18.758376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a3be5-5cff-4a8b-9ce0-ac209bb0ccfc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.759340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 331/665] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:18.765963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c686ea-84e1-44e9-9498-d86ce4e800dc admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.774170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-881a3be5-5cff-4a8b-9ce0-ac209bb0ccfc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:18.779852 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 335/666] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:18.782201 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a3be5-5cff-4a8b-9ce0-ac209bb0ccfc admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.789337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c686ea-84e1-44e9-9498-d86ce4e800dc admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.792711 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a3be5-5cff-4a8b-9ce0-ac209bb0ccfc admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.798381 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe908e8-f88a-4326-a0a7-b37e5a9abadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.799041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe908e8-f88a-4326-a0a7-b37e5a9abadf admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.799372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe908e8-f88a-4326-a0a7-b37e5a9abadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.799655 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe908e8-f88a-4326-a0a7-b37e5a9abadf admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.800557 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe908e8-f88a-4326-a0a7-b37e5a9abadf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:18.800866 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe908e8-f88a-4326-a0a7-b37e5a9abadf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.802873 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe908e8-f88a-4326-a0a7-b37e5a9abadf admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.804446 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81bf67-92dc-445a-9683-9094c422f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.805114 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81bf67-92dc-445a-9683-9094c422f035 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.805388 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81bf67-92dc-445a-9683-9094c422f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.805657 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81bf67-92dc-445a-9683-9094c422f035 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.806399 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81bf67-92dc-445a-9683-9094c422f035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:18.806698 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81bf67-92dc-445a-9683-9094c422f035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.808311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81bf67-92dc-445a-9683-9094c422f035 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.820401 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 336/667] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:18.823239 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe908e8-f88a-4326-a0a7-b37e5a9abadf admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.824939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 332/668] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:18.830953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81bf67-92dc-445a-9683-9094c422f035 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.834061 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe908e8-f88a-4326-a0a7-b37e5a9abadf admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.838905 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b4e1c-595e-4a63-9867-d471de7b77a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.839558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4e1c-595e-4a63-9867-d471de7b77a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.839932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4e1c-595e-4a63-9867-d471de7b77a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.840206 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4e1c-595e-4a63-9867-d471de7b77a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.841117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b4e1c-595e-4a63-9867-d471de7b77a2 admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=7e9153b864b44f5dbbfd6f33ddb253c0) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:18.841425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b4e1c-595e-4a63-9867-d471de7b77a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.843955 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b4e1c-595e-4a63-9867-d471de7b77a2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.854090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81bf67-92dc-445a-9683-9094c422f035 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.855328 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 337/669] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/role_assignments?user.id=7e9153b864b44f5dbbfd6f33ddb253c0&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:18.885734 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47768713-b1be-40bf-bbf4-451788613e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.886565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47768713-b1be-40bf-bbf4-451788613e91 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.886843 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47768713-b1be-40bf-bbf4-451788613e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.887114 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47768713-b1be-40bf-bbf4-451788613e91 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.901412 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47768713-b1be-40bf-bbf4-451788613e91 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.903450 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47768713-b1be-40bf-bbf4-451788613e91 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.922997 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-47768713-b1be-40bf-bbf4-451788613e91 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 01:11:18.929120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 333/670] 10.222.0.87 () {56 vars in 1138 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:18.935807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b4e1c-595e-4a63-9867-d471de7b77a2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.946749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b4e1c-595e-4a63-9867-d471de7b77a2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:18.951459 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b1274-0447-4ca2-bb6e-9e6b7ac68886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:18.952246 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b1274-0447-4ca2-bb6e-9e6b7ac68886 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:18.952606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b1274-0447-4ca2-bb6e-9e6b7ac68886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:18.952782 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b1274-0447-4ca2-bb6e-9e6b7ac68886 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:18.953726 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b1274-0447-4ca2-bb6e-9e6b7ac68886 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:18.954032 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b1274-0447-4ca2-bb6e-9e6b7ac68886 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:18.956086 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b1274-0447-4ca2-bb6e-9e6b7ac68886 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:18.978521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 338/671] 10.222.0.87 () {56 vars in 1170 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:18.984620 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47768713-b1be-40bf-bbf4-451788613e91 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:18.994629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47768713-b1be-40bf-bbf4-451788613e91 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:19.009607 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadd55f-85c4-4c78-a265-1d1cecc6aa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:19.010402 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadd55f-85c4-4c78-a265-1d1cecc6aa4a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:19.010675 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadd55f-85c4-4c78-a265-1d1cecc6aa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:19.010939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadd55f-85c4-4c78-a265-1d1cecc6aa4a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:19.024055 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadd55f-85c4-4c78-a265-1d1cecc6aa4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:19.025914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadd55f-85c4-4c78-a265-1d1cecc6aa4a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:19.054164 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-3eadd55f-85c4-4c78-a265-1d1cecc6aa4a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:19.055424 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 334/672] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:19.062485 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b1274-0447-4ca2-bb6e-9e6b7ac68886 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:19.078181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b1274-0447-4ca2-bb6e-9e6b7ac68886 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:19.087011 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baada9-25b8-487b-b9c5-5b2661ee1a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:19.087890 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baada9-25b8-487b-b9c5-5b2661ee1a67 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:19.088051 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baada9-25b8-487b-b9c5-5b2661ee1a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:19.088242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baada9-25b8-487b-b9c5-5b2661ee1a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:19.088996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51baada9-25b8-487b-b9c5-5b2661ee1a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:19.089299 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51baada9-25b8-487b-b9c5-5b2661ee1a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:19.091026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51baada9-25b8-487b-b9c5-5b2661ee1a67 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:19.113920 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 339/673] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:19.117559 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadd55f-85c4-4c78-a265-1d1cecc6aa4a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:19.131107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadd55f-85c4-4c78-a265-1d1cecc6aa4a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:19.136610 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04881aae-e309-4a68-b2c4-84fb8b0f93c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:19.137391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04881aae-e309-4a68-b2c4-84fb8b0f93c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:19.137668 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04881aae-e309-4a68-b2c4-84fb8b0f93c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:19.137937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04881aae-e309-4a68-b2c4-84fb8b0f93c3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:19.145304 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04881aae-e309-4a68-b2c4-84fb8b0f93c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:19.147236 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04881aae-e309-4a68-b2c4-84fb8b0f93c3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:19.162812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-04881aae-e309-4a68-b2c4-84fb8b0f93c3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:19.164362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 335/674] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:19.170282 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baada9-25b8-487b-b9c5-5b2661ee1a67 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:19.180764 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baada9-25b8-487b-b9c5-5b2661ee1a67 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:19.196396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acbf1d-ac7d-4259-ad14-b433f435025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:19.197372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acbf1d-ac7d-4259-ad14-b433f435025e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:19.197850 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acbf1d-ac7d-4259-ad14-b433f435025e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:19.198312 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acbf1d-ac7d-4259-ad14-b433f435025e admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:19.199343 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acbf1d-ac7d-4259-ad14-b433f435025e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:19.199894 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acbf1d-ac7d-4259-ad14-b433f435025e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:19.202035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acbf1d-ac7d-4259-ad14-b433f435025e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:19.216706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 340/675] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:19.222044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04881aae-e309-4a68-b2c4-84fb8b0f93c3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:19.234157 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04881aae-e309-4a68-b2c4-84fb8b0f93c3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:19.248413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de768c-6f12-49f5-bf16-bbd94461087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:19.249391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de768c-6f12-49f5-bf16-bbd94461087c admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:19.249837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de768c-6f12-49f5-bf16-bbd94461087c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:19.250116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de768c-6f12-49f5-bf16-bbd94461087c admin admin] PATH_INFO: `/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/28ed9da4224549d1a2efd82998c8a500/roles/0811ae5a177643f9b2b86ec5feb7b163` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:19.271571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de768c-6f12-49f5-bf16-bbd94461087c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579ca0c9e3d480ab7b4f64d199c403b, user_id=28ed9da4224549d1a2efd82998c8a500, role_id=0811ae5a177643f9b2b86ec5feb7b163)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:19.274217 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de768c-6f12-49f5-bf16-bbd94461087c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:19.382341 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 336/676] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:11:19 2021] PUT /identity/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/28ed9da4224549d1a2efd82998c8a500/roles/0811ae5a177643f9b2b86ec5feb7b163 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:11:19.510354 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8972be2-129a-4b2d-8f03-8b923d8dc4e9 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:19.511022 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8972be2-129a-4b2d-8f03-8b923d8dc4e9 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:19.511505 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8972be2-129a-4b2d-8f03-8b923d8dc4e9 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:19.513699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 341/677] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:19.520660 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a70a0-c805-4837-87fd-729e0e620304 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:19.520947 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a70a0-c805-4837-87fd-729e0e620304 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:19.521220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a70a0-c805-4837-87fd-729e0e620304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:19.549119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-202a70a0-c805-4837-87fd-729e0e620304 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:19.550354 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-202a70a0-c805-4837-87fd-729e0e620304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:19.631591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 337/678] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:19 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:19.655143 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8972be2-129a-4b2d-8f03-8b923d8dc4e9 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:19.667752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8972be2-129a-4b2d-8f03-8b923d8dc4e9 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:19.672569 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc1f6a-7167-43b5-8453-a958a4666058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:19.673363 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc1f6a-7167-43b5-8453-a958a4666058 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:19.673640 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc1f6a-7167-43b5-8453-a958a4666058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:19.673909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc1f6a-7167-43b5-8453-a958a4666058 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:19.674643 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc1f6a-7167-43b5-8453-a958a4666058 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:19.676347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc1f6a-7167-43b5-8453-a958a4666058 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:19.694749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-4ccc1f6a-7167-43b5-8453-a958a4666058 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 01:11:19.696676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 342/679] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:19 2021] GET /identity/v3/services/network => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:19.703509 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a70a0-c805-4837-87fd-729e0e620304 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:19.716691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a70a0-c805-4837-87fd-729e0e620304 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:19.723941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d5d91-76b7-4568-b1e4-47cee7661883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:19.724615 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5d91-76b7-4568-b1e4-47cee7661883 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:19.724890 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5d91-76b7-4568-b1e4-47cee7661883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:19.725154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5d91-76b7-4568-b1e4-47cee7661883 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:19.725883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d5d91-76b7-4568-b1e4-47cee7661883 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:19.726180 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d5d91-76b7-4568-b1e4-47cee7661883 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:19.727177 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-cf9d5d91-76b7-4568-b1e4-47cee7661883 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:19.727177 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:11:19.727177 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:11:19.728076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d5d91-76b7-4568-b1e4-47cee7661883 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:19.735207 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 338/680] 10.222.0.87 () {56 vars in 1133 bytes} [Fri Oct 29 01:11:19 2021] GET /identity/v3/services?name=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:19.741521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc1f6a-7167-43b5-8453-a958a4666058 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:19.753313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc1f6a-7167-43b5-8453-a958a4666058 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:19.760153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c523a-4702-43ba-970d-32c76c8dea38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:19.760883 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c523a-4702-43ba-970d-32c76c8dea38 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:19.761079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c523a-4702-43ba-970d-32c76c8dea38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:19.761344 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c523a-4702-43ba-970d-32c76c8dea38 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:19.762224 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c523a-4702-43ba-970d-32c76c8dea38 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:19.762525 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c523a-4702-43ba-970d-32c76c8dea38 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:19.764121 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c523a-4702-43ba-970d-32c76c8dea38 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:19.774166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 343/681] 10.222.0.87 () {56 vars in 1133 bytes} [Fri Oct 29 01:11:19 2021] GET /identity/v3/services?type=network => generated 350 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:19.780897 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d5d91-76b7-4568-b1e4-47cee7661883 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:19.797326 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d5d91-76b7-4568-b1e4-47cee7661883 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:19.808380 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e7f37-a2dd-42f6-8b7f-9801fe4ec8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:19.809062 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e7f37-a2dd-42f6-8b7f-9801fe4ec8ad admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:19.809341 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e7f37-a2dd-42f6-8b7f-9801fe4ec8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:19.809610 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e7f37-a2dd-42f6-8b7f-9801fe4ec8ad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:19.810434 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e7f37-a2dd-42f6-8b7f-9801fe4ec8ad admin admin] RBAC: Adding query filter params (interface=public, service_id=0eaa269cb5a540a3a7e043e02892c3f9, region_id=RegionOne) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:19.810742 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e7f37-a2dd-42f6-8b7f-9801fe4ec8ad admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:19.812571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-ca8e7f37-a2dd-42f6-8b7f-9801fe4ec8ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:19.812571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:11:19.812571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:11:19.813561 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e7f37-a2dd-42f6-8b7f-9801fe4ec8ad admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:19.828393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 339/682] 10.222.0.87 () {56 vars in 1272 bytes} [Fri Oct 29 01:11:19 2021] GET /identity/v3/endpoints?service_id=0eaa269cb5a540a3a7e043e02892c3f9&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:19.834037 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c523a-4702-43ba-970d-32c76c8dea38 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:19.848673 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c523a-4702-43ba-970d-32c76c8dea38 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:19.862858 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e192e-fb15-4039-93c4-e3fb80d0a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:19.863526 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e192e-fb15-4039-93c4-e3fb80d0a9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:19.863822 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e192e-fb15-4039-93c4-e3fb80d0a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:19.864090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e192e-fb15-4039-93c4-e3fb80d0a9f9 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:19.864785 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e192e-fb15-4039-93c4-e3fb80d0a9f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:19.881108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e192e-fb15-4039-93c4-e3fb80d0a9f9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:19.886903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 344/683] 10.222.0.87 () {56 vars in 1108 bytes} [Fri Oct 29 01:11:19 2021] GET /identity/v3/services => generated 772 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:20.029736 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cb39a-b0c3-40be-a25d-559fc8b62d9f None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.030137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cb39a-b0c3-40be-a25d-559fc8b62d9f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.030311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cb39a-b0c3-40be-a25d-559fc8b62d9f None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.032695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 340/684] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:20.041585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982019b-b69e-4e9a-8c78-c012aed351c4 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.041909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982019b-b69e-4e9a-8c78-c012aed351c4 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.042110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982019b-b69e-4e9a-8c78-c012aed351c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.065769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-2982019b-b69e-4e9a-8c78-c012aed351c4 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:20.066953 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2982019b-b69e-4e9a-8c78-c012aed351c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:20.080406 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 345/685] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:20 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:20.116909 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cb39a-b0c3-40be-a25d-559fc8b62d9f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.132747 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cb39a-b0c3-40be-a25d-559fc8b62d9f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.140955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af81b43-d40d-422b-829d-369178936334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.141688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af81b43-d40d-422b-829d-369178936334 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.141967 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af81b43-d40d-422b-829d-369178936334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.142240 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af81b43-d40d-422b-829d-369178936334 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.164551 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af81b43-d40d-422b-829d-369178936334 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:20.171841 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-2af81b43-d40d-422b-829d-369178936334 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:11:20.173349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 341/686] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:20.179610 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982019b-b69e-4e9a-8c78-c012aed351c4 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.188882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982019b-b69e-4e9a-8c78-c012aed351c4 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.193206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c7765-6731-48bf-90d1-ac354c795f53 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.194033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c7765-6731-48bf-90d1-ac354c795f53 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.194404 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5c74e-e633-4703-8565-e9f264299035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.194805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c7765-6731-48bf-90d1-ac354c795f53 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.195054 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5c74e-e633-4703-8565-e9f264299035 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.195329 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5c74e-e633-4703-8565-e9f264299035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.195652 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5c74e-e633-4703-8565-e9f264299035 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.196462 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5c74e-e633-4703-8565-e9f264299035 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:20.196763 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5c74e-e633-4703-8565-e9f264299035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.198085 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 342/687] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:20 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:11:20.200416 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5c74e-e633-4703-8565-e9f264299035 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.206752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787735a-4780-4b78-9187-12a378d8c128 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.207779 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787735a-4780-4b78-9187-12a378d8c128 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.208286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787735a-4780-4b78-9187-12a378d8c128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.211092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 346/688] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:20.220870 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5c74e-e633-4703-8565-e9f264299035 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.230861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-3787735a-4780-4b78-9187-12a378d8c128 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:20.232109 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3787735a-4780-4b78-9187-12a378d8c128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:20.235447 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5c74e-e633-4703-8565-e9f264299035 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.241254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdd35a-ff58-4f86-9dc4-1c744ce18abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.241963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 343/689] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:20 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:20.243029 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdd35a-ff58-4f86-9dc4-1c744ce18abe admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.243534 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdd35a-ff58-4f86-9dc4-1c744ce18abe admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.244040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdd35a-ff58-4f86-9dc4-1c744ce18abe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.256838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdd35a-ff58-4f86-9dc4-1c744ce18abe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.258939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdd35a-ff58-4f86-9dc4-1c744ce18abe admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.268068 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787735a-4780-4b78-9187-12a378d8c128 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.277270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-83cdd35a-ff58-4f86-9dc4-1c744ce18abe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:20.278640 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787735a-4780-4b78-9187-12a378d8c128 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.278974 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 347/690] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:20.286280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdd35a-ff58-4f86-9dc4-1c744ce18abe admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.287948 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94711465-eecc-4195-a90c-8b9e178230f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.289088 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94711465-eecc-4195-a90c-8b9e178230f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.289597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94711465-eecc-4195-a90c-8b9e178230f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.290063 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94711465-eecc-4195-a90c-8b9e178230f6 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.290970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94711465-eecc-4195-a90c-8b9e178230f6 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.292215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-94711465-eecc-4195-a90c-8b9e178230f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:20.292215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:11:20.292215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:11:20.293487 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94711465-eecc-4195-a90c-8b9e178230f6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.297750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdd35a-ff58-4f86-9dc4-1c744ce18abe admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.307046 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fe6ff-214d-48c0-a827-67ae5805be99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.308084 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fe6ff-214d-48c0-a827-67ae5805be99 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.308644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fe6ff-214d-48c0-a827-67ae5805be99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.308995 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-94711465-eecc-4195-a90c-8b9e178230f6 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 01:11:20.309318 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fe6ff-214d-48c0-a827-67ae5805be99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.310460 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fe6ff-214d-48c0-a827-67ae5805be99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:20.310563 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 344/691] 10.222.0.87 () {56 vars in 1150 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:20.311040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fe6ff-214d-48c0-a827-67ae5805be99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.313007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fe6ff-214d-48c0-a827-67ae5805be99 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.322729 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94711465-eecc-4195-a90c-8b9e178230f6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.340357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 348/692] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:20.341651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fe6ff-214d-48c0-a827-67ae5805be99 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.345874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94711465-eecc-4195-a90c-8b9e178230f6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.351288 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965270cb-02cd-45c9-94ff-cecd6b3ef306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.352240 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965270cb-02cd-45c9-94ff-cecd6b3ef306 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.352689 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965270cb-02cd-45c9-94ff-cecd6b3ef306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.353170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965270cb-02cd-45c9-94ff-cecd6b3ef306 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.356239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965270cb-02cd-45c9-94ff-cecd6b3ef306 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:20.356239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965270cb-02cd-45c9-94ff-cecd6b3ef306 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.356239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965270cb-02cd-45c9-94ff-cecd6b3ef306 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.361746 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fe6ff-214d-48c0-a827-67ae5805be99 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.364214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 345/693] 10.222.0.87 () {56 vars in 1145 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:20.376103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e48b0b-e6c7-4bfa-ba10-5afd29e2aa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.376103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48b0b-e6c7-4bfa-ba10-5afd29e2aa33 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.376103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48b0b-e6c7-4bfa-ba10-5afd29e2aa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.376103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48b0b-e6c7-4bfa-ba10-5afd29e2aa33 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.377237 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965270cb-02cd-45c9-94ff-cecd6b3ef306 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.383041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e48b0b-e6c7-4bfa-ba10-5afd29e2aa33 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.385488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e48b0b-e6c7-4bfa-ba10-5afd29e2aa33 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.400276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-03e48b0b-e6c7-4bfa-ba10-5afd29e2aa33 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 01:11:20.402032 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 349/694] 10.222.0.87 () {56 vars in 1114 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:20.409866 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e48b0b-e6c7-4bfa-ba10-5afd29e2aa33 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.414544 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965270cb-02cd-45c9-94ff-cecd6b3ef306 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.423471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c57e4-9cea-41b2-b1f8-2ccbfd3a7e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.424723 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c57e4-9cea-41b2-b1f8-2ccbfd3a7e98 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.425942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c57e4-9cea-41b2-b1f8-2ccbfd3a7e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.426883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c57e4-9cea-41b2-b1f8-2ccbfd3a7e98 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.427862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c57e4-9cea-41b2-b1f8-2ccbfd3a7e98 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:20.429618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c57e4-9cea-41b2-b1f8-2ccbfd3a7e98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.431262 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e48b0b-e6c7-4bfa-ba10-5afd29e2aa33 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.433412 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c57e4-9cea-41b2-b1f8-2ccbfd3a7e98 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.441095 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6189e2a-3ceb-48b7-b54f-91bee4723706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.444310 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6189e2a-3ceb-48b7-b54f-91bee4723706 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.444901 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6189e2a-3ceb-48b7-b54f-91bee4723706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.445347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6189e2a-3ceb-48b7-b54f-91bee4723706 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.446631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6189e2a-3ceb-48b7-b54f-91bee4723706 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:20.447969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6189e2a-3ceb-48b7-b54f-91bee4723706 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.449342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 346/695] 10.222.0.87 () {56 vars in 1145 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:20.451700 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6189e2a-3ceb-48b7-b54f-91bee4723706 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.457229 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c57e4-9cea-41b2-b1f8-2ccbfd3a7e98 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.477444 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c57e4-9cea-41b2-b1f8-2ccbfd3a7e98 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.487543 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e082e1-02f7-4b56-8f28-5e3bce8e07d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.489934 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e082e1-02f7-4b56-8f28-5e3bce8e07d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.490362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e082e1-02f7-4b56-8f28-5e3bce8e07d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.490772 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e082e1-02f7-4b56-8f28-5e3bce8e07d3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.491698 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 350/696] 10.222.0.87 () {56 vars in 1154 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:20.492677 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e082e1-02f7-4b56-8f28-5e3bce8e07d3 admin admin] RBAC: Adding query filter params (interface=public, service_id=f24f84fa65b34921a85fb35a18eb0932, region_id=RegionOne) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:20.493226 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e082e1-02f7-4b56-8f28-5e3bce8e07d3 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.494990 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e082e1-02f7-4b56-8f28-5e3bce8e07d3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.503995 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 347/697] 10.222.0.87 () {56 vars in 1272 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/endpoints?service_id=f24f84fa65b34921a85fb35a18eb0932&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:20.504991 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6189e2a-3ceb-48b7-b54f-91bee4723706 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.509246 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e082e1-02f7-4b56-8f28-5e3bce8e07d3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.516534 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6189e2a-3ceb-48b7-b54f-91bee4723706 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.521539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb2cc0-3caf-487b-b6e6-7cd67ba7e157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.522491 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb2cc0-3caf-487b-b6e6-7cd67ba7e157 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.522987 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb2cc0-3caf-487b-b6e6-7cd67ba7e157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.523504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb2cc0-3caf-487b-b6e6-7cd67ba7e157 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.524720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e082e1-02f7-4b56-8f28-5e3bce8e07d3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.533786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb2cc0-3caf-487b-b6e6-7cd67ba7e157 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.535902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb2cc0-3caf-487b-b6e6-7cd67ba7e157 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.541902 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04a28d-0d55-4e0a-8071-9578a087dce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.542558 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04a28d-0d55-4e0a-8071-9578a087dce3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.542850 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04a28d-0d55-4e0a-8071-9578a087dce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.543141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04a28d-0d55-4e0a-8071-9578a087dce3 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.543854 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04a28d-0d55-4e0a-8071-9578a087dce3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.545473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04a28d-0d55-4e0a-8071-9578a087dce3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.547543 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 351/698] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:20.562096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 348/699] 10.222.0.87 () {56 vars in 1108 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/services => generated 772 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:20.565167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb2cc0-3caf-487b-b6e6-7cd67ba7e157 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.575167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb2cc0-3caf-487b-b6e6-7cd67ba7e157 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.580103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047de17f-18bc-49e5-a904-c0bc24267156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.580907 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047de17f-18bc-49e5-a904-c0bc24267156 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.581184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047de17f-18bc-49e5-a904-c0bc24267156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.581449 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047de17f-18bc-49e5-a904-c0bc24267156 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.594012 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047de17f-18bc-49e5-a904-c0bc24267156 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.595950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047de17f-18bc-49e5-a904-c0bc24267156 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.615617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-047de17f-18bc-49e5-a904-c0bc24267156 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:20.617232 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 352/700] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:20.624227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04a28d-0d55-4e0a-8071-9578a087dce3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.641501 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04a28d-0d55-4e0a-8071-9578a087dce3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.652578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3742ff-43c9-4630-9e8c-dd18aed864fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.653734 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3742ff-43c9-4630-9e8c-dd18aed864fe admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.654214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3742ff-43c9-4630-9e8c-dd18aed864fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.654679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3742ff-43c9-4630-9e8c-dd18aed864fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.656564 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3742ff-43c9-4630-9e8c-dd18aed864fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:20.657117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3742ff-43c9-4630-9e8c-dd18aed864fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.659014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3742ff-43c9-4630-9e8c-dd18aed864fe admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.675809 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 349/701] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:20.682311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047de17f-18bc-49e5-a904-c0bc24267156 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.697772 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047de17f-18bc-49e5-a904-c0bc24267156 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.702813 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031c7f1-ac8b-45ef-b34c-7b0beaf2356d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.707881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c7f1-ac8b-45ef-b34c-7b0beaf2356d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.708208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c7f1-ac8b-45ef-b34c-7b0beaf2356d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.708658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c7f1-ac8b-45ef-b34c-7b0beaf2356d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.716510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031c7f1-ac8b-45ef-b34c-7b0beaf2356d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.718889 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031c7f1-ac8b-45ef-b34c-7b0beaf2356d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.741115 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-0031c7f1-ac8b-45ef-b34c-7b0beaf2356d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:20.742678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 353/702] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:20.749792 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3742ff-43c9-4630-9e8c-dd18aed864fe admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.761476 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3742ff-43c9-4630-9e8c-dd18aed864fe admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.773474 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46a5dc-0f01-43e0-82e3-206710825e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.774170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a5dc-0f01-43e0-82e3-206710825e97 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.774454 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a5dc-0f01-43e0-82e3-206710825e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.774731 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a5dc-0f01-43e0-82e3-206710825e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.775546 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46a5dc-0f01-43e0-82e3-206710825e97 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:20.775892 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46a5dc-0f01-43e0-82e3-206710825e97 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.777729 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46a5dc-0f01-43e0-82e3-206710825e97 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.803846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 350/703] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:20.805040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031c7f1-ac8b-45ef-b34c-7b0beaf2356d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:20.822181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031c7f1-ac8b-45ef-b34c-7b0beaf2356d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:20.828346 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a94768-cd3b-4d74-a26e-6121e9ca1a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:20.829004 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a94768-cd3b-4d74-a26e-6121e9ca1a03 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:20.829286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a94768-cd3b-4d74-a26e-6121e9ca1a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:20.829559 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a94768-cd3b-4d74-a26e-6121e9ca1a03 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:20.830462 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a94768-cd3b-4d74-a26e-6121e9ca1a03 admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=28d331f2997547968c51fec87598420f) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:20.830775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a94768-cd3b-4d74-a26e-6121e9ca1a03 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:20.832688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a94768-cd3b-4d74-a26e-6121e9ca1a03 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:20.840918 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 354/704] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:20 2021] GET /identity/v3/role_assignments?user.id=28d331f2997547968c51fec87598420f&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:21.583328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606fff7-ce3b-4a21-a876-4ac8ea436bc5 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:21.584247 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606fff7-ce3b-4a21-a876-4ac8ea436bc5 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:21.584695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606fff7-ce3b-4a21-a876-4ac8ea436bc5 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:21.586841 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 351/705] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:21.602664 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672334b-39e8-4034-bd31-4a4698c4c8d8 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:21.603491 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672334b-39e8-4034-bd31-4a4698c4c8d8 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:21.603944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672334b-39e8-4034-bd31-4a4698c4c8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:21.628750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-1672334b-39e8-4034-bd31-4a4698c4c8d8 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:21.630200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-1672334b-39e8-4034-bd31-4a4698c4c8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:21.638540 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 355/706] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:21 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:21.674880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606fff7-ce3b-4a21-a876-4ac8ea436bc5 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:21.693345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606fff7-ce3b-4a21-a876-4ac8ea436bc5 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:21.698354 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1830c7e-e9b8-4d69-9a7c-0760b86e71fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:21.699296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1830c7e-e9b8-4d69-9a7c-0760b86e71fe admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:21.699721 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1830c7e-e9b8-4d69-9a7c-0760b86e71fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:21.700149 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1830c7e-e9b8-4d69-9a7c-0760b86e71fe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:21.714249 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1830c7e-e9b8-4d69-9a7c-0760b86e71fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:21.721932 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-f1830c7e-e9b8-4d69-9a7c-0760b86e71fe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:11:21.723608 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 352/707] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:21.730019 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672334b-39e8-4034-bd31-4a4698c4c8d8 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:21.744741 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672334b-39e8-4034-bd31-4a4698c4c8d8 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:21.756384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93bb45-1553-4628-aa17-6b4aee664418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:21.757273 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93bb45-1553-4628-aa17-6b4aee664418 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:21.757698 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93bb45-1553-4628-aa17-6b4aee664418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:21.758111 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93bb45-1553-4628-aa17-6b4aee664418 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:21.759016 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93bb45-1553-4628-aa17-6b4aee664418 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:21.759461 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93bb45-1553-4628-aa17-6b4aee664418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:21.761222 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93bb45-1553-4628-aa17-6b4aee664418 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:21.770978 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 356/708] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:21.777514 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1830c7e-e9b8-4d69-9a7c-0760b86e71fe admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:21.792756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1830c7e-e9b8-4d69-9a7c-0760b86e71fe admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:21.800336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055668d9-cf4d-4000-90a8-74e3fea59448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:21.801314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055668d9-cf4d-4000-90a8-74e3fea59448 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:21.801738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055668d9-cf4d-4000-90a8-74e3fea59448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:21.802151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055668d9-cf4d-4000-90a8-74e3fea59448 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:21.814327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055668d9-cf4d-4000-90a8-74e3fea59448 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:21.816394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055668d9-cf4d-4000-90a8-74e3fea59448 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:21.836870 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-055668d9-cf4d-4000-90a8-74e3fea59448 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:21.838282 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 353/709] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:21.846230 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93bb45-1553-4628-aa17-6b4aee664418 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:21.856295 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93bb45-1553-4628-aa17-6b4aee664418 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:21.863877 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016fd8e-6047-48af-b153-a9b09be6172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:21.864736 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016fd8e-6047-48af-b153-a9b09be6172d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:21.865167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016fd8e-6047-48af-b153-a9b09be6172d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:21.865581 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016fd8e-6047-48af-b153-a9b09be6172d admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:21.866478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016fd8e-6047-48af-b153-a9b09be6172d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:21.866931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016fd8e-6047-48af-b153-a9b09be6172d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:21.868704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016fd8e-6047-48af-b153-a9b09be6172d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:21.890981 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 357/710] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:21.897549 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055668d9-cf4d-4000-90a8-74e3fea59448 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:21.916720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055668d9-cf4d-4000-90a8-74e3fea59448 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:21.928377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec091523-620b-4d9d-ba33-e1f8ba34263c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:21.929374 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec091523-620b-4d9d-ba33-e1f8ba34263c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:21.929800 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec091523-620b-4d9d-ba33-e1f8ba34263c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:21.930240 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec091523-620b-4d9d-ba33-e1f8ba34263c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:21.945139 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec091523-620b-4d9d-ba33-e1f8ba34263c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:21.947367 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec091523-620b-4d9d-ba33-e1f8ba34263c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:21.963964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-ec091523-620b-4d9d-ba33-e1f8ba34263c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 01:11:21.965345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 354/711] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:21 2021] GET /identity/v3/users/swift => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:21.973090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016fd8e-6047-48af-b153-a9b09be6172d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:21.989919 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016fd8e-6047-48af-b153-a9b09be6172d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.001203 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58bb39-f081-4a6c-b412-a2e306f1b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.002024 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58bb39-f081-4a6c-b412-a2e306f1b3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.002459 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58bb39-f081-4a6c-b412-a2e306f1b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.002924 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58bb39-f081-4a6c-b412-a2e306f1b3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.003980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58bb39-f081-4a6c-b412-a2e306f1b3d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:22.004396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58bb39-f081-4a6c-b412-a2e306f1b3d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.006442 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58bb39-f081-4a6c-b412-a2e306f1b3d3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.039492 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 358/712] 10.222.0.87 () {56 vars in 1156 bytes} [Fri Oct 29 01:11:21 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:22.046694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec091523-620b-4d9d-ba33-e1f8ba34263c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.065205 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec091523-620b-4d9d-ba33-e1f8ba34263c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.077656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d0002-02cb-48d9-ae53-f38488842534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.078798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d0002-02cb-48d9-ae53-f38488842534 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.079253 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d0002-02cb-48d9-ae53-f38488842534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.079669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d0002-02cb-48d9-ae53-f38488842534 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.102058 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d0002-02cb-48d9-ae53-f38488842534 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.104284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d0002-02cb-48d9-ae53-f38488842534 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.129743 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-cb4d0002-02cb-48d9-ae53-f38488842534 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:22.131499 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 355/713] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:22.137720 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58bb39-f081-4a6c-b412-a2e306f1b3d3 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.159836 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58bb39-f081-4a6c-b412-a2e306f1b3d3 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.172406 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef57b2-4a46-4363-ac89-f40e63b8aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.173222 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef57b2-4a46-4363-ac89-f40e63b8aea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.173822 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef57b2-4a46-4363-ac89-f40e63b8aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.174205 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef57b2-4a46-4363-ac89-f40e63b8aea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.175113 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef57b2-4a46-4363-ac89-f40e63b8aea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:22.175530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef57b2-4a46-4363-ac89-f40e63b8aea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.177304 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef57b2-4a46-4363-ac89-f40e63b8aea1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.199570 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 359/714] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:22.207439 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d0002-02cb-48d9-ae53-f38488842534 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.221490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d0002-02cb-48d9-ae53-f38488842534 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.231966 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c77660-bf3b-4ea1-b692-b846ac7a134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.233504 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c77660-bf3b-4ea1-b692-b846ac7a134f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.233955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c77660-bf3b-4ea1-b692-b846ac7a134f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.234378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c77660-bf3b-4ea1-b692-b846ac7a134f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.253128 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e83d-a31e-452c-abae-131d52bdfbfd None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.254714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c77660-bf3b-4ea1-b692-b846ac7a134f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.255898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e83d-a31e-452c-abae-131d52bdfbfd None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.256305 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e83d-a31e-452c-abae-131d52bdfbfd None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.257563 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c77660-bf3b-4ea1-b692-b846ac7a134f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.259760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 360/715] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:22 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:22.274534 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812439b-c641-492c-9c2c-20a647a8d5ba None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.274982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812439b-c641-492c-9c2c-20a647a8d5ba None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.275369 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812439b-c641-492c-9c2c-20a647a8d5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.279875 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-62c77660-bf3b-4ea1-b692-b846ac7a134f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:22.281887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 356/716] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:22.288763 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c77660-bf3b-4ea1-b692-b846ac7a134f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.300063 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-9812439b-c641-492c-9c2c-20a647a8d5ba None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:22.302000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9812439b-c641-492c-9c2c-20a647a8d5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:22.304761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c77660-bf3b-4ea1-b692-b846ac7a134f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.312990 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 361/717] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:22 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:22.316751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198c8e9-427f-4554-8cda-2445607cefbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.316751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198c8e9-427f-4554-8cda-2445607cefbd admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.316751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198c8e9-427f-4554-8cda-2445607cefbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.316751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198c8e9-427f-4554-8cda-2445607cefbd admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.317153 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198c8e9-427f-4554-8cda-2445607cefbd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:22.317153 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198c8e9-427f-4554-8cda-2445607cefbd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.319299 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198c8e9-427f-4554-8cda-2445607cefbd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.332603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 357/718] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:22.339275 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812439b-c641-492c-9c2c-20a647a8d5ba None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.350129 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812439b-c641-492c-9c2c-20a647a8d5ba None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.362579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9ffda-886e-4856-9df1-46a97cadcc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.362579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9ffda-886e-4856-9df1-46a97cadcc8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.362579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9ffda-886e-4856-9df1-46a97cadcc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.362579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9ffda-886e-4856-9df1-46a97cadcc8d admin admin] PATH_INFO: `/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/7e9153b864b44f5dbbfd6f33ddb253c0/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.363017 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198c8e9-427f-4554-8cda-2445607cefbd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.363249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9ffda-886e-4856-9df1-46a97cadcc8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579ca0c9e3d480ab7b4f64d199c403b, user_id=7e9153b864b44f5dbbfd6f33ddb253c0, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.366061 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9ffda-886e-4856-9df1-46a97cadcc8d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.373735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198c8e9-427f-4554-8cda-2445607cefbd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.380184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87da54-0008-45ed-a2a1-b13dbce23c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.381087 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87da54-0008-45ed-a2a1-b13dbce23c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.381427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87da54-0008-45ed-a2a1-b13dbce23c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.381705 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87da54-0008-45ed-a2a1-b13dbce23c14 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.395599 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87da54-0008-45ed-a2a1-b13dbce23c14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:22.403085 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-1f87da54-0008-45ed-a2a1-b13dbce23c14 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:11:22.404688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 358/719] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:22.411720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87da54-0008-45ed-a2a1-b13dbce23c14 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.422685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87da54-0008-45ed-a2a1-b13dbce23c14 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.427165 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12d6fd-57c0-4bfb-a22a-00e35b8c4ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.427968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12d6fd-57c0-4bfb-a22a-00e35b8c4ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.428314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12d6fd-57c0-4bfb-a22a-00e35b8c4ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.428646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12d6fd-57c0-4bfb-a22a-00e35b8c4ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.429555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12d6fd-57c0-4bfb-a22a-00e35b8c4ad0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:22.429860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12d6fd-57c0-4bfb-a22a-00e35b8c4ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.431418 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12d6fd-57c0-4bfb-a22a-00e35b8c4ad0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.440584 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 359/720] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:22.446913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12d6fd-57c0-4bfb-a22a-00e35b8c4ad0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.457617 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12d6fd-57c0-4bfb-a22a-00e35b8c4ad0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.462387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22726a0e-2176-49c4-97d0-dc3930a87b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.463163 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726a0e-2176-49c4-97d0-dc3930a87b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.465595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726a0e-2176-49c4-97d0-dc3930a87b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.465595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726a0e-2176-49c4-97d0-dc3930a87b55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.474913 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 362/721] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:11:22 2021] PUT /identity/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/7e9153b864b44f5dbbfd6f33ddb253c0/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:11:22.475683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22726a0e-2176-49c4-97d0-dc3930a87b55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.477863 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22726a0e-2176-49c4-97d0-dc3930a87b55 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.496949 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-22726a0e-2176-49c4-97d0-dc3930a87b55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:22.502722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 360/722] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:22.506114 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9ffda-886e-4856-9df1-46a97cadcc8d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.591471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9ffda-886e-4856-9df1-46a97cadcc8d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.601624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdce81-043c-4d16-bb1c-b11e82c88a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.602297 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdce81-043c-4d16-bb1c-b11e82c88a31 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.602573 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdce81-043c-4d16-bb1c-b11e82c88a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.602898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdce81-043c-4d16-bb1c-b11e82c88a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.603638 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdce81-043c-4d16-bb1c-b11e82c88a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:22.603959 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdce81-043c-4d16-bb1c-b11e82c88a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.605527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdce81-043c-4d16-bb1c-b11e82c88a31 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.620976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 363/723] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:22.627168 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22726a0e-2176-49c4-97d0-dc3930a87b55 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.640150 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22726a0e-2176-49c4-97d0-dc3930a87b55 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.646956 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c36702-6803-47db-b259-d6563689c899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.647868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c36702-6803-47db-b259-d6563689c899 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.648145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c36702-6803-47db-b259-d6563689c899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.648409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c36702-6803-47db-b259-d6563689c899 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.661209 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c36702-6803-47db-b259-d6563689c899 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.663324 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c36702-6803-47db-b259-d6563689c899 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.684332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-50c36702-6803-47db-b259-d6563689c899 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 01:11:22.686018 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 361/724] 10.222.0.87 () {56 vars in 1138 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:22.693249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdce81-043c-4d16-bb1c-b11e82c88a31 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.704628 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdce81-043c-4d16-bb1c-b11e82c88a31 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.709551 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d20d02-068f-46d1-bc6a-f7d927eb2dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.710286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20d02-068f-46d1-bc6a-f7d927eb2dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.710561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20d02-068f-46d1-bc6a-f7d927eb2dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.710830 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20d02-068f-46d1-bc6a-f7d927eb2dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.711948 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d20d02-068f-46d1-bc6a-f7d927eb2dd2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:22.712258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d20d02-068f-46d1-bc6a-f7d927eb2dd2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.714211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d20d02-068f-46d1-bc6a-f7d927eb2dd2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.739846 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 364/725] 10.222.0.87 () {56 vars in 1170 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:22.746114 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c36702-6803-47db-b259-d6563689c899 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.755184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081facb6-4888-4a26-86cc-3a475e8af6f7 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.755524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081facb6-4888-4a26-86cc-3a475e8af6f7 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.755697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081facb6-4888-4a26-86cc-3a475e8af6f7 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.759669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c36702-6803-47db-b259-d6563689c899 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.760784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 365/726] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:22 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:22.769754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b76642-e4ce-49fb-a440-fd57a07f5d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.770508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b76642-e4ce-49fb-a440-fd57a07f5d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.770784 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b76642-e4ce-49fb-a440-fd57a07f5d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.771056 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b76642-e4ce-49fb-a440-fd57a07f5d88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.775857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fb4d9-9a01-494a-9a2b-f16fd13b5f06 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.775857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fb4d9-9a01-494a-9a2b-f16fd13b5f06 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.775857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fb4d9-9a01-494a-9a2b-f16fd13b5f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.781733 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b76642-e4ce-49fb-a440-fd57a07f5d88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.787754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b76642-e4ce-49fb-a440-fd57a07f5d88 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.800171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 362/727] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:22.806266 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b76642-e4ce-49fb-a440-fd57a07f5d88 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.809162 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ed9fb4d9-9a01-494a-9a2b-f16fd13b5f06 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:22.810958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ed9fb4d9-9a01-494a-9a2b-f16fd13b5f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:22.815972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b76642-e4ce-49fb-a440-fd57a07f5d88 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.822297 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d562c-bff2-4ddf-840f-424a31a26a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.823138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d562c-bff2-4ddf-840f-424a31a26a2c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.823374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 366/728] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:22 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:22.823491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d562c-bff2-4ddf-840f-424a31a26a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.823648 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d562c-bff2-4ddf-840f-424a31a26a2c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.839130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d562c-bff2-4ddf-840f-424a31a26a2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.841283 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d562c-bff2-4ddf-840f-424a31a26a2c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.855798 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fb4d9-9a01-494a-9a2b-f16fd13b5f06 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.864815 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-7a6d562c-bff2-4ddf-840f-424a31a26a2c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:22.866731 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 363/729] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:22.868818 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fb4d9-9a01-494a-9a2b-f16fd13b5f06 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.877101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d562c-bff2-4ddf-840f-424a31a26a2c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.878871 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2942c-aa7e-4042-8556-b269d77811e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.879958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2942c-aa7e-4042-8556-b269d77811e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.880436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2942c-aa7e-4042-8556-b269d77811e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.880913 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2942c-aa7e-4042-8556-b269d77811e9 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.881851 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2942c-aa7e-4042-8556-b269d77811e9 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.884637 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2942c-aa7e-4042-8556-b269d77811e9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.887643 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d562c-bff2-4ddf-840f-424a31a26a2c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.893582 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bfb5c-082b-45c2-b88f-508717e84581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.894479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bfb5c-082b-45c2-b88f-508717e84581 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.894969 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bfb5c-082b-45c2-b88f-508717e84581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.895469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bfb5c-082b-45c2-b88f-508717e84581 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.896457 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bfb5c-082b-45c2-b88f-508717e84581 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:22.896979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bfb5c-082b-45c2-b88f-508717e84581 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.897641 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-23e2942c-aa7e-4042-8556-b269d77811e9 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 01:11:22.898971 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bfb5c-082b-45c2-b88f-508717e84581 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.904034 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 367/730] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/services/network => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:22.908706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2942c-aa7e-4042-8556-b269d77811e9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.915565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 364/731] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:22.920604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2942c-aa7e-4042-8556-b269d77811e9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.923364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bfb5c-082b-45c2-b88f-508717e84581 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.926520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209d3d8-7ef4-4aae-982e-4da4c8ad3bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.927326 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209d3d8-7ef4-4aae-982e-4da4c8ad3bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.927798 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209d3d8-7ef4-4aae-982e-4da4c8ad3bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.928234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209d3d8-7ef4-4aae-982e-4da4c8ad3bb2 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.929393 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209d3d8-7ef4-4aae-982e-4da4c8ad3bb2 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:22.929887 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209d3d8-7ef4-4aae-982e-4da4c8ad3bb2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.931624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209d3d8-7ef4-4aae-982e-4da4c8ad3bb2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.937828 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bfb5c-082b-45c2-b88f-508717e84581 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.938110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 368/732] 10.222.0.87 () {56 vars in 1133 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/services?name=network => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:22.944992 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209d3d8-7ef4-4aae-982e-4da4c8ad3bb2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.949806 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02370-2452-43dd-842e-32e9a7e003f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.950778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02370-2452-43dd-842e-32e9a7e003f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.951130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02370-2452-43dd-842e-32e9a7e003f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.951472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02370-2452-43dd-842e-32e9a7e003f6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.957129 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209d3d8-7ef4-4aae-982e-4da4c8ad3bb2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:22.962351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f8859-7a97-4c2a-9b99-ab93b10dcc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:22.963411 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f8859-7a97-4c2a-9b99-ab93b10dcc7d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:22.963929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f8859-7a97-4c2a-9b99-ab93b10dcc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:22.964414 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f8859-7a97-4c2a-9b99-ab93b10dcc7d admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:22.965327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f8859-7a97-4c2a-9b99-ab93b10dcc7d admin admin] RBAC: Adding query filter params (type=network) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:22.965845 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f8859-7a97-4c2a-9b99-ab93b10dcc7d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.968208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f8859-7a97-4c2a-9b99-ab93b10dcc7d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.969587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d02370-2452-43dd-842e-32e9a7e003f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:22.971562 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d02370-2452-43dd-842e-32e9a7e003f6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:22.974906 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 369/733] 10.222.0.87 () {56 vars in 1133 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/services?type=network => generated 350 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:22.981922 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f8859-7a97-4c2a-9b99-ab93b10dcc7d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:22.998260 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f8859-7a97-4c2a-9b99-ab93b10dcc7d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:23.001228 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-f6d02370-2452-43dd-842e-32e9a7e003f6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:23.003518 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 365/734] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:23.009469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02370-2452-43dd-842e-32e9a7e003f6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:23.017416 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20149997-088d-4839-b016-d4ceefcda691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:23.018654 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20149997-088d-4839-b016-d4ceefcda691 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:23.019133 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20149997-088d-4839-b016-d4ceefcda691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:23.019610 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20149997-088d-4839-b016-d4ceefcda691 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:23.020108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02370-2452-43dd-842e-32e9a7e003f6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:23.020946 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20149997-088d-4839-b016-d4ceefcda691 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:23.022345 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-20149997-088d-4839-b016-d4ceefcda691 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:23.022345 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:11:23.022345 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:11:23.023654 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20149997-088d-4839-b016-d4ceefcda691 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:23.025279 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e9707-b51a-4a24-8898-95a79a94ad21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:23.025989 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e9707-b51a-4a24-8898-95a79a94ad21 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:23.026271 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e9707-b51a-4a24-8898-95a79a94ad21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:23.031753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e9707-b51a-4a24-8898-95a79a94ad21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:23.031753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e9707-b51a-4a24-8898-95a79a94ad21 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:23.031753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e9707-b51a-4a24-8898-95a79a94ad21 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:23.031753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e9707-b51a-4a24-8898-95a79a94ad21 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:23.044552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 366/735] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:23.052144 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e9707-b51a-4a24-8898-95a79a94ad21 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:23.063176 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e9707-b51a-4a24-8898-95a79a94ad21 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:23.068217 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6acb17-2163-4137-80ed-a87068d8c0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:23.069170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6acb17-2163-4137-80ed-a87068d8c0ef admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:23.069456 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6acb17-2163-4137-80ed-a87068d8c0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:23.069734 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6acb17-2163-4137-80ed-a87068d8c0ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:23.070630 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6acb17-2163-4137-80ed-a87068d8c0ef admin admin] RBAC: Adding query filter params (role.id=0811ae5a177643f9b2b86ec5feb7b163, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=28ed9da4224549d1a2efd82998c8a500) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:23.070952 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6acb17-2163-4137-80ed-a87068d8c0ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:23.072975 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6acb17-2163-4137-80ed-a87068d8c0ef admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:23.080050 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 367/736] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:23 2021] GET /identity/v3/role_assignments?user.id=28ed9da4224549d1a2efd82998c8a500&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=0811ae5a177643f9b2b86ec5feb7b163 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:23.165669 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 370/737] 10.222.0.87 () {60 vars in 1165 bytes} [Fri Oct 29 01:11:22 2021] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:11:23.664768 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab16b0-8d56-4610-82e2-f3bbf4badd9d None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:23.665874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab16b0-8d56-4610-82e2-f3bbf4badd9d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:23.666364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab16b0-8d56-4610-82e2-f3bbf4badd9d None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:23.668685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 368/738] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:23.675557 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882308-2dfb-4343-82cd-7def2225ca04 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:23.676440 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882308-2dfb-4343-82cd-7def2225ca04 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:23.676998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882308-2dfb-4343-82cd-7def2225ca04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:23.695416 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ea882308-2dfb-4343-82cd-7def2225ca04 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:23.696957 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ea882308-2dfb-4343-82cd-7def2225ca04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:23.719838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 371/739] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:23 2021] POST /identity/v3/auth/tokens => generated 1419 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:23.740976 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab16b0-8d56-4610-82e2-f3bbf4badd9d None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:23.754254 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab16b0-8d56-4610-82e2-f3bbf4badd9d None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:23.759010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7c10a-77b3-4b49-94f4-acc5df2d82dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:23.760069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7c10a-77b3-4b49-94f4-acc5df2d82dd admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:23.760564 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7c10a-77b3-4b49-94f4-acc5df2d82dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:23.761031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7c10a-77b3-4b49-94f4-acc5df2d82dd admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:23.761912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7c10a-77b3-4b49-94f4-acc5df2d82dd admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:23.763784 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7c10a-77b3-4b49-94f4-acc5df2d82dd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:23.775908 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-c6f7c10a-77b3-4b49-94f4-acc5df2d82dd admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 01:11:23.782938 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 369/740] 10.222.0.87 () {56 vars in 1150 bytes} [Fri Oct 29 01:11:23 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:23.784560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea882308-2dfb-4343-82cd-7def2225ca04 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:23.793967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea882308-2dfb-4343-82cd-7def2225ca04 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:23.799408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eef78c-82c4-4ac5-a6c2-d38fc57a6bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:23.800324 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eef78c-82c4-4ac5-a6c2-d38fc57a6bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:23.800807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eef78c-82c4-4ac5-a6c2-d38fc57a6bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:23.801298 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eef78c-82c4-4ac5-a6c2-d38fc57a6bd6 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:23.802226 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eef78c-82c4-4ac5-a6c2-d38fc57a6bd6 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:23.802736 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eef78c-82c4-4ac5-a6c2-d38fc57a6bd6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:23.804598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eef78c-82c4-4ac5-a6c2-d38fc57a6bd6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:23.815225 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 372/741] 10.222.0.87 () {56 vars in 1145 bytes} [Fri Oct 29 01:11:23 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:23.816835 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7c10a-77b3-4b49-94f4-acc5df2d82dd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:23.828058 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7c10a-77b3-4b49-94f4-acc5df2d82dd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:23.833161 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae78a92-3633-465f-9c64-1f9af66f808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:23.834045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae78a92-3633-465f-9c64-1f9af66f808a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:23.834542 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae78a92-3633-465f-9c64-1f9af66f808a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:23.835015 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae78a92-3633-465f-9c64-1f9af66f808a admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:23.835979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae78a92-3633-465f-9c64-1f9af66f808a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:23.836484 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae78a92-3633-465f-9c64-1f9af66f808a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:23.838312 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae78a92-3633-465f-9c64-1f9af66f808a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:23.849705 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 370/742] 10.222.0.87 () {56 vars in 1145 bytes} [Fri Oct 29 01:11:23 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:23.851268 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eef78c-82c4-4ac5-a6c2-d38fc57a6bd6 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:23.861757 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eef78c-82c4-4ac5-a6c2-d38fc57a6bd6 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:23.867163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55d1a2-5cb3-49b7-8a14-c690f4512210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:23.868156 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55d1a2-5cb3-49b7-8a14-c690f4512210 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:23.868644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55d1a2-5cb3-49b7-8a14-c690f4512210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:23.869114 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55d1a2-5cb3-49b7-8a14-c690f4512210 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:23.870097 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55d1a2-5cb3-49b7-8a14-c690f4512210 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:23.874040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55d1a2-5cb3-49b7-8a14-c690f4512210 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:24.016055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 373/743] 10.222.0.87 () {60 vars in 1165 bytes} [Fri Oct 29 01:11:23 2021] POST /identity/v3/endpoints => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:24.039391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9158f-16ea-4fbf-9e9c-678992cab711 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:24.039748 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9158f-16ea-4fbf-9e9c-678992cab711 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:24.039990 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9158f-16ea-4fbf-9e9c-678992cab711 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:24.042144 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 371/744] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:24.049463 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8e517-ed8a-4693-a299-2988e3326583 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:24.049748 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8e517-ed8a-4693-a299-2988e3326583 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:24.050023 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8e517-ed8a-4693-a299-2988e3326583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:24.070647 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-37d8e517-ed8a-4693-a299-2988e3326583 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:24.072028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-37d8e517-ed8a-4693-a299-2988e3326583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:24.091690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 374/745] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:24 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:24.115568 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9158f-16ea-4fbf-9e9c-678992cab711 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:24.129243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9158f-16ea-4fbf-9e9c-678992cab711 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:24.134017 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872b52c-2122-442f-8361-869872fbd032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:24.134893 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872b52c-2122-442f-8361-869872fbd032 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:24.135177 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872b52c-2122-442f-8361-869872fbd032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:24.135452 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872b52c-2122-442f-8361-869872fbd032 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:24.136280 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872b52c-2122-442f-8361-869872fbd032 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:24.137995 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872b52c-2122-442f-8361-869872fbd032 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:24.152161 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-2872b52c-2122-442f-8361-869872fbd032 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 01:11:24.153860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 372/746] 10.222.0.87 () {56 vars in 1153 bytes} [Fri Oct 29 01:11:24 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:24.161048 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8e517-ed8a-4693-a299-2988e3326583 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:24.170984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8e517-ed8a-4693-a299-2988e3326583 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:24.176073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99532bc2-270d-4f6a-81c9-6594abf3401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:24.176745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99532bc2-270d-4f6a-81c9-6594abf3401f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:24.177022 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99532bc2-270d-4f6a-81c9-6594abf3401f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:24.177293 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99532bc2-270d-4f6a-81c9-6594abf3401f admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:24.178025 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99532bc2-270d-4f6a-81c9-6594abf3401f admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:24.178381 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99532bc2-270d-4f6a-81c9-6594abf3401f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:24.180125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99532bc2-270d-4f6a-81c9-6594abf3401f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:24.186639 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 375/747] 10.222.0.87 () {56 vars in 1147 bytes} [Fri Oct 29 01:11:24 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:24.192860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872b52c-2122-442f-8361-869872fbd032 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:24.204326 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872b52c-2122-442f-8361-869872fbd032 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:24.209309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5369ed7-0939-437e-bc3a-605cdc5777ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:24.209983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5369ed7-0939-437e-bc3a-605cdc5777ed admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:24.210316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5369ed7-0939-437e-bc3a-605cdc5777ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:24.210587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5369ed7-0939-437e-bc3a-605cdc5777ed admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:24.211368 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5369ed7-0939-437e-bc3a-605cdc5777ed admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:24.211680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5369ed7-0939-437e-bc3a-605cdc5777ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:24.213447 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5369ed7-0939-437e-bc3a-605cdc5777ed admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:24.220298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 373/748] 10.222.0.87 () {56 vars in 1147 bytes} [Fri Oct 29 01:11:24 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:25.055966 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49592156-434f-4bb2-90a1-8807142b0ff2 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.056524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49592156-434f-4bb2-90a1-8807142b0ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.056524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49592156-434f-4bb2-90a1-8807142b0ff2 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.058506 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 376/749] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:25.064696 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210d8f-b445-4503-b78f-da3713999eb0 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.065209 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210d8f-b445-4503-b78f-da3713999eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.065209 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210d8f-b445-4503-b78f-da3713999eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.083348 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-57210d8f-b445-4503-b78f-da3713999eb0 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:25.084673 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-57210d8f-b445-4503-b78f-da3713999eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:25.094225 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 374/750] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:25 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:25.120801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49592156-434f-4bb2-90a1-8807142b0ff2 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.133240 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49592156-434f-4bb2-90a1-8807142b0ff2 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.137982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beed6e5-6675-4ecb-9202-3104b566be2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.138997 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beed6e5-6675-4ecb-9202-3104b566be2e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.139519 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beed6e5-6675-4ecb-9202-3104b566be2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.140024 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beed6e5-6675-4ecb-9202-3104b566be2e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.150965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beed6e5-6675-4ecb-9202-3104b566be2e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:25.158802 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-7beed6e5-6675-4ecb-9202-3104b566be2e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:11:25.160606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 377/751] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:25.167208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57210d8f-b445-4503-b78f-da3713999eb0 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.177278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57210d8f-b445-4503-b78f-da3713999eb0 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.182175 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f1c6b-b5eb-44ef-904f-28f3c16ed604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.183092 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f1c6b-b5eb-44ef-904f-28f3c16ed604 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.183568 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f1c6b-b5eb-44ef-904f-28f3c16ed604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.184068 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f1c6b-b5eb-44ef-904f-28f3c16ed604 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.185038 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f1c6b-b5eb-44ef-904f-28f3c16ed604 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:25.185550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f1c6b-b5eb-44ef-904f-28f3c16ed604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:25.187364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f1c6b-b5eb-44ef-904f-28f3c16ed604 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:25.197016 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 375/752] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:25.204254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beed6e5-6675-4ecb-9202-3104b566be2e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.214807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beed6e5-6675-4ecb-9202-3104b566be2e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.220089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd344aa-7981-492b-ba45-b8a1d4292c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.221120 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd344aa-7981-492b-ba45-b8a1d4292c1f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.221608 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd344aa-7981-492b-ba45-b8a1d4292c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.222072 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd344aa-7981-492b-ba45-b8a1d4292c1f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.233619 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd344aa-7981-492b-ba45-b8a1d4292c1f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:25.235828 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd344aa-7981-492b-ba45-b8a1d4292c1f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:25.253696 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-4cd344aa-7981-492b-ba45-b8a1d4292c1f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:25.255487 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 378/753] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:25.262095 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f1c6b-b5eb-44ef-904f-28f3c16ed604 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.272695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f1c6b-b5eb-44ef-904f-28f3c16ed604 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.277834 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4231ba9-da1c-4c03-a260-8d8c1901d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.278891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4231ba9-da1c-4c03-a260-8d8c1901d0ef admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.279378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4231ba9-da1c-4c03-a260-8d8c1901d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.279933 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4231ba9-da1c-4c03-a260-8d8c1901d0ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.281060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4231ba9-da1c-4c03-a260-8d8c1901d0ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:25.281590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4231ba9-da1c-4c03-a260-8d8c1901d0ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:25.283550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4231ba9-da1c-4c03-a260-8d8c1901d0ef admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:25.298017 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 376/754] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:25.304456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd344aa-7981-492b-ba45-b8a1d4292c1f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.315550 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd344aa-7981-492b-ba45-b8a1d4292c1f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.320566 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75f416-aaaa-4217-819d-e5e9baee1cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.328154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75f416-aaaa-4217-819d-e5e9baee1cef admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.328154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75f416-aaaa-4217-819d-e5e9baee1cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.328154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75f416-aaaa-4217-819d-e5e9baee1cef admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.329986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75f416-aaaa-4217-819d-e5e9baee1cef admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:25.332025 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75f416-aaaa-4217-819d-e5e9baee1cef admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:25.347456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-1e75f416-aaaa-4217-819d-e5e9baee1cef admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 01:11:25.349117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 379/755] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:25.355067 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4231ba9-da1c-4c03-a260-8d8c1901d0ef admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.371887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4231ba9-da1c-4c03-a260-8d8c1901d0ef admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.376866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5091626-933c-4468-99bf-e737a9f2f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.377539 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5091626-933c-4468-99bf-e737a9f2f2ee admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.377822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5091626-933c-4468-99bf-e737a9f2f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.378095 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5091626-933c-4468-99bf-e737a9f2f2ee admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.379016 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5091626-933c-4468-99bf-e737a9f2f2ee admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:25.379322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5091626-933c-4468-99bf-e737a9f2f2ee admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:25.381425 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5091626-933c-4468-99bf-e737a9f2f2ee admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:25.400556 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 377/756] 10.222.0.87 () {56 vars in 1156 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:25.407386 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75f416-aaaa-4217-819d-e5e9baee1cef admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.417568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75f416-aaaa-4217-819d-e5e9baee1cef admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.422890 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13e918-1256-47a4-857f-6b9fcd89c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.423603 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13e918-1256-47a4-857f-6b9fcd89c7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.423929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13e918-1256-47a4-857f-6b9fcd89c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.424199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13e918-1256-47a4-857f-6b9fcd89c7d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.433531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13e918-1256-47a4-857f-6b9fcd89c7d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:25.435408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13e918-1256-47a4-857f-6b9fcd89c7d9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:25.445960 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 380/757] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:25.452964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5091626-933c-4468-99bf-e737a9f2f2ee admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.462974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5091626-933c-4468-99bf-e737a9f2f2ee admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.467837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c33f0-b8be-4b74-b6d4-72e58039e74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.468843 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c33f0-b8be-4b74-b6d4-72e58039e74c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.469122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c33f0-b8be-4b74-b6d4-72e58039e74c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.469394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c33f0-b8be-4b74-b6d4-72e58039e74c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.480281 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c33f0-b8be-4b74-b6d4-72e58039e74c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:25.482223 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c33f0-b8be-4b74-b6d4-72e58039e74c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:25.503653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-4f7c33f0-b8be-4b74-b6d4-72e58039e74c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:25.505349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 378/758] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:25.511121 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13e918-1256-47a4-857f-6b9fcd89c7d9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.520242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13e918-1256-47a4-857f-6b9fcd89c7d9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.524979 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54b1e8-aa2b-4a10-9780-5bdece701143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.525627 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54b1e8-aa2b-4a10-9780-5bdece701143 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.525902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54b1e8-aa2b-4a10-9780-5bdece701143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.526169 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54b1e8-aa2b-4a10-9780-5bdece701143 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.526897 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54b1e8-aa2b-4a10-9780-5bdece701143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:25.527193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54b1e8-aa2b-4a10-9780-5bdece701143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:25.528782 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54b1e8-aa2b-4a10-9780-5bdece701143 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:25.540813 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 381/759] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:25.547676 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c33f0-b8be-4b74-b6d4-72e58039e74c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.557669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c33f0-b8be-4b74-b6d4-72e58039e74c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.563132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c045b5-ee0c-446d-8ea0-59b4b3f563d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.563999 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c045b5-ee0c-446d-8ea0-59b4b3f563d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.564278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c045b5-ee0c-446d-8ea0-59b4b3f563d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.564602 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c045b5-ee0c-446d-8ea0-59b4b3f563d8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.572600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c045b5-ee0c-446d-8ea0-59b4b3f563d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:25.574629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c045b5-ee0c-446d-8ea0-59b4b3f563d8 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:25.587837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-e9c045b5-ee0c-446d-8ea0-59b4b3f563d8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:25.589348 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 379/760] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:25.596380 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54b1e8-aa2b-4a10-9780-5bdece701143 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.606403 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54b1e8-aa2b-4a10-9780-5bdece701143 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.611326 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14fbb1-61a9-4ca7-a60c-affc7ae60844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.612061 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14fbb1-61a9-4ca7-a60c-affc7ae60844 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.612338 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14fbb1-61a9-4ca7-a60c-affc7ae60844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.612658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14fbb1-61a9-4ca7-a60c-affc7ae60844 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.613465 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14fbb1-61a9-4ca7-a60c-affc7ae60844 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:25.613807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14fbb1-61a9-4ca7-a60c-affc7ae60844 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:25.615689 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14fbb1-61a9-4ca7-a60c-affc7ae60844 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:25.630258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 382/761] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:25.636984 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c045b5-ee0c-446d-8ea0-59b4b3f563d8 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.649287 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c045b5-ee0c-446d-8ea0-59b4b3f563d8 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.654311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620a008-6d27-48ab-8dd6-475a492f83c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.655548 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a008-6d27-48ab-8dd6-475a492f83c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.655859 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a008-6d27-48ab-8dd6-475a492f83c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.656135 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a008-6d27-48ab-8dd6-475a492f83c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.657045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620a008-6d27-48ab-8dd6-475a492f83c2 admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=7e9153b864b44f5dbbfd6f33ddb253c0) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:25.657353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620a008-6d27-48ab-8dd6-475a492f83c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:25.659330 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620a008-6d27-48ab-8dd6-475a492f83c2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:25.667275 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 380/762] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/role_assignments?user.id=7e9153b864b44f5dbbfd6f33ddb253c0&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:25.786989 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d517698-4284-4f69-a961-7c95a9bfc7cf None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.787315 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d517698-4284-4f69-a961-7c95a9bfc7cf None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.787523 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d517698-4284-4f69-a961-7c95a9bfc7cf None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.789940 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 383/763] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:25.796452 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4111a5e-c504-4dea-8f5e-a68ad0a1f142 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.796754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4111a5e-c504-4dea-8f5e-a68ad0a1f142 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.797049 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4111a5e-c504-4dea-8f5e-a68ad0a1f142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.818043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-e4111a5e-c504-4dea-8f5e-a68ad0a1f142 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:25.820329 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e4111a5e-c504-4dea-8f5e-a68ad0a1f142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:25.835849 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 381/764] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:25 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:25.857225 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d517698-4284-4f69-a961-7c95a9bfc7cf None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.870410 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d517698-4284-4f69-a961-7c95a9bfc7cf None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.884019 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bad4a-fa69-465e-bfb8-491e09713f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.884756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bad4a-fa69-465e-bfb8-491e09713f78 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.885033 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bad4a-fa69-465e-bfb8-491e09713f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.885304 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bad4a-fa69-465e-bfb8-491e09713f78 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.898781 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bad4a-fa69-465e-bfb8-491e09713f78 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:25.906741 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-7d2bad4a-fa69-465e-bfb8-491e09713f78 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 01:11:25.908311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 384/765] 10.222.0.87 () {56 vars in 1141 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:25.914857 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4111a5e-c504-4dea-8f5e-a68ad0a1f142 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.925510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4111a5e-c504-4dea-8f5e-a68ad0a1f142 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.930124 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a206df-da17-4efe-a994-78d9fe8ed524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.930790 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a206df-da17-4efe-a994-78d9fe8ed524 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.931068 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a206df-da17-4efe-a994-78d9fe8ed524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.931340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a206df-da17-4efe-a994-78d9fe8ed524 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.932181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a206df-da17-4efe-a994-78d9fe8ed524 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:25.932487 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a206df-da17-4efe-a994-78d9fe8ed524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:25.934703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a206df-da17-4efe-a994-78d9fe8ed524 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:25.944419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 382/766] 10.222.0.87 () {56 vars in 1136 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:25.950440 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bad4a-fa69-465e-bfb8-491e09713f78 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:25.963912 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bad4a-fa69-465e-bfb8-491e09713f78 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:25.968840 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943371b6-97c6-4da9-800c-32df299f5010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:25.969675 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943371b6-97c6-4da9-800c-32df299f5010 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:25.969956 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943371b6-97c6-4da9-800c-32df299f5010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:25.970229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943371b6-97c6-4da9-800c-32df299f5010 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:25.981866 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943371b6-97c6-4da9-800c-32df299f5010 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:25.984385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943371b6-97c6-4da9-800c-32df299f5010 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:26.001280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-943371b6-97c6-4da9-800c-32df299f5010 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:26.002795 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 385/767] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:26.008839 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a206df-da17-4efe-a994-78d9fe8ed524 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:26.019313 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a206df-da17-4efe-a994-78d9fe8ed524 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:26.023994 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85c539-1cae-42d5-901b-8ae80744061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:26.024702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85c539-1cae-42d5-901b-8ae80744061e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.025149 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85c539-1cae-42d5-901b-8ae80744061e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.025428 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85c539-1cae-42d5-901b-8ae80744061e admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.026218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85c539-1cae-42d5-901b-8ae80744061e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:26.026523 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85c539-1cae-42d5-901b-8ae80744061e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:26.028243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85c539-1cae-42d5-901b-8ae80744061e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:26.042030 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 383/768] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:26.048744 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943371b6-97c6-4da9-800c-32df299f5010 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:26.058998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943371b6-97c6-4da9-800c-32df299f5010 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:26.064346 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a1226-6849-4ac4-b83a-e9ad7145ea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:26.065203 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a1226-6849-4ac4-b83a-e9ad7145ea95 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.065482 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a1226-6849-4ac4-b83a-e9ad7145ea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.065752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a1226-6849-4ac4-b83a-e9ad7145ea95 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.074522 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a1226-6849-4ac4-b83a-e9ad7145ea95 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:26.077167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a1226-6849-4ac4-b83a-e9ad7145ea95 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:26.091805 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-ed2a1226-6849-4ac4-b83a-e9ad7145ea95 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 01:11:26.093983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 386/769] 10.222.0.87 () {56 vars in 1138 bytes} [Fri Oct 29 01:11:26 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:26.100265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85c539-1cae-42d5-901b-8ae80744061e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:26.110342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85c539-1cae-42d5-901b-8ae80744061e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:26.114957 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85973da0-a07a-4a60-b4d1-1a8a3e23d38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:26.115619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85973da0-a07a-4a60-b4d1-1a8a3e23d38a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.115929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85973da0-a07a-4a60-b4d1-1a8a3e23d38a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.116250 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85973da0-a07a-4a60-b4d1-1a8a3e23d38a admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.117099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85973da0-a07a-4a60-b4d1-1a8a3e23d38a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:26.117454 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85973da0-a07a-4a60-b4d1-1a8a3e23d38a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:26.119348 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85973da0-a07a-4a60-b4d1-1a8a3e23d38a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:26.138412 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 384/770] 10.222.0.87 () {56 vars in 1170 bytes} [Fri Oct 29 01:11:26 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:26.145596 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a1226-6849-4ac4-b83a-e9ad7145ea95 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:26.156212 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a1226-6849-4ac4-b83a-e9ad7145ea95 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:26.160866 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b6fc8-aac2-4da2-beb4-5dab757c26f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:26.161495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b6fc8-aac2-4da2-beb4-5dab757c26f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.161824 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b6fc8-aac2-4da2-beb4-5dab757c26f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.162094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b6fc8-aac2-4da2-beb4-5dab757c26f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.172345 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b6fc8-aac2-4da2-beb4-5dab757c26f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:26.174146 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b6fc8-aac2-4da2-beb4-5dab757c26f9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:26.183916 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 387/771] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:26 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:26.190298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85973da0-a07a-4a60-b4d1-1a8a3e23d38a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:26.200735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85973da0-a07a-4a60-b4d1-1a8a3e23d38a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:26.206044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0f71e-619d-4f6e-b656-3b54c509248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:26.206871 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0f71e-619d-4f6e-b656-3b54c509248c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.207146 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0f71e-619d-4f6e-b656-3b54c509248c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.207466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0f71e-619d-4f6e-b656-3b54c509248c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.218627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0f71e-619d-4f6e-b656-3b54c509248c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:26.220479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0f71e-619d-4f6e-b656-3b54c509248c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:26.238490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-a4e0f71e-619d-4f6e-b656-3b54c509248c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:26.244038 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 385/772] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:26.246171 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b6fc8-aac2-4da2-beb4-5dab757c26f9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:26.255950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b6fc8-aac2-4da2-beb4-5dab757c26f9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:26.260710 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb4b05-9f47-4ff0-9b3e-9060023c307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:26.261477 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb4b05-9f47-4ff0-9b3e-9060023c307b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.261763 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb4b05-9f47-4ff0-9b3e-9060023c307b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.262033 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb4b05-9f47-4ff0-9b3e-9060023c307b admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.262795 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb4b05-9f47-4ff0-9b3e-9060023c307b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:26.263092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb4b05-9f47-4ff0-9b3e-9060023c307b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:26.265368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb4b05-9f47-4ff0-9b3e-9060023c307b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:26.280507 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 388/773] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:26.286767 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0f71e-619d-4f6e-b656-3b54c509248c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:26.297710 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0f71e-619d-4f6e-b656-3b54c509248c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:26.302508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efdad4-79cb-405c-8974-ddfbd0d543e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:26.303336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efdad4-79cb-405c-8974-ddfbd0d543e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.303619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efdad4-79cb-405c-8974-ddfbd0d543e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.304000 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efdad4-79cb-405c-8974-ddfbd0d543e8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.312432 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efdad4-79cb-405c-8974-ddfbd0d543e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:26.317220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efdad4-79cb-405c-8974-ddfbd0d543e8 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:26.328139 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-82efdad4-79cb-405c-8974-ddfbd0d543e8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:26.329714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 386/774] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:26.336000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb4b05-9f47-4ff0-9b3e-9060023c307b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:26.346495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb4b05-9f47-4ff0-9b3e-9060023c307b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:26.351323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622ebbc-3867-4894-a18b-ceb31f9385e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:26.352047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622ebbc-3867-4894-a18b-ceb31f9385e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.352372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622ebbc-3867-4894-a18b-ceb31f9385e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.352642 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622ebbc-3867-4894-a18b-ceb31f9385e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.353428 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622ebbc-3867-4894-a18b-ceb31f9385e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:26.353866 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622ebbc-3867-4894-a18b-ceb31f9385e2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:26.355818 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622ebbc-3867-4894-a18b-ceb31f9385e2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:26.368452 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 389/775] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:26.375629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efdad4-79cb-405c-8974-ddfbd0d543e8 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:26.386515 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efdad4-79cb-405c-8974-ddfbd0d543e8 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:26.391875 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e2151-7ef7-458b-b121-1c7c34a3d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:26.392447 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e2151-7ef7-458b-b121-1c7c34a3d9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.392768 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e2151-7ef7-458b-b121-1c7c34a3d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.393032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e2151-7ef7-458b-b121-1c7c34a3d9d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.393918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e2151-7ef7-458b-b121-1c7c34a3d9d6 admin admin] RBAC: Adding query filter params (role.id=ffc892d848ec45c7b84e21038a4ed135, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=28ed9da4224549d1a2efd82998c8a500) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:26.394271 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e2151-7ef7-458b-b121-1c7c34a3d9d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:26.396218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e2151-7ef7-458b-b121-1c7c34a3d9d6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:26.402996 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 387/776] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:26 2021] GET /identity/v3/role_assignments?user.id=28ed9da4224549d1a2efd82998c8a500&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=ffc892d848ec45c7b84e21038a4ed135 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:26.422255 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ef4f1-3b31-40b3-aef0-599e267a0ada None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.422534 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ef4f1-3b31-40b3-aef0-599e267a0ada None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.422809 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ef4f1-3b31-40b3-aef0-599e267a0ada None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.425019 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 390/777] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:26.431895 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6f5c1-4ec7-4415-80d8-06fb6972d048 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.432184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6f5c1-4ec7-4415-80d8-06fb6972d048 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.432464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6f5c1-4ec7-4415-80d8-06fb6972d048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.453622 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-86c6f5c1-4ec7-4415-80d8-06fb6972d048 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:26.454846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-86c6f5c1-4ec7-4415-80d8-06fb6972d048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:26.463240 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 388/778] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:26 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:26.486961 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ef4f1-3b31-40b3-aef0-599e267a0ada None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:26.503466 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ef4f1-3b31-40b3-aef0-599e267a0ada None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:26.508409 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5012c-fa3f-447c-ae2f-f40ba980274a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:26.509352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5012c-fa3f-447c-ae2f-f40ba980274a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.509728 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5012c-fa3f-447c-ae2f-f40ba980274a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.510069 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5012c-fa3f-447c-ae2f-f40ba980274a admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.510814 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5012c-fa3f-447c-ae2f-f40ba980274a admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:26.512710 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5012c-fa3f-447c-ae2f-f40ba980274a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:26.524912 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-63f5012c-fa3f-447c-ae2f-f40ba980274a admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 01:11:26.526652 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 391/779] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:11:26 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:26.533837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6f5c1-4ec7-4415-80d8-06fb6972d048 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:26.543600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6f5c1-4ec7-4415-80d8-06fb6972d048 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:26.548893 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e65605-a076-46c4-8771-624645a2c9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:26.549864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e65605-a076-46c4-8771-624645a2c9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.550323 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e65605-a076-46c4-8771-624645a2c9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.550791 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e65605-a076-46c4-8771-624645a2c9b7 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.551712 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e65605-a076-46c4-8771-624645a2c9b7 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:26.552254 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e65605-a076-46c4-8771-624645a2c9b7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:26.554101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e65605-a076-46c4-8771-624645a2c9b7 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:26.560114 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 389/780] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:11:26 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:26.567357 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e65605-a076-46c4-8771-624645a2c9b7 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:26.568000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c13a-e656-4047-8f4e-11ff37c05a26 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.568319 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c13a-e656-4047-8f4e-11ff37c05a26 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.568556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c13a-e656-4047-8f4e-11ff37c05a26 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.570950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 392/781] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:26.577481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b5e4b-f210-4e31-92ce-4bbfaa60094d None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.577760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b5e4b-f210-4e31-92ce-4bbfaa60094d None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.578026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b5e4b-f210-4e31-92ce-4bbfaa60094d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.580572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e65605-a076-46c4-8771-624645a2c9b7 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:26.586503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4889ca6-2b49-411b-b9ac-54b6b39eead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:26.587188 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4889ca6-2b49-411b-b9ac-54b6b39eead1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.591986 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4889ca6-2b49-411b-b9ac-54b6b39eead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.593860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4889ca6-2b49-411b-b9ac-54b6b39eead1 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.595162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4889ca6-2b49-411b-b9ac-54b6b39eead1 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:26.595663 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4889ca6-2b49-411b-b9ac-54b6b39eead1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:26.597600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4889ca6-2b49-411b-b9ac-54b6b39eead1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:26.599031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-080b5e4b-f210-4e31-92ce-4bbfaa60094d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:26.600274 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-080b5e4b-f210-4e31-92ce-4bbfaa60094d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:26.604172 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 390/782] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:11:26 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:26.616342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 393/783] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:26 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:26.643131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4889ca6-2b49-411b-b9ac-54b6b39eead1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:26.653878 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4889ca6-2b49-411b-b9ac-54b6b39eead1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:26.660622 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db9d75-0969-4a65-8457-fbe4ad79282a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:26.661661 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9d75-0969-4a65-8457-fbe4ad79282a admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:26.662181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9d75-0969-4a65-8457-fbe4ad79282a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:26.662714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9d75-0969-4a65-8457-fbe4ad79282a admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:26.663825 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db9d75-0969-4a65-8457-fbe4ad79282a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:26.665752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db9d75-0969-4a65-8457-fbe4ad79282a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:26.737253 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 391/784] 10.222.0.87 () {60 vars in 1162 bytes} [Fri Oct 29 01:11:26 2021] POST /identity/v3/services => generated 269 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:28.135109 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d671095-aa86-417a-9a28-f73f5a46093f None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:28.135624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d671095-aa86-417a-9a28-f73f5a46093f None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:28.135624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d671095-aa86-417a-9a28-f73f5a46093f None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:28.138083 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 394/785] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:28.144634 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e555-a82f-4c45-bc97-e5fd40f3f418 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:28.145491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e555-a82f-4c45-bc97-e5fd40f3f418 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:28.145980 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e555-a82f-4c45-bc97-e5fd40f3f418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:28.164509 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8408e555-a82f-4c45-bc97-e5fd40f3f418 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:28.166010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8408e555-a82f-4c45-bc97-e5fd40f3f418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:28.183699 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 392/786] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:28 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:28.208347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d671095-aa86-417a-9a28-f73f5a46093f None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:28.220761 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d671095-aa86-417a-9a28-f73f5a46093f None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:28.225213 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77175fab-6002-4782-b10c-e4c0d45db2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:28.226003 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77175fab-6002-4782-b10c-e4c0d45db2ea admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:28.226283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77175fab-6002-4782-b10c-e4c0d45db2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:28.226556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77175fab-6002-4782-b10c-e4c0d45db2ea admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:28.227228 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77175fab-6002-4782-b10c-e4c0d45db2ea admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:28.228825 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77175fab-6002-4782-b10c-e4c0d45db2ea admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:28.241193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-77175fab-6002-4782-b10c-e4c0d45db2ea admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 01:11:28.247833 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 395/787] 10.222.0.87 () {56 vars in 1147 bytes} [Fri Oct 29 01:11:28 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:28.250135 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e555-a82f-4c45-bc97-e5fd40f3f418 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:28.259212 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e555-a82f-4c45-bc97-e5fd40f3f418 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:28.263864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78d06d-88cb-4853-874a-5d41753fc84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:28.265474 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78d06d-88cb-4853-874a-5d41753fc84b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:28.265762 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78d06d-88cb-4853-874a-5d41753fc84b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:28.266036 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78d06d-88cb-4853-874a-5d41753fc84b admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:28.266818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78d06d-88cb-4853-874a-5d41753fc84b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:28.267125 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78d06d-88cb-4853-874a-5d41753fc84b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:28.268745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78d06d-88cb-4853-874a-5d41753fc84b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:28.275822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 393/788] 10.222.0.87 () {56 vars in 1143 bytes} [Fri Oct 29 01:11:28 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:28.281216 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77175fab-6002-4782-b10c-e4c0d45db2ea admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:28.290938 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77175fab-6002-4782-b10c-e4c0d45db2ea admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:28.295603 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc346c12-de08-4d81-b1ab-cbc3ebbe5046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:28.296342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346c12-de08-4d81-b1ab-cbc3ebbe5046 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:28.296626 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346c12-de08-4d81-b1ab-cbc3ebbe5046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:28.296898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346c12-de08-4d81-b1ab-cbc3ebbe5046 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:28.297614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc346c12-de08-4d81-b1ab-cbc3ebbe5046 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:28.297917 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc346c12-de08-4d81-b1ab-cbc3ebbe5046 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:28.299648 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc346c12-de08-4d81-b1ab-cbc3ebbe5046 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:28.311895 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 396/789] 10.222.0.87 () {56 vars in 1143 bytes} [Fri Oct 29 01:11:28 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:28.714696 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ffde9-7593-4fa7-9c35-6d4b5d877270 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:28.715096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ffde9-7593-4fa7-9c35-6d4b5d877270 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:28.715306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ffde9-7593-4fa7-9c35-6d4b5d877270 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:28.717904 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 394/790] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:28.723982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59115adf-cdaf-45dd-a3ed-bc3efd214c36 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:28.724262 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59115adf-cdaf-45dd-a3ed-bc3efd214c36 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:28.724535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59115adf-cdaf-45dd-a3ed-bc3efd214c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:28.742714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-59115adf-cdaf-45dd-a3ed-bc3efd214c36 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:28.744233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-59115adf-cdaf-45dd-a3ed-bc3efd214c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:28.753286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 397/791] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:28 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:28.776396 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ffde9-7593-4fa7-9c35-6d4b5d877270 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:28.789299 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ffde9-7593-4fa7-9c35-6d4b5d877270 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:28.793653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb8577-28ec-46a7-b155-70c60a1e7bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:28.794443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb8577-28ec-46a7-b155-70c60a1e7bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:28.794719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb8577-28ec-46a7-b155-70c60a1e7bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:28.794987 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb8577-28ec-46a7-b155-70c60a1e7bf2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:28.805485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb8577-28ec-46a7-b155-70c60a1e7bf2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:28.813221 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-aecb8577-28ec-46a7-b155-70c60a1e7bf2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 01:11:28.814710 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 395/792] 10.222.0.87 () {56 vars in 1141 bytes} [Fri Oct 29 01:11:28 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:28.821368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59115adf-cdaf-45dd-a3ed-bc3efd214c36 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:28.830869 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59115adf-cdaf-45dd-a3ed-bc3efd214c36 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:28.837379 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5e8ff-7b4b-4e5d-84bc-93a0d9ae41da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:28.838102 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5e8ff-7b4b-4e5d-84bc-93a0d9ae41da admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:28.838445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5e8ff-7b4b-4e5d-84bc-93a0d9ae41da admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:28.838783 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5e8ff-7b4b-4e5d-84bc-93a0d9ae41da admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:28.839601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5e8ff-7b4b-4e5d-84bc-93a0d9ae41da admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:28.840025 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5e8ff-7b4b-4e5d-84bc-93a0d9ae41da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:28.841670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5e8ff-7b4b-4e5d-84bc-93a0d9ae41da admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:28.851234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 398/793] 10.222.0.87 () {56 vars in 1136 bytes} [Fri Oct 29 01:11:28 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:28.857368 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb8577-28ec-46a7-b155-70c60a1e7bf2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:28.874801 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb8577-28ec-46a7-b155-70c60a1e7bf2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:28.879877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa641bd6-f42c-4fe0-bd77-7715e7bd5cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:28.880918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa641bd6-f42c-4fe0-bd77-7715e7bd5cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:28.881339 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa641bd6-f42c-4fe0-bd77-7715e7bd5cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:28.881744 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa641bd6-f42c-4fe0-bd77-7715e7bd5cd5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:28.893807 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa641bd6-f42c-4fe0-bd77-7715e7bd5cd5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:28.896092 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa641bd6-f42c-4fe0-bd77-7715e7bd5cd5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:28.915312 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-fa641bd6-f42c-4fe0-bd77-7715e7bd5cd5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:28.917114 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 396/794] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:28.923976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5e8ff-7b4b-4e5d-84bc-93a0d9ae41da admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:28.934033 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5e8ff-7b4b-4e5d-84bc-93a0d9ae41da admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:28.939259 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648abcec-d47d-41c3-bf59-eb6de109f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:28.940057 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648abcec-d47d-41c3-bf59-eb6de109f4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:28.940431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648abcec-d47d-41c3-bf59-eb6de109f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:28.940798 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648abcec-d47d-41c3-bf59-eb6de109f4a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:28.941651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648abcec-d47d-41c3-bf59-eb6de109f4a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:28.942046 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648abcec-d47d-41c3-bf59-eb6de109f4a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:28.943697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648abcec-d47d-41c3-bf59-eb6de109f4a7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:28.956505 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 399/795] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:28.962601 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa641bd6-f42c-4fe0-bd77-7715e7bd5cd5 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:28.972799 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa641bd6-f42c-4fe0-bd77-7715e7bd5cd5 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:28.977944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3da729-8a36-47a7-9312-e55e09e2dae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:28.979181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3da729-8a36-47a7-9312-e55e09e2dae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:28.979672 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3da729-8a36-47a7-9312-e55e09e2dae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:28.980246 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3da729-8a36-47a7-9312-e55e09e2dae5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:28.989621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3da729-8a36-47a7-9312-e55e09e2dae5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:28.992145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3da729-8a36-47a7-9312-e55e09e2dae5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:29.008466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-ce3da729-8a36-47a7-9312-e55e09e2dae5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 01:11:29.010108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 397/796] 10.222.0.87 () {56 vars in 1138 bytes} [Fri Oct 29 01:11:28 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:29.017342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648abcec-d47d-41c3-bf59-eb6de109f4a7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:29.027831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648abcec-d47d-41c3-bf59-eb6de109f4a7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:29.033631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8d2f7-ed01-4b0a-aa9a-19c2ace9c2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:29.034605 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8d2f7-ed01-4b0a-aa9a-19c2ace9c2fa admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.035076 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8d2f7-ed01-4b0a-aa9a-19c2ace9c2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.035567 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8d2f7-ed01-4b0a-aa9a-19c2ace9c2fa admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.037005 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8d2f7-ed01-4b0a-aa9a-19c2ace9c2fa admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:29.037509 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8d2f7-ed01-4b0a-aa9a-19c2ace9c2fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:29.038155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e3ae7-4b64-4f44-8c3a-063cdd0a8062 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.038445 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e3ae7-4b64-4f44-8c3a-063cdd0a8062 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.038722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e3ae7-4b64-4f44-8c3a-063cdd0a8062 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.040177 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8d2f7-ed01-4b0a-aa9a-19c2ace9c2fa admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:29.040888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 398/797] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:11:29.047761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60597-cfaf-4325-abe3-a9fae6b8af2f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.049569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60597-cfaf-4325-abe3-a9fae6b8af2f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.049569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60597-cfaf-4325-abe3-a9fae6b8af2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.060070 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 400/798] 10.222.0.87 () {56 vars in 1170 bytes} [Fri Oct 29 01:11:29 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:29.068526 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d2f60597-cfaf-4325-abe3-a9fae6b8af2f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:29.069009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8d2f7-ed01-4b0a-aa9a-19c2ace9c2fa admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:29.069979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d2f60597-cfaf-4325-abe3-a9fae6b8af2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:29.079131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 399/799] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:29 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:29.082479 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8d2f7-ed01-4b0a-aa9a-19c2ace9c2fa admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:29.087167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60423d0-9234-437d-86c9-b1acca45beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:29.088234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60423d0-9234-437d-86c9-b1acca45beeb admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.088710 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60423d0-9234-437d-86c9-b1acca45beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.089288 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60423d0-9234-437d-86c9-b1acca45beeb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.100200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60423d0-9234-437d-86c9-b1acca45beeb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:29.102286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60423d0-9234-437d-86c9-b1acca45beeb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:29.104251 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f60597-cfaf-4325-abe3-a9fae6b8af2f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:29.114545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f60597-cfaf-4325-abe3-a9fae6b8af2f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:29.119284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95268c4f-fb2d-4922-b2c8-ef54867c8cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:29.120025 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95268c4f-fb2d-4922-b2c8-ef54867c8cec admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.120304 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95268c4f-fb2d-4922-b2c8-ef54867c8cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.120577 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95268c4f-fb2d-4922-b2c8-ef54867c8cec admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.121327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95268c4f-fb2d-4922-b2c8-ef54867c8cec admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:29.122249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-a60423d0-9234-437d-86c9-b1acca45beeb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:29.122965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95268c4f-fb2d-4922-b2c8-ef54867c8cec admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:29.124303 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 401/800] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:29.130475 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60423d0-9234-437d-86c9-b1acca45beeb admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:29.140970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60423d0-9234-437d-86c9-b1acca45beeb admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:29.145496 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f84c2-b949-46d6-aeb8-d271cdd6c32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:29.146127 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f84c2-b949-46d6-aeb8-d271cdd6c32b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.146403 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f84c2-b949-46d6-aeb8-d271cdd6c32b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.146672 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f84c2-b949-46d6-aeb8-d271cdd6c32b admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.147399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f84c2-b949-46d6-aeb8-d271cdd6c32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:29.147697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f84c2-b949-46d6-aeb8-d271cdd6c32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:29.149288 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f84c2-b949-46d6-aeb8-d271cdd6c32b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:29.161179 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 402/801] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:29.163509 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5785e-bd1e-47ad-8d58-766329ce31e7 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.163829 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5785e-bd1e-47ad-8d58-766329ce31e7 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.164111 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5785e-bd1e-47ad-8d58-766329ce31e7 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.165788 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 403/802] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:29.166959 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5785e-bd1e-47ad-8d58-766329ce31e7 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:29.179527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5785e-bd1e-47ad-8d58-766329ce31e7 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:29.183838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bc79c-3db2-4332-9eb3-29a3db1c1a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:29.184579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bc79c-3db2-4332-9eb3-29a3db1c1a07 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.184857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bc79c-3db2-4332-9eb3-29a3db1c1a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.185125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bc79c-3db2-4332-9eb3-29a3db1c1a07 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.192278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bc79c-3db2-4332-9eb3-29a3db1c1a07 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:29.193340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 400/803] 10.222.0.87 () {60 vars in 1162 bytes} [Fri Oct 29 01:11:29 2021] POST /identity/v3/services => generated 251 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:29.195843 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bc79c-3db2-4332-9eb3-29a3db1c1a07 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:29.195970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42a715-69f3-4020-85b1-8ad84e442f66 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.195970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42a715-69f3-4020-85b1-8ad84e442f66 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.195970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42a715-69f3-4020-85b1-8ad84e442f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.211753 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-dc7bc79c-3db2-4332-9eb3-29a3db1c1a07 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:29.219825 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 404/804] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:29.221927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bc79c-3db2-4332-9eb3-29a3db1c1a07 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:29.228946 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-5a42a715-69f3-4020-85b1-8ad84e442f66 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:29.230104 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-5a42a715-69f3-4020-85b1-8ad84e442f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:29.238758 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bc79c-3db2-4332-9eb3-29a3db1c1a07 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:29.257203 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 401/805] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:29 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:29.265427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dcc75-0336-4404-8ca1-5b4bf5d945b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:29.266495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dcc75-0336-4404-8ca1-5b4bf5d945b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.266914 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dcc75-0336-4404-8ca1-5b4bf5d945b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.267366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dcc75-0336-4404-8ca1-5b4bf5d945b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.268490 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dcc75-0336-4404-8ca1-5b4bf5d945b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:29.268939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dcc75-0336-4404-8ca1-5b4bf5d945b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:29.271010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dcc75-0336-4404-8ca1-5b4bf5d945b4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:29.281704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42a715-69f3-4020-85b1-8ad84e442f66 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:29.287669 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 405/806] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:29.293424 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42a715-69f3-4020-85b1-8ad84e442f66 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:29.294811 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dcc75-0336-4404-8ca1-5b4bf5d945b4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:29.298563 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae6794-0bb2-46b9-a5dd-32fc9af61e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:29.299392 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae6794-0bb2-46b9-a5dd-32fc9af61e4f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.299669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae6794-0bb2-46b9-a5dd-32fc9af61e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.299987 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae6794-0bb2-46b9-a5dd-32fc9af61e4f admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.300669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae6794-0bb2-46b9-a5dd-32fc9af61e4f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:29.302288 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae6794-0bb2-46b9-a5dd-32fc9af61e4f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:29.307493 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dcc75-0336-4404-8ca1-5b4bf5d945b4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:29.313833 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf629e-6c5e-45e6-b297-6a2d15e6a6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:29.315029 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf629e-6c5e-45e6-b297-6a2d15e6a6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.315371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-feae6794-0bb2-46b9-a5dd-32fc9af61e4f admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 01:11:29.315709 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf629e-6c5e-45e6-b297-6a2d15e6a6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.316258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf629e-6c5e-45e6-b297-6a2d15e6a6b5 admin admin] PATH_INFO: `/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/28ed9da4224549d1a2efd82998c8a500/roles/ffc892d848ec45c7b84e21038a4ed135` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.317989 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 402/807] 10.222.0.87 () {56 vars in 1153 bytes} [Fri Oct 29 01:11:29 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:29.327185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf629e-6c5e-45e6-b297-6a2d15e6a6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579ca0c9e3d480ab7b4f64d199c403b, user_id=28ed9da4224549d1a2efd82998c8a500, role_id=ffc892d848ec45c7b84e21038a4ed135)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:29.327185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf629e-6c5e-45e6-b297-6a2d15e6a6b5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:29.327438 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae6794-0bb2-46b9-a5dd-32fc9af61e4f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:29.335206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae6794-0bb2-46b9-a5dd-32fc9af61e4f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:29.339841 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01a4bb-df19-42d3-a09a-2ffba7b37559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:29.344300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01a4bb-df19-42d3-a09a-2ffba7b37559 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.344300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01a4bb-df19-42d3-a09a-2ffba7b37559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.344300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01a4bb-df19-42d3-a09a-2ffba7b37559 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.344300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01a4bb-df19-42d3-a09a-2ffba7b37559 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:29.344300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01a4bb-df19-42d3-a09a-2ffba7b37559 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:29.344769 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01a4bb-df19-42d3-a09a-2ffba7b37559 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:29.349973 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 403/808] 10.222.0.87 () {56 vars in 1147 bytes} [Fri Oct 29 01:11:29 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:29.356552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01a4bb-df19-42d3-a09a-2ffba7b37559 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:29.366738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01a4bb-df19-42d3-a09a-2ffba7b37559 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:29.371464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1ea25-4268-462c-ba24-226266eb7040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:29.372177 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1ea25-4268-462c-ba24-226266eb7040 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.372461 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1ea25-4268-462c-ba24-226266eb7040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.372804 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1ea25-4268-462c-ba24-226266eb7040 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.374337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1ea25-4268-462c-ba24-226266eb7040 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:29.374337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1ea25-4268-462c-ba24-226266eb7040 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:29.376035 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1ea25-4268-462c-ba24-226266eb7040 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:29.381894 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 404/809] 10.222.0.87 () {56 vars in 1147 bytes} [Fri Oct 29 01:11:29 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:29.388547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1ea25-4268-462c-ba24-226266eb7040 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:29.399587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1ea25-4268-462c-ba24-226266eb7040 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:29.404134 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d13b07-ab52-421e-9983-1c5ab80c1a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:29.405022 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13b07-ab52-421e-9983-1c5ab80c1a15 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.405692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13b07-ab52-421e-9983-1c5ab80c1a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.405692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13b07-ab52-421e-9983-1c5ab80c1a15 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.406222 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d13b07-ab52-421e-9983-1c5ab80c1a15 admin admin] RBAC: Adding query filter params (interface=public, service_id=75c5c18236fa49fb9bed002a3dcb1740, region_id=RegionOne) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:29.406533 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d13b07-ab52-421e-9983-1c5ab80c1a15 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:29.408228 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d13b07-ab52-421e-9983-1c5ab80c1a15 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:29.414048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 405/810] 10.222.0.87 () {56 vars in 1272 bytes} [Fri Oct 29 01:11:29 2021] GET /identity/v3/endpoints?service_id=75c5c18236fa49fb9bed002a3dcb1740&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:29.418113 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 406/811] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:11:29 2021] PUT /identity/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/28ed9da4224549d1a2efd82998c8a500/roles/ffc892d848ec45c7b84e21038a4ed135 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:11:29.420441 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d13b07-ab52-421e-9983-1c5ab80c1a15 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:29.433816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d13b07-ab52-421e-9983-1c5ab80c1a15 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:29.504808 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872eeb4-a68c-42f4-a5c2-d40fce8e963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:29.505401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eeb4-a68c-42f4-a5c2-d40fce8e963a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:29.505679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eeb4-a68c-42f4-a5c2-d40fce8e963a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:29.505948 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eeb4-a68c-42f4-a5c2-d40fce8e963a admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:29.506652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872eeb4-a68c-42f4-a5c2-d40fce8e963a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:29.508813 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872eeb4-a68c-42f4-a5c2-d40fce8e963a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:29.519797 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 406/812] 10.222.0.87 () {56 vars in 1108 bytes} [Fri Oct 29 01:11:29 2021] GET /identity/v3/services => generated 1268 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:11:30.685820 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc5338-5a55-4ed1-a34c-f054a7fae5ce None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:30.686807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc5338-5a55-4ed1-a34c-f054a7fae5ce None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:30.687233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc5338-5a55-4ed1-a34c-f054a7fae5ce None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:30.689527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 407/813] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:30.696341 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265bf31-39fc-4a6c-b014-d41bcab0aba9 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:30.697227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265bf31-39fc-4a6c-b014-d41bcab0aba9 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:30.697707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265bf31-39fc-4a6c-b014-d41bcab0aba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:30.718215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-7265bf31-39fc-4a6c-b014-d41bcab0aba9 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:30.720011 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7265bf31-39fc-4a6c-b014-d41bcab0aba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:30.728959 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 407/814] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:30 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:30.754252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc5338-5a55-4ed1-a34c-f054a7fae5ce None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:30.766806 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc5338-5a55-4ed1-a34c-f054a7fae5ce None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:30.771441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7f411-2f59-4456-a471-ddad1898ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:30.772359 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f411-2f59-4456-a471-ddad1898ff65 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:30.772859 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f411-2f59-4456-a471-ddad1898ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:30.773328 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f411-2f59-4456-a471-ddad1898ff65 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:30.774271 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7f411-2f59-4456-a471-ddad1898ff65 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:30.775475 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-24c7f411-2f59-4456-a471-ddad1898ff65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:30.775475 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:11:30.775475 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:11:30.776728 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7f411-2f59-4456-a471-ddad1898ff65 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:30.862960 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 408/815] 10.222.0.87 () {60 vars in 1162 bytes} [Fri Oct 29 01:11:30 2021] POST /identity/v3/services => generated 241 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:11:31.620646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39e0a5-321b-49eb-b304-58ced89741aa None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.621051 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39e0a5-321b-49eb-b304-58ced89741aa None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.621224 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39e0a5-321b-49eb-b304-58ced89741aa None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.623784 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 408/816] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:31.629757 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8dd07-68d0-432c-83a3-e1eed83da9f5 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.630050 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8dd07-68d0-432c-83a3-e1eed83da9f5 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.630348 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8dd07-68d0-432c-83a3-e1eed83da9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.648769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-3df8dd07-68d0-432c-83a3-e1eed83da9f5 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:31.649969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3df8dd07-68d0-432c-83a3-e1eed83da9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:31.672672 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 409/817] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:31 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:31.694193 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39e0a5-321b-49eb-b304-58ced89741aa None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:31.706650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39e0a5-321b-49eb-b304-58ced89741aa None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:31.711180 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1d460-fec4-4edb-a426-33bbf35db80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:31.711985 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1d460-fec4-4edb-a426-33bbf35db80f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.712261 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1d460-fec4-4edb-a426-33bbf35db80f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.712528 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1d460-fec4-4edb-a426-33bbf35db80f admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.713195 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1d460-fec4-4edb-a426-33bbf35db80f admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:31.714772 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1d460-fec4-4edb-a426-33bbf35db80f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:31.726982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-6aa1d460-fec4-4edb-a426-33bbf35db80f admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 01:11:31.731853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 409/818] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:11:31 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:31.735696 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8dd07-68d0-432c-83a3-e1eed83da9f5 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:31.745269 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8dd07-68d0-432c-83a3-e1eed83da9f5 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:31.750797 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9457a-a811-4af7-a966-bc3a21351e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:31.751543 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9457a-a811-4af7-a966-bc3a21351e4f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.751848 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9457a-a811-4af7-a966-bc3a21351e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.752123 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9457a-a811-4af7-a966-bc3a21351e4f admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.752863 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9457a-a811-4af7-a966-bc3a21351e4f admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:31.753167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9457a-a811-4af7-a966-bc3a21351e4f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:31.754815 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9457a-a811-4af7-a966-bc3a21351e4f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:31.766472 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 410/819] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:11:31 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:31.767878 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1d460-fec4-4edb-a426-33bbf35db80f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:31.777780 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1d460-fec4-4edb-a426-33bbf35db80f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:31.782470 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d571e4-a023-4689-82e9-b8e971759a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:31.783122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d571e4-a023-4689-82e9-b8e971759a07 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.783400 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d571e4-a023-4689-82e9-b8e971759a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.783676 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d571e4-a023-4689-82e9-b8e971759a07 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.784419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d571e4-a023-4689-82e9-b8e971759a07 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:31.784722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d571e4-a023-4689-82e9-b8e971759a07 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:31.786305 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d571e4-a023-4689-82e9-b8e971759a07 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:31.795823 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 410/820] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:11:31 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:31.798450 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9457a-a811-4af7-a966-bc3a21351e4f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:31.808180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9457a-a811-4af7-a966-bc3a21351e4f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:31.810134 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666fe1a-a8ce-4842-838e-0584eed86b89 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.810417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666fe1a-a8ce-4842-838e-0584eed86b89 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.811334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666fe1a-a8ce-4842-838e-0584eed86b89 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.813540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 411/821] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:11:31.813738 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a8bfb-9142-4edc-b990-cf28551d42bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:31.814250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a8bfb-9142-4edc-b990-cf28551d42bc admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.814591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a8bfb-9142-4edc-b990-cf28551d42bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.814871 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a8bfb-9142-4edc-b990-cf28551d42bc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.815668 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a8bfb-9142-4edc-b990-cf28551d42bc admin admin] RBAC: Adding query filter params (interface=public, service_id=3756470ecb9e4e2ba52b0696e2f3f2e3, region_id=RegionOne) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:31.816001 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a8bfb-9142-4edc-b990-cf28551d42bc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:31.816998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-074a8bfb-9142-4edc-b990-cf28551d42bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:31.816998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:11:31.816998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:11:31.818003 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a8bfb-9142-4edc-b990-cf28551d42bc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:31.819309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347bb40-7f86-4319-a505-021e61391b94 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.819584 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347bb40-7f86-4319-a505-021e61391b94 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.819894 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347bb40-7f86-4319-a505-021e61391b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.828604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 411/822] 10.222.0.87 () {56 vars in 1272 bytes} [Fri Oct 29 01:11:31 2021] GET /identity/v3/endpoints?service_id=3756470ecb9e4e2ba52b0696e2f3f2e3&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:31.833730 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a8bfb-9142-4edc-b990-cf28551d42bc admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:31.842779 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-6347bb40-7f86-4319-a505-021e61391b94 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:31.843769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a8bfb-9142-4edc-b990-cf28551d42bc admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:31.843986 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6347bb40-7f86-4319-a505-021e61391b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:31.848382 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76d23b-af9b-412d-b04e-65cf4d83502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:31.849015 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76d23b-af9b-412d-b04e-65cf4d83502d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.849287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76d23b-af9b-412d-b04e-65cf4d83502d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.849556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76d23b-af9b-412d-b04e-65cf4d83502d admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.850246 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76d23b-af9b-412d-b04e-65cf4d83502d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:31.851831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76d23b-af9b-412d-b04e-65cf4d83502d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:31.853087 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 412/823] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:31 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:31.861353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 412/824] 10.222.0.87 () {56 vars in 1108 bytes} [Fri Oct 29 01:11:31 2021] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:11:31.881079 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347bb40-7f86-4319-a505-021e61391b94 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:31.891585 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347bb40-7f86-4319-a505-021e61391b94 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:31.893645 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae9fb-1ba5-46c9-a641-6a5e5fb36968 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.893941 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae9fb-1ba5-46c9-a641-6a5e5fb36968 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.894225 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae9fb-1ba5-46c9-a641-6a5e5fb36968 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.897644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d10a8-8b1e-4e1c-8b06-0de25c1890b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:31.898752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d10a8-8b1e-4e1c-8b06-0de25c1890b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.899258 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d10a8-8b1e-4e1c-8b06-0de25c1890b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.899758 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d10a8-8b1e-4e1c-8b06-0de25c1890b9 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.900675 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d10a8-8b1e-4e1c-8b06-0de25c1890b9 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:31.901204 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 413/825] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:31 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:11:31.902767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b437be6-f58c-4b9f-97b1-1f0ccef3138d None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.903055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b437be6-f58c-4b9f-97b1-1f0ccef3138d None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.903331 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b437be6-f58c-4b9f-97b1-1f0ccef3138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.903557 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d10a8-8b1e-4e1c-8b06-0de25c1890b9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:31.919598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-751d10a8-8b1e-4e1c-8b06-0de25c1890b9 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 01:11:31.927771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 413/826] 10.222.0.87 () {56 vars in 1153 bytes} [Fri Oct 29 01:11:31 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:31.929123 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-9b437be6-f58c-4b9f-97b1-1f0ccef3138d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:31.929239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d10a8-8b1e-4e1c-8b06-0de25c1890b9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:31.930823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9b437be6-f58c-4b9f-97b1-1f0ccef3138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:31.940337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d10a8-8b1e-4e1c-8b06-0de25c1890b9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:31.945675 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d0df8-2e49-439b-9421-c2b281efd5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:31.946011 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 414/827] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:31 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:31.946401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d0df8-2e49-439b-9421-c2b281efd5ee admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.948404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d0df8-2e49-439b-9421-c2b281efd5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.948404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d0df8-2e49-439b-9421-c2b281efd5ee admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.948404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d0df8-2e49-439b-9421-c2b281efd5ee admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:31.948404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d0df8-2e49-439b-9421-c2b281efd5ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:31.949768 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d0df8-2e49-439b-9421-c2b281efd5ee admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:31.961300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 414/828] 10.222.0.87 () {56 vars in 1147 bytes} [Fri Oct 29 01:11:31 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:31.962701 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b437be6-f58c-4b9f-97b1-1f0ccef3138d None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:31.972529 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d0df8-2e49-439b-9421-c2b281efd5ee admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:31.979680 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b437be6-f58c-4b9f-97b1-1f0ccef3138d None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:31.985004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d0df8-2e49-439b-9421-c2b281efd5ee admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:31.985631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9e8a9-ff6c-4778-8910-91e2bf021734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:31.986669 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9e8a9-ff6c-4778-8910-91e2bf021734 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.987224 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9e8a9-ff6c-4778-8910-91e2bf021734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.987786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9e8a9-ff6c-4778-8910-91e2bf021734 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.988794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9e8a9-ff6c-4778-8910-91e2bf021734 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:31.989323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9e8a9-ff6c-4778-8910-91e2bf021734 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:31.990251 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd6525-2ffe-4eae-a248-50212af36fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:31.991068 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6525-2ffe-4eae-a248-50212af36fce admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:31.991400 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6525-2ffe-4eae-a248-50212af36fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:31.991676 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6525-2ffe-4eae-a248-50212af36fce admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:31.992254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9e8a9-ff6c-4778-8910-91e2bf021734 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:32.007350 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 415/829] 10.222.0.87 () {56 vars in 1147 bytes} [Fri Oct 29 01:11:31 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:32.010064 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9e8a9-ff6c-4778-8910-91e2bf021734 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:32.015955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd6525-2ffe-4eae-a248-50212af36fce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:32.022859 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9e8a9-ff6c-4778-8910-91e2bf021734 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:32.024667 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-68fd6525-2ffe-4eae-a248-50212af36fce admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 01:11:32.026663 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 415/830] 10.222.0.87 () {56 vars in 1141 bytes} [Fri Oct 29 01:11:31 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:32.033117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b549cf-cd8c-4dd2-ac42-49ab7b036c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:32.033684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd6525-2ffe-4eae-a248-50212af36fce admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:32.034414 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b549cf-cd8c-4dd2-ac42-49ab7b036c96 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:32.035037 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b549cf-cd8c-4dd2-ac42-49ab7b036c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:32.035510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b549cf-cd8c-4dd2-ac42-49ab7b036c96 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:32.036544 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b549cf-cd8c-4dd2-ac42-49ab7b036c96 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:32.038850 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b549cf-cd8c-4dd2-ac42-49ab7b036c96 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:32.044170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd6525-2ffe-4eae-a248-50212af36fce admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:32.050672 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0c1c4-0789-4dd4-ada9-43489fb26199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:32.051402 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0c1c4-0789-4dd4-ada9-43489fb26199 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:32.051853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0c1c4-0789-4dd4-ada9-43489fb26199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:32.052070 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0c1c4-0789-4dd4-ada9-43489fb26199 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:32.052995 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0c1c4-0789-4dd4-ada9-43489fb26199 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:32.053309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0c1c4-0789-4dd4-ada9-43489fb26199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:32.054922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0c1c4-0789-4dd4-ada9-43489fb26199 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:32.065317 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 416/831] 10.222.0.87 () {56 vars in 1136 bytes} [Fri Oct 29 01:11:32 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:32.074203 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0c1c4-0789-4dd4-ada9-43489fb26199 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:32.084296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0c1c4-0789-4dd4-ada9-43489fb26199 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:32.089676 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb166441-dfc5-4cd3-96e5-cbda581bac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:32.090462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb166441-dfc5-4cd3-96e5-cbda581bac7c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:32.090745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb166441-dfc5-4cd3-96e5-cbda581bac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:32.091019 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb166441-dfc5-4cd3-96e5-cbda581bac7c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:32.103607 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb166441-dfc5-4cd3-96e5-cbda581bac7c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:32.105619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb166441-dfc5-4cd3-96e5-cbda581bac7c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:32.123271 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-eb166441-dfc5-4cd3-96e5-cbda581bac7c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:32.125304 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 417/832] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:32.131400 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb166441-dfc5-4cd3-96e5-cbda581bac7c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:32.142363 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 416/833] 10.222.0.87 () {60 vars in 1165 bytes} [Fri Oct 29 01:11:32 2021] POST /identity/v3/endpoints => generated 347 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:32.147184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb166441-dfc5-4cd3-96e5-cbda581bac7c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:32.165867 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df92b-deba-459b-9bef-2dd667bb3e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:32.166603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df92b-deba-459b-9bef-2dd667bb3e42 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:32.166939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df92b-deba-459b-9bef-2dd667bb3e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:32.167268 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df92b-deba-459b-9bef-2dd667bb3e42 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:32.168246 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683df92b-deba-459b-9bef-2dd667bb3e42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:32.168558 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683df92b-deba-459b-9bef-2dd667bb3e42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:32.170971 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683df92b-deba-459b-9bef-2dd667bb3e42 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:32.185531 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 418/834] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:32.192939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b549cf-cd8c-4dd2-ac42-49ab7b036c96 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:32.204343 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b549cf-cd8c-4dd2-ac42-49ab7b036c96 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:32.209470 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020c955-9a6e-4925-94ce-2991539c0153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:32.210362 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020c955-9a6e-4925-94ce-2991539c0153 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:32.210641 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020c955-9a6e-4925-94ce-2991539c0153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:32.210970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020c955-9a6e-4925-94ce-2991539c0153 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:32.219966 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020c955-9a6e-4925-94ce-2991539c0153 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:32.222112 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020c955-9a6e-4925-94ce-2991539c0153 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:32.238458 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-8020c955-9a6e-4925-94ce-2991539c0153 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 01:11:32.240119 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 417/835] 10.222.0.87 () {56 vars in 1138 bytes} [Fri Oct 29 01:11:32 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:32.246873 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df92b-deba-459b-9bef-2dd667bb3e42 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:32.257817 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df92b-deba-459b-9bef-2dd667bb3e42 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:32.262611 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001344-cd0b-42ef-a2d2-3f82e0db2988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:32.263343 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001344-cd0b-42ef-a2d2-3f82e0db2988 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:32.263678 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001344-cd0b-42ef-a2d2-3f82e0db2988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:32.264604 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001344-cd0b-42ef-a2d2-3f82e0db2988 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:32.265600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00001344-cd0b-42ef-a2d2-3f82e0db2988 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:32.265909 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00001344-cd0b-42ef-a2d2-3f82e0db2988 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:32.267869 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00001344-cd0b-42ef-a2d2-3f82e0db2988 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:32.289239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 419/836] 10.222.0.87 () {56 vars in 1170 bytes} [Fri Oct 29 01:11:32 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:32.295904 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020c955-9a6e-4925-94ce-2991539c0153 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:32.306687 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020c955-9a6e-4925-94ce-2991539c0153 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:32.312548 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85247b-1c37-4dfb-a1cf-fc08347e8a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:32.313429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85247b-1c37-4dfb-a1cf-fc08347e8a7a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:32.313877 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85247b-1c37-4dfb-a1cf-fc08347e8a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:32.314310 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85247b-1c37-4dfb-a1cf-fc08347e8a7a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:32.323886 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85247b-1c37-4dfb-a1cf-fc08347e8a7a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:32.325900 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85247b-1c37-4dfb-a1cf-fc08347e8a7a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:32.342484 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 418/837] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:32 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:32.344177 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001344-cd0b-42ef-a2d2-3f82e0db2988 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:32.354919 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001344-cd0b-42ef-a2d2-3f82e0db2988 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:32.360089 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2eca8-ed6d-463e-9bc0-1fd0133001b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:32.361101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2eca8-ed6d-463e-9bc0-1fd0133001b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:32.361533 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2eca8-ed6d-463e-9bc0-1fd0133001b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:32.361959 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2eca8-ed6d-463e-9bc0-1fd0133001b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:32.374251 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2eca8-ed6d-463e-9bc0-1fd0133001b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:32.376414 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2eca8-ed6d-463e-9bc0-1fd0133001b3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:32.394877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-3ec2eca8-ed6d-463e-9bc0-1fd0133001b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:32.399014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 420/838] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:32.402844 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85247b-1c37-4dfb-a1cf-fc08347e8a7a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:32.413632 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85247b-1c37-4dfb-a1cf-fc08347e8a7a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:32.419699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee08e2b-bf0a-498b-bb12-fcdf3cf133ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:32.420767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08e2b-bf0a-498b-bb12-fcdf3cf133ee admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:32.421140 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08e2b-bf0a-498b-bb12-fcdf3cf133ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:32.421512 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08e2b-bf0a-498b-bb12-fcdf3cf133ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:32.422425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee08e2b-bf0a-498b-bb12-fcdf3cf133ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:32.422791 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee08e2b-bf0a-498b-bb12-fcdf3cf133ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:32.424952 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee08e2b-bf0a-498b-bb12-fcdf3cf133ee admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:32.440288 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 419/839] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:32.447620 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2eca8-ed6d-463e-9bc0-1fd0133001b3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:32.458790 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2eca8-ed6d-463e-9bc0-1fd0133001b3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:32.463885 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d9802-724a-435a-bc78-c84ae2797a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:32.464915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d9802-724a-435a-bc78-c84ae2797a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:32.465395 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d9802-724a-435a-bc78-c84ae2797a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:32.465866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d9802-724a-435a-bc78-c84ae2797a4e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:32.474833 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d9802-724a-435a-bc78-c84ae2797a4e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:32.477132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d9802-724a-435a-bc78-c84ae2797a4e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:32.491784 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-af9d9802-724a-435a-bc78-c84ae2797a4e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:32.499397 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 421/840] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:32.501153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee08e2b-bf0a-498b-bb12-fcdf3cf133ee admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:32.511627 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee08e2b-bf0a-498b-bb12-fcdf3cf133ee admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:32.516674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a6261-e40d-4630-a95b-cae9692c5318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:32.517555 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a6261-e40d-4630-a95b-cae9692c5318 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:32.517984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a6261-e40d-4630-a95b-cae9692c5318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:32.518409 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a6261-e40d-4630-a95b-cae9692c5318 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:32.519385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a6261-e40d-4630-a95b-cae9692c5318 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:32.519876 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a6261-e40d-4630-a95b-cae9692c5318 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:32.521845 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a6261-e40d-4630-a95b-cae9692c5318 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:32.539834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 420/841] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:32.543256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d9802-724a-435a-bc78-c84ae2797a4e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:32.554767 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d9802-724a-435a-bc78-c84ae2797a4e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:32.559586 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480ef39-e2ac-47a4-a063-75302b8655ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:32.560409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480ef39-e2ac-47a4-a063-75302b8655ab admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:32.560866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480ef39-e2ac-47a4-a063-75302b8655ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:32.561283 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480ef39-e2ac-47a4-a063-75302b8655ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:32.562294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480ef39-e2ac-47a4-a063-75302b8655ab admin admin] RBAC: Adding query filter params (role.id=ffc892d848ec45c7b84e21038a4ed135, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=28ed9da4224549d1a2efd82998c8a500) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:32.562752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480ef39-e2ac-47a4-a063-75302b8655ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:32.564783 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480ef39-e2ac-47a4-a063-75302b8655ab admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:32.576012 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 422/842] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:32 2021] GET /identity/v3/role_assignments?user.id=28ed9da4224549d1a2efd82998c8a500&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=ffc892d848ec45c7b84e21038a4ed135 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:33.287189 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b3762-354d-4787-aafc-508a6ea68433 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:33.287697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b3762-354d-4787-aafc-508a6ea68433 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:33.287846 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b3762-354d-4787-aafc-508a6ea68433 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:33.289921 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 421/843] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:33.296263 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bc08c-aa42-4819-b675-3857e9378ea6 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:33.296702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bc08c-aa42-4819-b675-3857e9378ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:33.296853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bc08c-aa42-4819-b675-3857e9378ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:33.315390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-683bc08c-aa42-4819-b675-3857e9378ea6 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:33.316620 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-683bc08c-aa42-4819-b675-3857e9378ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:33.331842 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 423/844] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:33 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:33.349990 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b3762-354d-4787-aafc-508a6ea68433 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:33.362533 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b3762-354d-4787-aafc-508a6ea68433 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:33.367106 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7bde6-df54-495e-af12-ea942d363dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:33.367949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7bde6-df54-495e-af12-ea942d363dde admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:33.368229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7bde6-df54-495e-af12-ea942d363dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:33.368500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7bde6-df54-495e-af12-ea942d363dde admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:33.369171 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7bde6-df54-495e-af12-ea942d363dde admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:33.370755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7bde6-df54-495e-af12-ea942d363dde admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:33.383047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-1ac7bde6-df54-495e-af12-ea942d363dde admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 01:11:33.384551 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 422/845] 10.222.0.87 () {56 vars in 1147 bytes} [Fri Oct 29 01:11:33 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:33.391508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bc08c-aa42-4819-b675-3857e9378ea6 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:33.400856 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bc08c-aa42-4819-b675-3857e9378ea6 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:33.406366 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75817129-b8bb-4b97-a4ea-9dd1741fa637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:33.407246 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75817129-b8bb-4b97-a4ea-9dd1741fa637 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:33.407843 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75817129-b8bb-4b97-a4ea-9dd1741fa637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:33.408339 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75817129-b8bb-4b97-a4ea-9dd1741fa637 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:33.409258 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75817129-b8bb-4b97-a4ea-9dd1741fa637 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:33.409762 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75817129-b8bb-4b97-a4ea-9dd1741fa637 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:33.411698 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75817129-b8bb-4b97-a4ea-9dd1741fa637 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:33.421103 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 424/846] 10.222.0.87 () {56 vars in 1143 bytes} [Fri Oct 29 01:11:33 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:33.424322 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7bde6-df54-495e-af12-ea942d363dde admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:33.434167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7bde6-df54-495e-af12-ea942d363dde admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:33.439463 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a826d-4452-4f71-a585-bd4a3910177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:33.440155 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a826d-4452-4f71-a585-bd4a3910177d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:33.440481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a826d-4452-4f71-a585-bd4a3910177d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:33.440759 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a826d-4452-4f71-a585-bd4a3910177d admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:33.441489 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a826d-4452-4f71-a585-bd4a3910177d admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:33.441793 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a826d-4452-4f71-a585-bd4a3910177d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:33.443400 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a826d-4452-4f71-a585-bd4a3910177d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:33.449903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 423/847] 10.222.0.87 () {56 vars in 1143 bytes} [Fri Oct 29 01:11:33 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:33.457257 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75817129-b8bb-4b97-a4ea-9dd1741fa637 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:33.467722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75817129-b8bb-4b97-a4ea-9dd1741fa637 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:33.472873 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ecba0-9930-46d8-8720-a8a903cf4052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:33.473792 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ecba0-9930-46d8-8720-a8a903cf4052 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:33.474276 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ecba0-9930-46d8-8720-a8a903cf4052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:33.474850 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ecba0-9930-46d8-8720-a8a903cf4052 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:33.475873 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ecba0-9930-46d8-8720-a8a903cf4052 admin admin] RBAC: Adding query filter params (interface=public, service_id=3874223a1b9d407ab67a92e818a73eb3, region_id=RegionOne) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:33.476392 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ecba0-9930-46d8-8720-a8a903cf4052 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:33.478171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ecba0-9930-46d8-8720-a8a903cf4052 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:33.488524 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 425/848] 10.222.0.87 () {56 vars in 1272 bytes} [Fri Oct 29 01:11:33 2021] GET /identity/v3/endpoints?service_id=3874223a1b9d407ab67a92e818a73eb3&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:33.491615 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a826d-4452-4f71-a585-bd4a3910177d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:33.505132 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a826d-4452-4f71-a585-bd4a3910177d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:33.510116 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285acb2-1be4-4fea-b6d1-8d672acc5302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:33.511066 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285acb2-1be4-4fea-b6d1-8d672acc5302 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:33.511719 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285acb2-1be4-4fea-b6d1-8d672acc5302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:33.512267 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285acb2-1be4-4fea-b6d1-8d672acc5302 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:33.513174 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285acb2-1be4-4fea-b6d1-8d672acc5302 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:33.515653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285acb2-1be4-4fea-b6d1-8d672acc5302 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:33.522471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 424/849] 10.222.0.87 () {56 vars in 1108 bytes} [Fri Oct 29 01:11:33 2021] GET /identity/v3/services => generated 1497 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:11:34.232286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7977-aaf7-43b2-b240-e3fbf8310b0c None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:34.233018 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7977-aaf7-43b2-b240-e3fbf8310b0c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:34.233287 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7977-aaf7-43b2-b240-e3fbf8310b0c None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:34.235417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 426/850] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:34.241352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46ad7-e027-42cf-96f7-edcce25a4ff5 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:34.241644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46ad7-e027-42cf-96f7-edcce25a4ff5 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:34.241918 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46ad7-e027-42cf-96f7-edcce25a4ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:34.260426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-4dc46ad7-e027-42cf-96f7-edcce25a4ff5 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:34.261621 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4dc46ad7-e027-42cf-96f7-edcce25a4ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:34.270675 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 425/851] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:34 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:34.294658 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7977-aaf7-43b2-b240-e3fbf8310b0c None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:34.308124 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7977-aaf7-43b2-b240-e3fbf8310b0c None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:34.313347 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e852fb-5d79-4747-98d6-c364998e6d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:34.314219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e852fb-5d79-4747-98d6-c364998e6d03 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:34.314566 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e852fb-5d79-4747-98d6-c364998e6d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:34.314909 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e852fb-5d79-4747-98d6-c364998e6d03 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:34.315695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e852fb-5d79-4747-98d6-c364998e6d03 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:34.317418 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e852fb-5d79-4747-98d6-c364998e6d03 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:34.329939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-d5e852fb-5d79-4747-98d6-c364998e6d03 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 01:11:34.331513 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 427/852] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:11:34 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:34.338486 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc46ad7-e027-42cf-96f7-edcce25a4ff5 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:34.348125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc46ad7-e027-42cf-96f7-edcce25a4ff5 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:34.353007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63824d5d-ff1f-40f9-a759-883f0d3c86c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:34.353670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63824d5d-ff1f-40f9-a759-883f0d3c86c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:34.353950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63824d5d-ff1f-40f9-a759-883f0d3c86c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:34.354247 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63824d5d-ff1f-40f9-a759-883f0d3c86c7 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:34.355036 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63824d5d-ff1f-40f9-a759-883f0d3c86c7 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:34.355341 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63824d5d-ff1f-40f9-a759-883f0d3c86c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:34.356968 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63824d5d-ff1f-40f9-a759-883f0d3c86c7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:34.363156 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 426/853] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:11:34 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:34.369590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e852fb-5d79-4747-98d6-c364998e6d03 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:34.380517 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e852fb-5d79-4747-98d6-c364998e6d03 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:34.385290 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5762f6-d0e8-4ad2-9597-7936928bf3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:34.385955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5762f6-d0e8-4ad2-9597-7936928bf3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:34.386277 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5762f6-d0e8-4ad2-9597-7936928bf3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:34.386562 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5762f6-d0e8-4ad2-9597-7936928bf3e9 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:34.387309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5762f6-d0e8-4ad2-9597-7936928bf3e9 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:34.387610 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5762f6-d0e8-4ad2-9597-7936928bf3e9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:34.389593 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5762f6-d0e8-4ad2-9597-7936928bf3e9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:34.395860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 428/854] 10.222.0.87 () {56 vars in 1135 bytes} [Fri Oct 29 01:11:34 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:34.408740 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63824d5d-ff1f-40f9-a759-883f0d3c86c7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:34.419499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63824d5d-ff1f-40f9-a759-883f0d3c86c7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:34.425003 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9579c-a5a0-4b0d-953f-bbc9050ab1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:34.425719 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9579c-a5a0-4b0d-953f-bbc9050ab1bd admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:34.425996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9579c-a5a0-4b0d-953f-bbc9050ab1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:34.426323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9579c-a5a0-4b0d-953f-bbc9050ab1bd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:34.427089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9579c-a5a0-4b0d-953f-bbc9050ab1bd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:34.428819 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9579c-a5a0-4b0d-953f-bbc9050ab1bd admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:34.497269 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 427/855] 10.222.0.87 () {60 vars in 1165 bytes} [Fri Oct 29 01:11:34 2021] POST /identity/v3/endpoints => generated 346 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:34.541692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965afc7d-79c7-4607-a8e1-95a9736cf6a9 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:34.542043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965afc7d-79c7-4607-a8e1-95a9736cf6a9 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:34.542229 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965afc7d-79c7-4607-a8e1-95a9736cf6a9 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:34.544358 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 429/856] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:34.551282 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149aa8a-11a2-48ad-abed-0a179edef419 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:34.551573 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149aa8a-11a2-48ad-abed-0a179edef419 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:34.551860 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149aa8a-11a2-48ad-abed-0a179edef419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:34.571512 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-4149aa8a-11a2-48ad-abed-0a179edef419 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:34.572751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4149aa8a-11a2-48ad-abed-0a179edef419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:34.590577 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 428/857] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:34 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:34.615052 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965afc7d-79c7-4607-a8e1-95a9736cf6a9 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:34.628898 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965afc7d-79c7-4607-a8e1-95a9736cf6a9 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:34.633850 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f783ae2-d8f5-4a16-9c07-3468dc037da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:34.634710 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f783ae2-d8f5-4a16-9c07-3468dc037da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:34.634989 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f783ae2-d8f5-4a16-9c07-3468dc037da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:34.635263 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f783ae2-d8f5-4a16-9c07-3468dc037da4 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:34.636080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f783ae2-d8f5-4a16-9c07-3468dc037da4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:34.637790 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f783ae2-d8f5-4a16-9c07-3468dc037da4 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:34.650591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-3f783ae2-d8f5-4a16-9c07-3468dc037da4 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 01:11:34.652187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 430/858] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:34 2021] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:34.659635 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149aa8a-11a2-48ad-abed-0a179edef419 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:34.668985 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149aa8a-11a2-48ad-abed-0a179edef419 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:34.674180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5e473-2739-42ee-86e7-994ae5e07d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:34.674858 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5e473-2739-42ee-86e7-994ae5e07d02 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:34.675177 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5e473-2739-42ee-86e7-994ae5e07d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:34.675450 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5e473-2739-42ee-86e7-994ae5e07d02 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:34.676238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5e473-2739-42ee-86e7-994ae5e07d02 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:34.676540 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5e473-2739-42ee-86e7-994ae5e07d02 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:34.678322 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5e473-2739-42ee-86e7-994ae5e07d02 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:34.684310 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 429/859] 10.222.0.87 () {56 vars in 1133 bytes} [Fri Oct 29 01:11:34 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:34.691325 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f783ae2-d8f5-4a16-9c07-3468dc037da4 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:34.702649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f783ae2-d8f5-4a16-9c07-3468dc037da4 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:34.707545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fc0a7-9fac-42e5-b1f9-f0b051ffc184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:34.708250 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fc0a7-9fac-42e5-b1f9-f0b051ffc184 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:34.708572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fc0a7-9fac-42e5-b1f9-f0b051ffc184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:34.708841 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fc0a7-9fac-42e5-b1f9-f0b051ffc184 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:34.709561 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fc0a7-9fac-42e5-b1f9-f0b051ffc184 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:34.709907 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fc0a7-9fac-42e5-b1f9-f0b051ffc184 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:34.711581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fc0a7-9fac-42e5-b1f9-f0b051ffc184 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:34.718377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 431/860] 10.222.0.87 () {56 vars in 1133 bytes} [Fri Oct 29 01:11:34 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:34.992508 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fa352-fbd3-4ae0-971f-3265ccc0650a None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:34.992896 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fa352-fbd3-4ae0-971f-3265ccc0650a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:34.993072 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fa352-fbd3-4ae0-971f-3265ccc0650a None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:34.995077 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 430/861] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:35.001211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cdf98-2e2b-422f-8e57-f2efb6c8d6e9 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:35.001502 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cdf98-2e2b-422f-8e57-f2efb6c8d6e9 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:35.001778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cdf98-2e2b-422f-8e57-f2efb6c8d6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:35.019982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-c56cdf98-2e2b-422f-8e57-f2efb6c8d6e9 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:35.021166 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c56cdf98-2e2b-422f-8e57-f2efb6c8d6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:35.029652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 432/862] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:34 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:35.052871 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fa352-fbd3-4ae0-971f-3265ccc0650a None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:35.066000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fa352-fbd3-4ae0-971f-3265ccc0650a None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:35.070798 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e862bbc-3ce3-48db-b9ad-4a9ff2c8f7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:35.071564 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e862bbc-3ce3-48db-b9ad-4a9ff2c8f7cc admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:35.071878 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e862bbc-3ce3-48db-b9ad-4a9ff2c8f7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:35.072152 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e862bbc-3ce3-48db-b9ad-4a9ff2c8f7cc admin admin] PATH_INFO: `/v3/services/image` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:35.072956 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e862bbc-3ce3-48db-b9ad-4a9ff2c8f7cc admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:35.074527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e862bbc-3ce3-48db-b9ad-4a9ff2c8f7cc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:35.086394 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-8e862bbc-3ce3-48db-b9ad-4a9ff2c8f7cc admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 01:11:35.087905 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 431/863] 10.222.0.87 () {56 vars in 1126 bytes} [Fri Oct 29 01:11:35 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:35.095453 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cdf98-2e2b-422f-8e57-f2efb6c8d6e9 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:35.104641 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cdf98-2e2b-422f-8e57-f2efb6c8d6e9 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:35.109525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447cc10-8b83-409c-864f-26f0cfd349fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:35.110190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447cc10-8b83-409c-864f-26f0cfd349fc admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:35.110473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447cc10-8b83-409c-864f-26f0cfd349fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:35.110745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447cc10-8b83-409c-864f-26f0cfd349fc admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:35.111471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447cc10-8b83-409c-864f-26f0cfd349fc admin admin] RBAC: Adding query filter params (name=image) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:35.111812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447cc10-8b83-409c-864f-26f0cfd349fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:35.113544 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447cc10-8b83-409c-864f-26f0cfd349fc admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:35.118974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 433/864] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:35 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:35.125316 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e862bbc-3ce3-48db-b9ad-4a9ff2c8f7cc admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:35.135084 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e862bbc-3ce3-48db-b9ad-4a9ff2c8f7cc admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:35.140294 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bbb6e-96e2-43d4-9fb3-d439e9192041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:35.140933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bbb6e-96e2-43d4-9fb3-d439e9192041 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:35.141211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bbb6e-96e2-43d4-9fb3-d439e9192041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:35.141477 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bbb6e-96e2-43d4-9fb3-d439e9192041 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:35.142190 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bbb6e-96e2-43d4-9fb3-d439e9192041 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:35.142491 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bbb6e-96e2-43d4-9fb3-d439e9192041 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:35.144160 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bbb6e-96e2-43d4-9fb3-d439e9192041 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:35.149088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 432/865] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:35 2021] GET /identity/v3/services?type=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:35.941237 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf1b34-7527-420d-988b-e4df1a43b178 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:35.941746 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf1b34-7527-420d-988b-e4df1a43b178 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:35.941821 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf1b34-7527-420d-988b-e4df1a43b178 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:35.943594 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 434/866] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:35.950452 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711bfde-de08-4425-a22a-bcf517c6ae4a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:35.951006 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711bfde-de08-4425-a22a-bcf517c6ae4a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:35.951006 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711bfde-de08-4425-a22a-bcf517c6ae4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:35.970175 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-e711bfde-de08-4425-a22a-bcf517c6ae4a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:35.971384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e711bfde-de08-4425-a22a-bcf517c6ae4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:35.979795 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 433/867] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:35 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:36.005080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf1b34-7527-420d-988b-e4df1a43b178 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:36.017759 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf1b34-7527-420d-988b-e4df1a43b178 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:36.022290 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6947554-2fa1-4759-b1da-87e1f5df59d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:36.023090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6947554-2fa1-4759-b1da-87e1f5df59d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:36.023355 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6947554-2fa1-4759-b1da-87e1f5df59d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:36.023627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6947554-2fa1-4759-b1da-87e1f5df59d3 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:36.024508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6947554-2fa1-4759-b1da-87e1f5df59d3 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:36.026092 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6947554-2fa1-4759-b1da-87e1f5df59d3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:36.037762 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-a6947554-2fa1-4759-b1da-87e1f5df59d3 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 01:11:36.039321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 435/868] 10.222.0.87 () {56 vars in 1147 bytes} [Fri Oct 29 01:11:36 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:36.046587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711bfde-de08-4425-a22a-bcf517c6ae4a None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:36.055892 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711bfde-de08-4425-a22a-bcf517c6ae4a None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:36.061296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b94d9-7e9d-40a2-9c34-de08ad3af48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:36.061959 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b94d9-7e9d-40a2-9c34-de08ad3af48e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:36.062237 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b94d9-7e9d-40a2-9c34-de08ad3af48e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:36.062512 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b94d9-7e9d-40a2-9c34-de08ad3af48e admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:36.063360 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b94d9-7e9d-40a2-9c34-de08ad3af48e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:36.063666 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b94d9-7e9d-40a2-9c34-de08ad3af48e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:36.065262 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b94d9-7e9d-40a2-9c34-de08ad3af48e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:36.070989 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 434/869] 10.222.0.87 () {56 vars in 1143 bytes} [Fri Oct 29 01:11:36 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:36.077766 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6947554-2fa1-4759-b1da-87e1f5df59d3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:36.087511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6947554-2fa1-4759-b1da-87e1f5df59d3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:36.093017 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a5f8e-2a6b-41b4-b14d-5ef19da3620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:36.093684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5f8e-2a6b-41b4-b14d-5ef19da3620c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:36.094078 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5f8e-2a6b-41b4-b14d-5ef19da3620c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:36.094420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5f8e-2a6b-41b4-b14d-5ef19da3620c admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:36.095156 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a5f8e-2a6b-41b4-b14d-5ef19da3620c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:36.095511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a5f8e-2a6b-41b4-b14d-5ef19da3620c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:36.097154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a5f8e-2a6b-41b4-b14d-5ef19da3620c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:36.103082 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 436/870] 10.222.0.87 () {56 vars in 1143 bytes} [Fri Oct 29 01:11:36 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:36.110502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b94d9-7e9d-40a2-9c34-de08ad3af48e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:36.121017 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b94d9-7e9d-40a2-9c34-de08ad3af48e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:36.126187 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0ac85-c926-4285-a8db-e7ca9d14f988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:36.126909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0ac85-c926-4285-a8db-e7ca9d14f988 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:36.127188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0ac85-c926-4285-a8db-e7ca9d14f988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:36.127492 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0ac85-c926-4285-a8db-e7ca9d14f988 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:36.128395 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0ac85-c926-4285-a8db-e7ca9d14f988 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:36.130076 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0ac85-c926-4285-a8db-e7ca9d14f988 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:36.200578 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 435/871] 10.222.0.87 () {60 vars in 1165 bytes} [Fri Oct 29 01:11:36 2021] POST /identity/v3/endpoints => generated 349 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:36.923658 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4baaf-8d3f-48e0-a41f-6570b5877704 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:36.924353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4baaf-8d3f-48e0-a41f-6570b5877704 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:36.924835 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4baaf-8d3f-48e0-a41f-6570b5877704 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:36.927071 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 437/872] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:36.933385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17afae4-095d-40c4-aa50-8114fbe28ac0 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:36.933978 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17afae4-095d-40c4-aa50-8114fbe28ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:36.934456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17afae4-095d-40c4-aa50-8114fbe28ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:36.953986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-b17afae4-095d-40c4-aa50-8114fbe28ac0 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:36.955951 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b17afae4-095d-40c4-aa50-8114fbe28ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:36.973797 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 436/873] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:36 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:36.999179 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4baaf-8d3f-48e0-a41f-6570b5877704 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:37.013166 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4baaf-8d3f-48e0-a41f-6570b5877704 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:37.019146 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5009b-b83d-4f66-8864-d4f89f983d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:37.020238 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5009b-b83d-4f66-8864-d4f89f983d8b admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:37.020760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5009b-b83d-4f66-8864-d4f89f983d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:37.021260 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5009b-b83d-4f66-8864-d4f89f983d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:37.022220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5009b-b83d-4f66-8864-d4f89f983d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:37.024448 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5009b-b83d-4f66-8864-d4f89f983d8b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:37.026212 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.common [None req-e8e5009b-b83d-4f66-8864-d4f89f983d8b admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 29 01:11:37.083944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.sql.core [None req-e8e5009b-b83d-4f66-8864-d4f89f983d8b admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 29 01:11:37.083944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 01:11:37.083944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [parameters: {'id': 'c1748261c5e5481684bd4babd3d2521f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 29 01:11:37.083944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79704) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 01:11:37.091097 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-e8e5009b-b83d-4f66-8864-d4f89f983d8b admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c1748261c5e5481684bd4babd3d2521f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c1748261c5e5481684bd4babd3d2521f. Oct 29 01:11:37.093420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 438/874] 10.222.0.87 () {60 vars in 1161 bytes} [Fri Oct 29 01:11:36 2021] POST /identity/v3/projects => generated 262 bytes in 95 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:37.100197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17afae4-095d-40c4-aa50-8114fbe28ac0 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:37.109857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17afae4-095d-40c4-aa50-8114fbe28ac0 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:37.114865 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe34951-353f-430b-ae6a-1fb4338ce0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:37.115928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe34951-353f-430b-ae6a-1fb4338ce0dd admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:37.116414 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe34951-353f-430b-ae6a-1fb4338ce0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:37.116905 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe34951-353f-430b-ae6a-1fb4338ce0dd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:37.125145 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe34951-353f-430b-ae6a-1fb4338ce0dd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:37.127369 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe34951-353f-430b-ae6a-1fb4338ce0dd admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:37.143447 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-5fe34951-353f-430b-ae6a-1fb4338ce0dd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:37.145125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 437/875] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:37.151497 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5009b-b83d-4f66-8864-d4f89f983d8b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:37.162240 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5009b-b83d-4f66-8864-d4f89f983d8b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:37.167254 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75da18-1aff-4e6c-9228-a6a68dea3019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:37.168208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75da18-1aff-4e6c-9228-a6a68dea3019 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:37.168697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75da18-1aff-4e6c-9228-a6a68dea3019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:37.169209 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75da18-1aff-4e6c-9228-a6a68dea3019 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:37.170282 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75da18-1aff-4e6c-9228-a6a68dea3019 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:37.170887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75da18-1aff-4e6c-9228-a6a68dea3019 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:37.173230 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75da18-1aff-4e6c-9228-a6a68dea3019 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:37.180443 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a66961-4100-4e1c-8806-60feb5c893bc None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:37.180732 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a66961-4100-4e1c-8806-60feb5c893bc None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:37.180992 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a66961-4100-4e1c-8806-60feb5c893bc None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:37.182999 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 438/876] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:11:37.189611 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c918b6-d215-4e4d-aec4-bbd14093bded None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:37.189894 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c918b6-d215-4e4d-aec4-bbd14093bded None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:37.190163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c918b6-d215-4e4d-aec4-bbd14093bded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:37.197796 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 439/877] 10.222.0.87 () {56 vars in 1133 bytes} [Fri Oct 29 01:11:37 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:37.210238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-b7c918b6-d215-4e4d-aec4-bbd14093bded None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:37.211459 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b7c918b6-d215-4e4d-aec4-bbd14093bded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:37.220470 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 439/878] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:37 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:37.245595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75da18-1aff-4e6c-9228-a6a68dea3019 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:37.256541 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75da18-1aff-4e6c-9228-a6a68dea3019 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:37.261531 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94381ff4-c8b5-4657-a759-d95ebc65c496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:37.262308 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94381ff4-c8b5-4657-a759-d95ebc65c496 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:37.262664 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94381ff4-c8b5-4657-a759-d95ebc65c496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:37.263018 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94381ff4-c8b5-4657-a759-d95ebc65c496 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:37.264672 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94381ff4-c8b5-4657-a759-d95ebc65c496 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:37.266385 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94381ff4-c8b5-4657-a759-d95ebc65c496 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:37.331998 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 440/879] 10.222.0.87 () {60 vars in 1162 bytes} [Fri Oct 29 01:11:37 2021] POST /identity/v3/services => generated 242 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:37.517321 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aa485-66c8-44c3-a60b-af0c5499582b None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:37.517508 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aa485-66c8-44c3-a60b-af0c5499582b None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:37.517788 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aa485-66c8-44c3-a60b-af0c5499582b None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:37.519565 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 440/880] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:37.526338 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8166e97-6e60-47e7-bc79-a3ebb10f67cb None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:37.526645 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8166e97-6e60-47e7-bc79-a3ebb10f67cb None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:37.526904 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8166e97-6e60-47e7-bc79-a3ebb10f67cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:37.548964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-a8166e97-6e60-47e7-bc79-a3ebb10f67cb None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:37.550649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a8166e97-6e60-47e7-bc79-a3ebb10f67cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:37.570465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 441/881] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:37 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:37.595625 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7aa485-66c8-44c3-a60b-af0c5499582b None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:37.610411 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7aa485-66c8-44c3-a60b-af0c5499582b None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:37.615287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4701b-9982-46d0-b5fd-c17254f42c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:37.615993 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4701b-9982-46d0-b5fd-c17254f42c51 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:37.616278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4701b-9982-46d0-b5fd-c17254f42c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:37.616552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4701b-9982-46d0-b5fd-c17254f42c51 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:37.617319 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4701b-9982-46d0-b5fd-c17254f42c51 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:37.619022 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4701b-9982-46d0-b5fd-c17254f42c51 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:37.697420 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 441/882] 10.222.0.87 () {60 vars in 1162 bytes} [Fri Oct 29 01:11:37 2021] POST /identity/v3/services => generated 242 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:38.644226 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643f9e0-e403-446f-bfa9-7186b568026b None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:38.645274 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643f9e0-e403-446f-bfa9-7186b568026b None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:38.645782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643f9e0-e403-446f-bfa9-7186b568026b None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:38.648135 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 442/883] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:38.654850 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee8aa7-2d22-4aad-875b-c80696211d28 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:38.655859 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee8aa7-2d22-4aad-875b-c80696211d28 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:38.656340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee8aa7-2d22-4aad-875b-c80696211d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:38.676037 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-6fee8aa7-2d22-4aad-875b-c80696211d28 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:38.677575 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6fee8aa7-2d22-4aad-875b-c80696211d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:38.697238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 442/884] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:38 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:38.722300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643f9e0-e403-446f-bfa9-7186b568026b None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:38.735914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643f9e0-e403-446f-bfa9-7186b568026b None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:38.740788 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7c89d-fb85-4614-a4e5-9fb8b4146a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:38.741855 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7c89d-fb85-4614-a4e5-9fb8b4146a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:38.742486 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7c89d-fb85-4614-a4e5-9fb8b4146a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:38.742951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7c89d-fb85-4614-a4e5-9fb8b4146a35 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:38.743881 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7c89d-fb85-4614-a4e5-9fb8b4146a35 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:38.745820 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7c89d-fb85-4614-a4e5-9fb8b4146a35 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:38.759045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-dde7c89d-fb85-4614-a4e5-9fb8b4146a35 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 01:11:38.761033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 443/885] 10.222.0.87 () {56 vars in 1147 bytes} [Fri Oct 29 01:11:38 2021] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:38.768298 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee8aa7-2d22-4aad-875b-c80696211d28 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:38.777924 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee8aa7-2d22-4aad-875b-c80696211d28 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:38.782983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ff273-78d3-4c2f-a2d3-6af5c2c43d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:38.783961 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ff273-78d3-4c2f-a2d3-6af5c2c43d8c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:38.784437 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ff273-78d3-4c2f-a2d3-6af5c2c43d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:38.785063 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ff273-78d3-4c2f-a2d3-6af5c2c43d8c admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:38.785981 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ff273-78d3-4c2f-a2d3-6af5c2c43d8c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:38.786499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ff273-78d3-4c2f-a2d3-6af5c2c43d8c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:38.788330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ff273-78d3-4c2f-a2d3-6af5c2c43d8c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:38.794482 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 443/886] 10.222.0.87 () {56 vars in 1143 bytes} [Fri Oct 29 01:11:38 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:38.802071 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7c89d-fb85-4614-a4e5-9fb8b4146a35 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:38.813108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7c89d-fb85-4614-a4e5-9fb8b4146a35 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:38.818160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d867e-339d-4fbc-b8ef-b5dbc99ccf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:38.819305 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d867e-339d-4fbc-b8ef-b5dbc99ccf6d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:38.819869 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d867e-339d-4fbc-b8ef-b5dbc99ccf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:38.820347 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d867e-339d-4fbc-b8ef-b5dbc99ccf6d admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:38.821591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d867e-339d-4fbc-b8ef-b5dbc99ccf6d admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:38.822124 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d867e-339d-4fbc-b8ef-b5dbc99ccf6d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:38.823965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d867e-339d-4fbc-b8ef-b5dbc99ccf6d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:38.830874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 444/887] 10.222.0.87 () {56 vars in 1143 bytes} [Fri Oct 29 01:11:38 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:38.837202 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ff273-78d3-4c2f-a2d3-6af5c2c43d8c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:38.847388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ff273-78d3-4c2f-a2d3-6af5c2c43d8c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:38.852233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaab7c-79fe-4c38-bc54-963cbc391a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:38.852878 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaab7c-79fe-4c38-bc54-963cbc391a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:38.853157 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaab7c-79fe-4c38-bc54-963cbc391a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:38.853428 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaab7c-79fe-4c38-bc54-963cbc391a4e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:38.854227 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eaab7c-79fe-4c38-bc54-963cbc391a4e admin admin] RBAC: Adding query filter params (interface=admin, service_id=3874223a1b9d407ab67a92e818a73eb3, region_id=RegionOne) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:38.854533 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eaab7c-79fe-4c38-bc54-963cbc391a4e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:38.856149 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eaab7c-79fe-4c38-bc54-963cbc391a4e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:38.862475 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 444/888] 10.222.0.87 () {56 vars in 1270 bytes} [Fri Oct 29 01:11:38 2021] GET /identity/v3/endpoints?service_id=3874223a1b9d407ab67a92e818a73eb3&interface=admin®ion_id=RegionOne => generated 193 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:38.868836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d867e-339d-4fbc-b8ef-b5dbc99ccf6d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:38.879227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d867e-339d-4fbc-b8ef-b5dbc99ccf6d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:38.884750 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22811c-b726-4d61-90c4-679b79450d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:38.885742 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22811c-b726-4d61-90c4-679b79450d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:38.886221 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22811c-b726-4d61-90c4-679b79450d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:38.886688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22811c-b726-4d61-90c4-679b79450d3d admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:38.887612 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22811c-b726-4d61-90c4-679b79450d3d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:38.890167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22811c-b726-4d61-90c4-679b79450d3d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:38.898000 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 445/889] 10.222.0.87 () {56 vars in 1108 bytes} [Fri Oct 29 01:11:38 2021] GET /identity/v3/services => generated 1957 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:11:39.615216 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306305ee-2a88-4990-92e0-72f4fc0bf56e None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:39.615593 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306305ee-2a88-4990-92e0-72f4fc0bf56e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:39.615825 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306305ee-2a88-4990-92e0-72f4fc0bf56e None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:39.618003 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 445/890] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:39.624653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddbb84-b96b-4799-8eb4-8b635ae17827 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:39.625309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddbb84-b96b-4799-8eb4-8b635ae17827 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:39.625782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddbb84-b96b-4799-8eb4-8b635ae17827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:39.646853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-42ddbb84-b96b-4799-8eb4-8b635ae17827 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:39.648995 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-42ddbb84-b96b-4799-8eb4-8b635ae17827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:39.658972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 446/891] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:39 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:39.685371 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306305ee-2a88-4990-92e0-72f4fc0bf56e None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:39.698360 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306305ee-2a88-4990-92e0-72f4fc0bf56e None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:39.703601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c55dc-c9b8-4eb9-a276-5ac933587cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:39.704313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c55dc-c9b8-4eb9-a276-5ac933587cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:39.704593 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c55dc-c9b8-4eb9-a276-5ac933587cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:39.704865 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c55dc-c9b8-4eb9-a276-5ac933587cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:39.705597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c55dc-c9b8-4eb9-a276-5ac933587cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:39.707419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c55dc-c9b8-4eb9-a276-5ac933587cb1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:39.708761 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.common [None req-690c55dc-c9b8-4eb9-a276-5ac933587cb1 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 29 01:11:39.757885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.sql.core [None req-690c55dc-c9b8-4eb9-a276-5ac933587cb1 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 29 01:11:39.757885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 29 01:11:39.757885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [parameters: {'user_id': '2d4e0dfbbc984fbb92b1687414889ec0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 29 01:11:39.757885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79703) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 01:11:39.773475 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-690c55dc-c9b8-4eb9-a276-5ac933587cb1 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 29 01:11:39.778593 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 446/892] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:11:39 2021] POST /identity/v3/users => generated 160 bytes in 90 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:39.782397 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddbb84-b96b-4799-8eb4-8b635ae17827 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:39.789006 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee832e1-7591-4e8e-b868-58744599380c None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:39.789292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee832e1-7591-4e8e-b868-58744599380c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:39.789572 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee832e1-7591-4e8e-b868-58744599380c None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:39.792280 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddbb84-b96b-4799-8eb4-8b635ae17827 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:39.795312 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 447/893] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:39 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:11:39.797713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef1d0a-0f46-401d-a1cf-1e7ed431d814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:39.798581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef1d0a-0f46-401d-a1cf-1e7ed431d814 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:39.798948 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef1d0a-0f46-401d-a1cf-1e7ed431d814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:39.799291 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef1d0a-0f46-401d-a1cf-1e7ed431d814 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:39.801368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e843-a6de-4631-8822-882e19ef1bfb None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:39.801658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e843-a6de-4631-8822-882e19ef1bfb None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:39.801935 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e843-a6de-4631-8822-882e19ef1bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:39.808453 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef1d0a-0f46-401d-a1cf-1e7ed431d814 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:39.811237 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef1d0a-0f46-401d-a1cf-1e7ed431d814 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:39.822641 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ed97e843-a6de-4631-8822-882e19ef1bfb None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:39.824556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ed97e843-a6de-4631-8822-882e19ef1bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:39.826865 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-84ef1d0a-0f46-401d-a1cf-1e7ed431d814 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 01:11:39.828764 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 447/894] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:39 2021] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:39.833690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 448/895] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:39 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:39.839787 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef1d0a-0f46-401d-a1cf-1e7ed431d814 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:39.845999 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef1d0a-0f46-401d-a1cf-1e7ed431d814 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:39.850870 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ce305-3228-4e73-9bc6-f960f88f7a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:39.851702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ce305-3228-4e73-9bc6-f960f88f7a82 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:39.852140 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ce305-3228-4e73-9bc6-f960f88f7a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:39.852504 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ce305-3228-4e73-9bc6-f960f88f7a82 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:39.853444 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ce305-3228-4e73-9bc6-f960f88f7a82 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:39.853870 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ce305-3228-4e73-9bc6-f960f88f7a82 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:39.855970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ce305-3228-4e73-9bc6-f960f88f7a82 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:39.860791 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97e843-a6de-4631-8822-882e19ef1bfb None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:39.881349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97e843-a6de-4631-8822-882e19ef1bfb None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:39.887117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd4b50-b9d0-4e7f-a492-1054633840bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:39.888259 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd4b50-b9d0-4e7f-a492-1054633840bd admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:39.889031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd4b50-b9d0-4e7f-a492-1054633840bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:39.889532 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd4b50-b9d0-4e7f-a492-1054633840bd admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:39.890498 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd4b50-b9d0-4e7f-a492-1054633840bd admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:39.892612 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd4b50-b9d0-4e7f-a492-1054633840bd admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:39.898008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 448/896] 10.222.0.87 () {56 vars in 1122 bytes} [Fri Oct 29 01:11:39 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:39.906195 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-74fd4b50-b9d0-4e7f-a492-1054633840bd admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 01:11:39.908087 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 449/897] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:39 2021] GET /identity/v3/services/compute => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:39.915186 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ce305-3228-4e73-9bc6-f960f88f7a82 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:39.926633 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ce305-3228-4e73-9bc6-f960f88f7a82 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:39.931533 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70413d67-f164-416e-bf63-a51d75dd39c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:39.932362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70413d67-f164-416e-bf63-a51d75dd39c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:39.932643 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70413d67-f164-416e-bf63-a51d75dd39c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:39.932911 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70413d67-f164-416e-bf63-a51d75dd39c0 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:39.933642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70413d67-f164-416e-bf63-a51d75dd39c0 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:39.933945 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70413d67-f164-416e-bf63-a51d75dd39c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:39.936505 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70413d67-f164-416e-bf63-a51d75dd39c0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:39.942623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 449/898] 10.222.0.87 () {56 vars in 1133 bytes} [Fri Oct 29 01:11:39 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:39.950074 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd4b50-b9d0-4e7f-a492-1054633840bd admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:39.961193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd4b50-b9d0-4e7f-a492-1054633840bd admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:39.966789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a8a92-d3bc-43de-a511-c18d73eff30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:39.967976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a8a92-d3bc-43de-a511-c18d73eff30c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:39.968530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a8a92-d3bc-43de-a511-c18d73eff30c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:39.969027 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a8a92-d3bc-43de-a511-c18d73eff30c admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:39.970091 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a8a92-d3bc-43de-a511-c18d73eff30c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:39.970665 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a8a92-d3bc-43de-a511-c18d73eff30c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:39.972739 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a8a92-d3bc-43de-a511-c18d73eff30c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:39.979513 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 450/899] 10.222.0.87 () {56 vars in 1133 bytes} [Fri Oct 29 01:11:39 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:39.987175 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70413d67-f164-416e-bf63-a51d75dd39c0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:39.999292 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70413d67-f164-416e-bf63-a51d75dd39c0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:40.005021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2befd-8210-4331-a1f3-8771f3f12a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:40.006130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2befd-8210-4331-a1f3-8771f3f12a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:40.006622 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2befd-8210-4331-a1f3-8771f3f12a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:40.007129 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2befd-8210-4331-a1f3-8771f3f12a0b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:40.008315 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2befd-8210-4331-a1f3-8771f3f12a0b admin admin] RBAC: Adding query filter params (interface=public, service_id=8588a7c341064e799b18cef560010e75, region_id=RegionOne) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:40.008858 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2befd-8210-4331-a1f3-8771f3f12a0b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:40.010766 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2befd-8210-4331-a1f3-8771f3f12a0b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:40.017368 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 450/900] 10.222.0.87 () {56 vars in 1272 bytes} [Fri Oct 29 01:11:39 2021] GET /identity/v3/endpoints?service_id=8588a7c341064e799b18cef560010e75&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:40.024086 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a8a92-d3bc-43de-a511-c18d73eff30c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:40.035543 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a8a92-d3bc-43de-a511-c18d73eff30c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:40.041092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cfe06-059d-419d-8209-e5ffc0b483a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:40.042173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cfe06-059d-419d-8209-e5ffc0b483a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:40.042719 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cfe06-059d-419d-8209-e5ffc0b483a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:40.043196 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cfe06-059d-419d-8209-e5ffc0b483a9 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:40.044250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cfe06-059d-419d-8209-e5ffc0b483a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:40.046291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cfe06-059d-419d-8209-e5ffc0b483a9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:40.054383 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 451/901] 10.222.0.87 () {56 vars in 1108 bytes} [Fri Oct 29 01:11:40 2021] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:11:40.137171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fde40-2e48-4d74-99dc-a2aad4047786 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:40.137475 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fde40-2e48-4d74-99dc-a2aad4047786 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:40.137665 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fde40-2e48-4d74-99dc-a2aad4047786 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:40.140329 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 451/902] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:40.147174 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32e354-8dad-43b1-a66c-e2e5edf34d9c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:40.147492 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32e354-8dad-43b1-a66c-e2e5edf34d9c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:40.147718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32e354-8dad-43b1-a66c-e2e5edf34d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:40.167978 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-7a32e354-8dad-43b1-a66c-e2e5edf34d9c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:40.169193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-7a32e354-8dad-43b1-a66c-e2e5edf34d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:40.178571 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 452/903] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:40 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:40.203517 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fde40-2e48-4d74-99dc-a2aad4047786 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:40.216396 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fde40-2e48-4d74-99dc-a2aad4047786 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:40.221774 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c35167-6b15-4832-9522-8235e492a8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:40.222584 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c35167-6b15-4832-9522-8235e492a8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:40.222859 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c35167-6b15-4832-9522-8235e492a8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:40.223129 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c35167-6b15-4832-9522-8235e492a8a3 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:40.223828 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c35167-6b15-4832-9522-8235e492a8a3 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:40.225466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c35167-6b15-4832-9522-8235e492a8a3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:40.238042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-24c35167-6b15-4832-9522-8235e492a8a3 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 01:11:40.239621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 452/904] 10.222.0.87 () {56 vars in 1126 bytes} [Fri Oct 29 01:11:40 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:40.246340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32e354-8dad-43b1-a66c-e2e5edf34d9c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:40.256481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32e354-8dad-43b1-a66c-e2e5edf34d9c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:40.261836 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b126677-29f8-4b5c-b342-b681d251fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:40.262524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b126677-29f8-4b5c-b342-b681d251fec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:40.262803 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b126677-29f8-4b5c-b342-b681d251fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:40.263073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b126677-29f8-4b5c-b342-b681d251fec5 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:40.264376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b126677-29f8-4b5c-b342-b681d251fec5 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:40.264681 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b126677-29f8-4b5c-b342-b681d251fec5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:40.266308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b126677-29f8-4b5c-b342-b681d251fec5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:40.272165 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 453/905] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:40 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:40.278880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c35167-6b15-4832-9522-8235e492a8a3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:40.289822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c35167-6b15-4832-9522-8235e492a8a3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:40.295635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04747e9-1a92-4f38-9c54-29213acb18c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:40.296421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04747e9-1a92-4f38-9c54-29213acb18c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:40.296707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04747e9-1a92-4f38-9c54-29213acb18c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:40.296982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04747e9-1a92-4f38-9c54-29213acb18c6 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:40.297708 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04747e9-1a92-4f38-9c54-29213acb18c6 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:40.298015 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04747e9-1a92-4f38-9c54-29213acb18c6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:40.299595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04747e9-1a92-4f38-9c54-29213acb18c6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:40.306005 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 453/906] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:40 2021] GET /identity/v3/services?type=image => generated 350 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:40.314989 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b126677-29f8-4b5c-b342-b681d251fec5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:40.325724 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b126677-29f8-4b5c-b342-b681d251fec5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:40.332891 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a58cb-088d-4ae4-8701-96d0189799bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:40.333548 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a58cb-088d-4ae4-8701-96d0189799bf admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:40.333870 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a58cb-088d-4ae4-8701-96d0189799bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:40.334095 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a58cb-088d-4ae4-8701-96d0189799bf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:40.334902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a58cb-088d-4ae4-8701-96d0189799bf admin admin] RBAC: Adding query filter params (interface=public, service_id=a30f5cc2968d49e9a7b53ee61b11017a, region_id=RegionOne) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:40.335211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a58cb-088d-4ae4-8701-96d0189799bf admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:40.336831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a58cb-088d-4ae4-8701-96d0189799bf admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:40.342753 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 454/907] 10.222.0.87 () {56 vars in 1272 bytes} [Fri Oct 29 01:11:40 2021] GET /identity/v3/endpoints?service_id=a30f5cc2968d49e9a7b53ee61b11017a&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:40.348949 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04747e9-1a92-4f38-9c54-29213acb18c6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:40.359574 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04747e9-1a92-4f38-9c54-29213acb18c6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:40.364333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd553c06-3038-4448-965e-303b55dd456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:40.365091 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553c06-3038-4448-965e-303b55dd456f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:40.365440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553c06-3038-4448-965e-303b55dd456f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:40.365782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553c06-3038-4448-965e-303b55dd456f admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:40.366553 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd553c06-3038-4448-965e-303b55dd456f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:40.368250 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd553c06-3038-4448-965e-303b55dd456f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:40.376004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 454/908] 10.222.0.87 () {56 vars in 1108 bytes} [Fri Oct 29 01:11:40 2021] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:11:41.249778 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e1870-965a-49fe-9e62-b597e1f27ca9 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:41.250344 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e1870-965a-49fe-9e62-b597e1f27ca9 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:41.250344 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e1870-965a-49fe-9e62-b597e1f27ca9 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:41.252234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 455/909] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:41.258400 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daee0d-3b20-451a-bae5-83b04240b30f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:41.258982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daee0d-3b20-451a-bae5-83b04240b30f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:41.259187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daee0d-3b20-451a-bae5-83b04240b30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:41.277563 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-a9daee0d-3b20-451a-bae5-83b04240b30f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:41.278737 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a9daee0d-3b20-451a-bae5-83b04240b30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:41.287406 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 455/910] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:41 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:41.313662 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e1870-965a-49fe-9e62-b597e1f27ca9 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:41.326366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e1870-965a-49fe-9e62-b597e1f27ca9 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:41.331717 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e8168-5ee0-417a-a01a-b78f9d74d6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:41.332543 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e8168-5ee0-417a-a01a-b78f9d74d6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:41.332821 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e8168-5ee0-417a-a01a-b78f9d74d6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:41.333090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e8168-5ee0-417a-a01a-b78f9d74d6a9 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:41.333752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e8168-5ee0-417a-a01a-b78f9d74d6a9 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:41.335319 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e8168-5ee0-417a-a01a-b78f9d74d6a9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:41.347545 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-f19e8168-5ee0-417a-a01a-b78f9d74d6a9 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 01:11:41.348950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 456/911] 10.222.0.87 () {56 vars in 1147 bytes} [Fri Oct 29 01:11:41 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:41.355434 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9daee0d-3b20-451a-bae5-83b04240b30f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:41.365592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9daee0d-3b20-451a-bae5-83b04240b30f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:41.370442 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c7d40-da38-4d69-9109-f2dfae577ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:41.371174 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c7d40-da38-4d69-9109-f2dfae577ecd admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:41.371526 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c7d40-da38-4d69-9109-f2dfae577ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:41.371927 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c7d40-da38-4d69-9109-f2dfae577ecd admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:41.373493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c7d40-da38-4d69-9109-f2dfae577ecd admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:41.374021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c7d40-da38-4d69-9109-f2dfae577ecd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:41.375951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c7d40-da38-4d69-9109-f2dfae577ecd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:41.394374 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 456/912] 10.222.0.87 () {56 vars in 1143 bytes} [Fri Oct 29 01:11:41 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:41.400848 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e8168-5ee0-417a-a01a-b78f9d74d6a9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:41.410983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e8168-5ee0-417a-a01a-b78f9d74d6a9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:41.415655 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3abc35-b506-4146-861e-30dfbe03b843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:41.416334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3abc35-b506-4146-861e-30dfbe03b843 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:41.416612 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3abc35-b506-4146-861e-30dfbe03b843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:41.416881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3abc35-b506-4146-861e-30dfbe03b843 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:41.417631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3abc35-b506-4146-861e-30dfbe03b843 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:41.417936 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3abc35-b506-4146-861e-30dfbe03b843 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:41.419599 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3abc35-b506-4146-861e-30dfbe03b843 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:41.424928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 457/913] 10.222.0.87 () {56 vars in 1143 bytes} [Fri Oct 29 01:11:41 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:41.431597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c7d40-da38-4d69-9109-f2dfae577ecd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:41.441796 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c7d40-da38-4d69-9109-f2dfae577ecd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:41.446612 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd55b0-05aa-493a-be5a-4dc972870ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:41.447331 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd55b0-05aa-493a-be5a-4dc972870ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:41.447616 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd55b0-05aa-493a-be5a-4dc972870ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:41.447933 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd55b0-05aa-493a-be5a-4dc972870ca0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:41.448694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd55b0-05aa-493a-be5a-4dc972870ca0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:41.449697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-dadd55b0-05aa-493a-be5a-4dc972870ca0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:41.449697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:11:41.449697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:11:41.450569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd55b0-05aa-493a-be5a-4dc972870ca0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:41.519915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 457/914] 10.222.0.87 () {60 vars in 1165 bytes} [Fri Oct 29 01:11:41 2021] POST /identity/v3/endpoints => generated 325 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:42.398358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfe6a7-676d-443c-aa13-a35c906e299b None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:42.398864 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfe6a7-676d-443c-aa13-a35c906e299b None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:42.398939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfe6a7-676d-443c-aa13-a35c906e299b None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:42.400839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 458/915] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:42.407271 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426adf6a-6bb6-4513-a1a6-711251206c6c None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:42.407688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426adf6a-6bb6-4513-a1a6-711251206c6c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:42.407835 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426adf6a-6bb6-4513-a1a6-711251206c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:42.425955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-426adf6a-6bb6-4513-a1a6-711251206c6c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:42.427126 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-426adf6a-6bb6-4513-a1a6-711251206c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:42.444683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 458/916] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:42 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:42.468473 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfe6a7-676d-443c-aa13-a35c906e299b None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:42.480470 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfe6a7-676d-443c-aa13-a35c906e299b None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:42.485538 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9158c2-f6e5-479a-8704-bfb9d449d07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:42.486302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9158c2-f6e5-479a-8704-bfb9d449d07f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:42.486576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9158c2-f6e5-479a-8704-bfb9d449d07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:42.486839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9158c2-f6e5-479a-8704-bfb9d449d07f admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:42.487493 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9158c2-f6e5-479a-8704-bfb9d449d07f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:42.489072 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9158c2-f6e5-479a-8704-bfb9d449d07f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:42.499861 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-0c9158c2-f6e5-479a-8704-bfb9d449d07f admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 01:11:42.501179 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 459/917] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:42 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:42.507589 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426adf6a-6bb6-4513-a1a6-711251206c6c None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:42.517200 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426adf6a-6bb6-4513-a1a6-711251206c6c None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:42.521838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32755b46-42cb-4096-aae7-22efa92dc923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:42.522612 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32755b46-42cb-4096-aae7-22efa92dc923 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:42.522964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32755b46-42cb-4096-aae7-22efa92dc923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:42.523314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32755b46-42cb-4096-aae7-22efa92dc923 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:42.524150 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32755b46-42cb-4096-aae7-22efa92dc923 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:42.524533 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32755b46-42cb-4096-aae7-22efa92dc923 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:42.526208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32755b46-42cb-4096-aae7-22efa92dc923 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:42.532432 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 459/918] 10.222.0.87 () {56 vars in 1133 bytes} [Fri Oct 29 01:11:42 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:42.538814 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9158c2-f6e5-479a-8704-bfb9d449d07f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:42.549878 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9158c2-f6e5-479a-8704-bfb9d449d07f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:42.554622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da8f67-dd68-42fa-9272-4a456d1b5f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:42.555308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da8f67-dd68-42fa-9272-4a456d1b5f66 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:42.555588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da8f67-dd68-42fa-9272-4a456d1b5f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:42.555898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da8f67-dd68-42fa-9272-4a456d1b5f66 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:42.556638 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da8f67-dd68-42fa-9272-4a456d1b5f66 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:42.556942 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da8f67-dd68-42fa-9272-4a456d1b5f66 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:42.558562 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da8f67-dd68-42fa-9272-4a456d1b5f66 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:42.564591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 460/919] 10.222.0.87 () {56 vars in 1133 bytes} [Fri Oct 29 01:11:42 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:42.571183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32755b46-42cb-4096-aae7-22efa92dc923 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:42.581953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32755b46-42cb-4096-aae7-22efa92dc923 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:42.586543 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa06ad-f7b3-422d-825d-26a8e85340c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:42.587191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa06ad-f7b3-422d-825d-26a8e85340c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:42.587468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa06ad-f7b3-422d-825d-26a8e85340c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:42.587759 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa06ad-f7b3-422d-825d-26a8e85340c1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:42.588516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa06ad-f7b3-422d-825d-26a8e85340c1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:42.590092 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa06ad-f7b3-422d-825d-26a8e85340c1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:42.645103 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 460/920] 10.222.0.87 () {60 vars in 1165 bytes} [Fri Oct 29 01:11:42 2021] POST /identity/v3/endpoints => generated 334 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:11:42.692110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73920f26-d6a2-48a5-bf19-a3d97a7543d9 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:42.692306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73920f26-d6a2-48a5-bf19-a3d97a7543d9 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:42.692571 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73920f26-d6a2-48a5-bf19-a3d97a7543d9 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:42.694909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 461/921] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:42.702227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791d70e-ca58-4ecc-98a9-732e18744df0 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:42.702585 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791d70e-ca58-4ecc-98a9-732e18744df0 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:42.702789 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791d70e-ca58-4ecc-98a9-732e18744df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:42.722838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-1791d70e-ca58-4ecc-98a9-732e18744df0 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:42.724110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1791d70e-ca58-4ecc-98a9-732e18744df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:42.743462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 461/922] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:42 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:42.768083 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73920f26-d6a2-48a5-bf19-a3d97a7543d9 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:42.781699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73920f26-d6a2-48a5-bf19-a3d97a7543d9 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:42.786356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ccd94-dfb0-43d3-ad7a-9089b29f5a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:42.787242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ccd94-dfb0-43d3-ad7a-9089b29f5a29 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:42.787591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ccd94-dfb0-43d3-ad7a-9089b29f5a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:42.787898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ccd94-dfb0-43d3-ad7a-9089b29f5a29 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:42.788568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ccd94-dfb0-43d3-ad7a-9089b29f5a29 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:42.790163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ccd94-dfb0-43d3-ad7a-9089b29f5a29 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:42.801648 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-a78ccd94-dfb0-43d3-ad7a-9089b29f5a29 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 01:11:42.803094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 462/923] 10.222.0.87 () {56 vars in 1126 bytes} [Fri Oct 29 01:11:42 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:42.810002 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791d70e-ca58-4ecc-98a9-732e18744df0 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:42.820328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791d70e-ca58-4ecc-98a9-732e18744df0 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:42.825071 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad679b-6420-4044-94e2-65c32119d062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:42.826514 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad679b-6420-4044-94e2-65c32119d062 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:42.826989 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad679b-6420-4044-94e2-65c32119d062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:42.827405 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad679b-6420-4044-94e2-65c32119d062 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:42.828246 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad679b-6420-4044-94e2-65c32119d062 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:42.828551 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad679b-6420-4044-94e2-65c32119d062 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:42.830171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad679b-6420-4044-94e2-65c32119d062 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:42.836031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 462/924] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:42 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:42.842348 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ccd94-dfb0-43d3-ad7a-9089b29f5a29 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:42.852503 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ccd94-dfb0-43d3-ad7a-9089b29f5a29 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:42.857260 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c8484-e24f-4e2c-b52f-f04f76a7c7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:42.858241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c8484-e24f-4e2c-b52f-f04f76a7c7ec admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:42.858530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c8484-e24f-4e2c-b52f-f04f76a7c7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:42.858799 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c8484-e24f-4e2c-b52f-f04f76a7c7ec admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:42.859527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c8484-e24f-4e2c-b52f-f04f76a7c7ec admin admin] RBAC: Adding query filter params (type=image) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:42.859878 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c8484-e24f-4e2c-b52f-f04f76a7c7ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:42.861483 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c8484-e24f-4e2c-b52f-f04f76a7c7ec admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:42.867132 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 463/925] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:42 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:42.874956 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad679b-6420-4044-94e2-65c32119d062 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:42.885144 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad679b-6420-4044-94e2-65c32119d062 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:42.890244 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8866f9c-bcdc-422c-9677-edcc91b18efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:42.890905 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8866f9c-bcdc-422c-9677-edcc91b18efd admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:42.891239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8866f9c-bcdc-422c-9677-edcc91b18efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:42.891519 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8866f9c-bcdc-422c-9677-edcc91b18efd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:42.892332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8866f9c-bcdc-422c-9677-edcc91b18efd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:42.893915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8866f9c-bcdc-422c-9677-edcc91b18efd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:42.965076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 463/926] 10.222.0.87 () {60 vars in 1165 bytes} [Fri Oct 29 01:11:42 2021] POST /identity/v3/endpoints => generated 327 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:43.826195 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db252610-aafd-4d08-a4ce-24f5d19a9b33 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:43.826723 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db252610-aafd-4d08-a4ce-24f5d19a9b33 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:43.826723 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db252610-aafd-4d08-a4ce-24f5d19a9b33 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:43.828821 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 464/927] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:43.835047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33791f-17a5-48fb-91e5-5c0690e2bc03 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:43.835504 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33791f-17a5-48fb-91e5-5c0690e2bc03 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:43.835702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33791f-17a5-48fb-91e5-5c0690e2bc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:43.854350 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-1c33791f-17a5-48fb-91e5-5c0690e2bc03 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:43.855541 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1c33791f-17a5-48fb-91e5-5c0690e2bc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:43.880188 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 464/928] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:43.905442 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db252610-aafd-4d08-a4ce-24f5d19a9b33 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:43.917496 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db252610-aafd-4d08-a4ce-24f5d19a9b33 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:43.923104 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f20ec0-938b-410a-8309-41f5eaabf71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:43.923922 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f20ec0-938b-410a-8309-41f5eaabf71c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:43.924201 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f20ec0-938b-410a-8309-41f5eaabf71c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:43.924471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f20ec0-938b-410a-8309-41f5eaabf71c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:43.925659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f20ec0-938b-410a-8309-41f5eaabf71c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:43.927332 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f20ec0-938b-410a-8309-41f5eaabf71c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:43.929115 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 465/929] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:43.935620 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33791f-17a5-48fb-91e5-5c0690e2bc03 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:43.944785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33791f-17a5-48fb-91e5-5c0690e2bc03 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:43.949340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b95ea-18bb-45f0-b955-1107041f689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:43.950018 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b95ea-18bb-45f0-b955-1107041f689a admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:43.950296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b95ea-18bb-45f0-b955-1107041f689a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:43.950567 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b95ea-18bb-45f0-b955-1107041f689a admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:43.951889 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b95ea-18bb-45f0-b955-1107041f689a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:43.954045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b95ea-18bb-45f0-b955-1107041f689a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:44.074361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 465/930] 10.222.0.87 () {60 vars in 1162 bytes} [Fri Oct 29 01:11:43 2021] POST /identity/v3/projects => generated 311 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:11:45.163155 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc1ce9-0426-463c-be6b-69372db18130 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.163670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc1ce9-0426-463c-be6b-69372db18130 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.163670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc1ce9-0426-463c-be6b-69372db18130 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.165706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 466/931] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:45.172892 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68b0fa-74a9-4db5-b9fd-111197bc873c None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.173432 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68b0fa-74a9-4db5-b9fd-111197bc873c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.173432 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68b0fa-74a9-4db5-b9fd-111197bc873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.191666 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-de68b0fa-74a9-4db5-b9fd-111197bc873c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:45.195849 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-de68b0fa-74a9-4db5-b9fd-111197bc873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:45.262230 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 466/932] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:45.287248 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc1ce9-0426-463c-be6b-69372db18130 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:45.300975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc1ce9-0426-463c-be6b-69372db18130 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:45.301630 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bf6c3-5226-4b3b-9bbf-4adbe6757c30 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.301938 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bf6c3-5226-4b3b-9bbf-4adbe6757c30 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.302221 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bf6c3-5226-4b3b-9bbf-4adbe6757c30 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.304295 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 467/933] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:11:45.305745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5ffc2-897d-4b7d-aad0-306b412da615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:45.306630 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5ffc2-897d-4b7d-aad0-306b412da615 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.307201 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5ffc2-897d-4b7d-aad0-306b412da615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.307576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5ffc2-897d-4b7d-aad0-306b412da615 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.310606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d356c-fddb-4ed4-9d8b-0da8dd870abf None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.311289 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d356c-fddb-4ed4-9d8b-0da8dd870abf None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.311289 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d356c-fddb-4ed4-9d8b-0da8dd870abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.322159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5ffc2-897d-4b7d-aad0-306b412da615 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:45.329657 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-a9d5ffc2-897d-4b7d-aad0-306b412da615 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 01:11:45.330543 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-482d356c-fddb-4ed4-9d8b-0da8dd870abf None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:45.331084 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 467/934] 10.222.0.87 () {56 vars in 1141 bytes} [Fri Oct 29 01:11:45 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:45.332762 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-482d356c-fddb-4ed4-9d8b-0da8dd870abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:45.337766 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5ffc2-897d-4b7d-aad0-306b412da615 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:45.340881 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 468/935] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:11:45.348431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5ffc2-897d-4b7d-aad0-306b412da615 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:45.353059 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98e3cd-cc51-4595-b9ac-24a340fe9009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:45.353711 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98e3cd-cc51-4595-b9ac-24a340fe9009 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.353985 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98e3cd-cc51-4595-b9ac-24a340fe9009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.354252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98e3cd-cc51-4595-b9ac-24a340fe9009 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.355009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98e3cd-cc51-4595-b9ac-24a340fe9009 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:45.355306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98e3cd-cc51-4595-b9ac-24a340fe9009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:45.357598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98e3cd-cc51-4595-b9ac-24a340fe9009 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:45.365848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d356c-fddb-4ed4-9d8b-0da8dd870abf None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:45.366761 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 468/936] 10.222.0.87 () {56 vars in 1136 bytes} [Fri Oct 29 01:11:45 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:45.372947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98e3cd-cc51-4595-b9ac-24a340fe9009 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:45.377193 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d356c-fddb-4ed4-9d8b-0da8dd870abf None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:45.381986 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d6bb-d903-400c-9865-9d8a1360bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:45.382640 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d6bb-d903-400c-9865-9d8a1360bdff admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.382917 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d6bb-d903-400c-9865-9d8a1360bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.383013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98e3cd-cc51-4595-b9ac-24a340fe9009 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:45.383186 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d6bb-d903-400c-9865-9d8a1360bdff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.387690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8d4bd-69fc-43a3-aeb8-b1e8ee0d23d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:45.388362 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8d4bd-69fc-43a3-aeb8-b1e8ee0d23d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.388702 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8d4bd-69fc-43a3-aeb8-b1e8ee0d23d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.388884 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8d4bd-69fc-43a3-aeb8-b1e8ee0d23d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.392167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3d6bb-d903-400c-9865-9d8a1360bdff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:45.394063 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3d6bb-d903-400c-9865-9d8a1360bdff admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:45.399993 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8d4bd-69fc-43a3-aeb8-b1e8ee0d23d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:45.401835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8d4bd-69fc-43a3-aeb8-b1e8ee0d23d5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:45.404389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 469/937] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:45 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:11:45.410986 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d6bb-d903-400c-9865-9d8a1360bdff admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:45.420776 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d6bb-d903-400c-9865-9d8a1360bdff admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:45.422166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-cbc8d4bd-69fc-43a3-aeb8-b1e8ee0d23d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:45.423649 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 469/938] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:45.425975 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77a15a-6d32-41c7-828f-e5bbb0f5f8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:45.426771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77a15a-6d32-41c7-828f-e5bbb0f5f8ce admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.427046 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77a15a-6d32-41c7-828f-e5bbb0f5f8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.427311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77a15a-6d32-41c7-828f-e5bbb0f5f8ce admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.428904 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77a15a-6d32-41c7-828f-e5bbb0f5f8ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:45.429849 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8d4bd-69fc-43a3-aeb8-b1e8ee0d23d5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:45.430634 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77a15a-6d32-41c7-828f-e5bbb0f5f8ce admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:45.432454 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 470/939] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:45.444152 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8d4bd-69fc-43a3-aeb8-b1e8ee0d23d5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:45.448977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7022b-a37f-4b05-894c-2907d8b072ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:45.449670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7022b-a37f-4b05-894c-2907d8b072ba admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.449978 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7022b-a37f-4b05-894c-2907d8b072ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.450217 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7022b-a37f-4b05-894c-2907d8b072ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.452018 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7022b-a37f-4b05-894c-2907d8b072ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:45.452326 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7022b-a37f-4b05-894c-2907d8b072ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:45.453984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7022b-a37f-4b05-894c-2907d8b072ba admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:45.468760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 470/940] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:45.475246 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77a15a-6d32-41c7-828f-e5bbb0f5f8ce admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:45.489491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77a15a-6d32-41c7-828f-e5bbb0f5f8ce admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:45.494285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0c48f-dbf4-4802-8a4e-e12736395764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:45.495119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0c48f-dbf4-4802-8a4e-e12736395764 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.495401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0c48f-dbf4-4802-8a4e-e12736395764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.495676 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0c48f-dbf4-4802-8a4e-e12736395764 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.504999 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0c48f-dbf4-4802-8a4e-e12736395764 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:45.507065 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0c48f-dbf4-4802-8a4e-e12736395764 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:45.523053 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-1ed0c48f-dbf4-4802-8a4e-e12736395764 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 01:11:45.524591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 471/941] 10.222.0.87 () {56 vars in 1114 bytes} [Fri Oct 29 01:11:45 2021] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:45.532043 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7022b-a37f-4b05-894c-2907d8b072ba admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:45.542307 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7022b-a37f-4b05-894c-2907d8b072ba admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:45.547186 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db027b3-6fe9-4c8c-bde6-9a65dd2d41ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:45.547996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db027b3-6fe9-4c8c-bde6-9a65dd2d41ba admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.548346 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db027b3-6fe9-4c8c-bde6-9a65dd2d41ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.548717 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db027b3-6fe9-4c8c-bde6-9a65dd2d41ba admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.549641 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db027b3-6fe9-4c8c-bde6-9a65dd2d41ba admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:45.550014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db027b3-6fe9-4c8c-bde6-9a65dd2d41ba admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:45.552027 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db027b3-6fe9-4c8c-bde6-9a65dd2d41ba admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:45.572905 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 471/942] 10.222.0.87 () {56 vars in 1154 bytes} [Fri Oct 29 01:11:45 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:45.580402 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0c48f-dbf4-4802-8a4e-e12736395764 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:45.590737 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0c48f-dbf4-4802-8a4e-e12736395764 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:45.597041 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabee71-fc0e-4c43-9a6b-7314448980b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:45.597817 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabee71-fc0e-4c43-9a6b-7314448980b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.598107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabee71-fc0e-4c43-9a6b-7314448980b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.598409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabee71-fc0e-4c43-9a6b-7314448980b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.608183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabee71-fc0e-4c43-9a6b-7314448980b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:45.610006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabee71-fc0e-4c43-9a6b-7314448980b2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:45.621160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 472/943] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:45 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:45.627382 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db027b3-6fe9-4c8c-bde6-9a65dd2d41ba admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:45.638616 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db027b3-6fe9-4c8c-bde6-9a65dd2d41ba admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:45.643866 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8d6db-ba49-42ba-b474-def1749b4963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:45.644773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d6db-ba49-42ba-b474-def1749b4963 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.645143 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d6db-ba49-42ba-b474-def1749b4963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.645482 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d6db-ba49-42ba-b474-def1749b4963 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.657718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8d6db-ba49-42ba-b474-def1749b4963 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:45.659606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8d6db-ba49-42ba-b474-def1749b4963 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:45.679337 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-09f8d6db-ba49-42ba-b474-def1749b4963 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:45.680905 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 472/944] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:45.687530 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabee71-fc0e-4c43-9a6b-7314448980b2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:45.697364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabee71-fc0e-4c43-9a6b-7314448980b2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:45.705680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b93f11-bb68-4917-8c77-0a7b762bd1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:45.706369 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b93f11-bb68-4917-8c77-0a7b762bd1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.706653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b93f11-bb68-4917-8c77-0a7b762bd1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.706928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b93f11-bb68-4917-8c77-0a7b762bd1d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.707691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b93f11-bb68-4917-8c77-0a7b762bd1d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:45.708054 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b93f11-bb68-4917-8c77-0a7b762bd1d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:45.709683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b93f11-bb68-4917-8c77-0a7b762bd1d3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:45.722835 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 473/945] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:45.729853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8d6db-ba49-42ba-b474-def1749b4963 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:45.741615 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8d6db-ba49-42ba-b474-def1749b4963 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:45.746614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbf25e-9466-4b8b-8172-bcb2c92c82fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:45.747445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbf25e-9466-4b8b-8172-bcb2c92c82fe admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.748474 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbf25e-9466-4b8b-8172-bcb2c92c82fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.748976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbf25e-9466-4b8b-8172-bcb2c92c82fe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.756954 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbf25e-9466-4b8b-8172-bcb2c92c82fe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:45.758890 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbf25e-9466-4b8b-8172-bcb2c92c82fe admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:45.772771 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-9ebbf25e-9466-4b8b-8172-bcb2c92c82fe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:45.774151 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 473/946] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:45.780674 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b93f11-bb68-4917-8c77-0a7b762bd1d3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:45.790793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b93f11-bb68-4917-8c77-0a7b762bd1d3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:45.796093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68babb6-acad-40b2-9115-00aa8918b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:45.796752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68babb6-acad-40b2-9115-00aa8918b712 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.797031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68babb6-acad-40b2-9115-00aa8918b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.797304 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68babb6-acad-40b2-9115-00aa8918b712 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.798101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68babb6-acad-40b2-9115-00aa8918b712 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:45.798407 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68babb6-acad-40b2-9115-00aa8918b712 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:45.800285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68babb6-acad-40b2-9115-00aa8918b712 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:45.813455 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 474/947] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:45.821090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbf25e-9466-4b8b-8172-bcb2c92c82fe admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:45.831622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbf25e-9466-4b8b-8172-bcb2c92c82fe admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:45.836120 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60b6c0-1412-4679-9858-bc98ad06463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:45.836745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60b6c0-1412-4679-9858-bc98ad06463c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:45.837025 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60b6c0-1412-4679-9858-bc98ad06463c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:45.837294 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60b6c0-1412-4679-9858-bc98ad06463c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:45.838121 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60b6c0-1412-4679-9858-bc98ad06463c admin admin] RBAC: Adding query filter params (role.id=ffc892d848ec45c7b84e21038a4ed135, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=28d331f2997547968c51fec87598420f) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:45.838430 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60b6c0-1412-4679-9858-bc98ad06463c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:45.840257 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60b6c0-1412-4679-9858-bc98ad06463c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:45.846192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 474/948] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:45 2021] GET /identity/v3/role_assignments?user.id=28d331f2997547968c51fec87598420f&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=ffc892d848ec45c7b84e21038a4ed135 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:46.441018 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b45868-1d19-47bf-bdb6-24fd9110e5f3 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:46.441569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b45868-1d19-47bf-bdb6-24fd9110e5f3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:46.441569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b45868-1d19-47bf-bdb6-24fd9110e5f3 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:46.443354 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 475/949] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:46.450196 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cc1d4-79e6-4d45-848d-46ade17e2054 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:46.450787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cc1d4-79e6-4d45-848d-46ade17e2054 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:46.450787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cc1d4-79e6-4d45-848d-46ade17e2054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:46.469391 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-bf1cc1d4-79e6-4d45-848d-46ade17e2054 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:46.470585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-bf1cc1d4-79e6-4d45-848d-46ade17e2054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:46.478604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 475/950] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:46.507999 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b45868-1d19-47bf-bdb6-24fd9110e5f3 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:46.520871 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b45868-1d19-47bf-bdb6-24fd9110e5f3 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:46.525224 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4e9ee-81f6-4efd-8ebe-392c30389d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:46.526006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4e9ee-81f6-4efd-8ebe-392c30389d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:46.526284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4e9ee-81f6-4efd-8ebe-392c30389d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:46.526554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4e9ee-81f6-4efd-8ebe-392c30389d1b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:46.527755 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4e9ee-81f6-4efd-8ebe-392c30389d1b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:46.530050 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4e9ee-81f6-4efd-8ebe-392c30389d1b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:46.531828 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 476/951] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:46.538273 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cc1d4-79e6-4d45-848d-46ade17e2054 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:46.547989 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cc1d4-79e6-4d45-848d-46ade17e2054 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:46.552465 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533be85f-691e-4d54-81f6-24ad4390029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:46.553115 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533be85f-691e-4d54-81f6-24ad4390029f admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:46.553397 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533be85f-691e-4d54-81f6-24ad4390029f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:46.553666 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533be85f-691e-4d54-81f6-24ad4390029f admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:46.554394 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533be85f-691e-4d54-81f6-24ad4390029f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:46.556294 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533be85f-691e-4d54-81f6-24ad4390029f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:46.638722 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 476/952] 10.222.0.87 () {60 vars in 1153 bytes} [Fri Oct 29 01:11:46 2021] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:48.115582 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d266383-85ab-454f-a25a-458687988b5f None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:48.116130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d266383-85ab-454f-a25a-458687988b5f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:48.116513 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d266383-85ab-454f-a25a-458687988b5f None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:48.119572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 477/953] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:48 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:48.126191 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49694dfa-b95a-4194-9b54-3fd5e00870a7 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:48.126625 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49694dfa-b95a-4194-9b54-3fd5e00870a7 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:48.126717 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49694dfa-b95a-4194-9b54-3fd5e00870a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:48.145132 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-49694dfa-b95a-4194-9b54-3fd5e00870a7 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:48.146298 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-49694dfa-b95a-4194-9b54-3fd5e00870a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:48.154546 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 477/954] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:48.179559 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d266383-85ab-454f-a25a-458687988b5f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:48.191922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d266383-85ab-454f-a25a-458687988b5f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:48.196521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb608f-5503-4b86-ad0f-95ffcf316ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:48.197308 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb608f-5503-4b86-ad0f-95ffcf316ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:48.197590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb608f-5503-4b86-ad0f-95ffcf316ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:48.197864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb608f-5503-4b86-ad0f-95ffcf316ce5 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:48.207906 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb608f-5503-4b86-ad0f-95ffcf316ce5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:48.215077 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-f2bb608f-5503-4b86-ad0f-95ffcf316ce5 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 01:11:48.216890 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 478/955] 10.222.0.87 () {56 vars in 1141 bytes} [Fri Oct 29 01:11:48 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:48.223557 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49694dfa-b95a-4194-9b54-3fd5e00870a7 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:48.233224 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49694dfa-b95a-4194-9b54-3fd5e00870a7 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:48.238292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa294d0c-70db-4798-9346-cd6fb8b107fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:48.238955 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa294d0c-70db-4798-9346-cd6fb8b107fd admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:48.239231 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa294d0c-70db-4798-9346-cd6fb8b107fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:48.239500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa294d0c-70db-4798-9346-cd6fb8b107fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:48.240297 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa294d0c-70db-4798-9346-cd6fb8b107fd admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:48.240579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa294d0c-70db-4798-9346-cd6fb8b107fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:48.242170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa294d0c-70db-4798-9346-cd6fb8b107fd admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:48.251460 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 478/956] 10.222.0.87 () {56 vars in 1136 bytes} [Fri Oct 29 01:11:48 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:48.257811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb608f-5503-4b86-ad0f-95ffcf316ce5 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:48.269311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb608f-5503-4b86-ad0f-95ffcf316ce5 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:48.273862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c10284-d85a-406f-85ec-60f93cc70701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:48.274628 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c10284-d85a-406f-85ec-60f93cc70701 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:48.274908 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c10284-d85a-406f-85ec-60f93cc70701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:48.275182 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c10284-d85a-406f-85ec-60f93cc70701 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:48.287533 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c10284-d85a-406f-85ec-60f93cc70701 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:48.289426 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c10284-d85a-406f-85ec-60f93cc70701 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:48.307155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-69c10284-d85a-406f-85ec-60f93cc70701 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:48.308394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 479/957] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:48.316167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa294d0c-70db-4798-9346-cd6fb8b107fd admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:48.327021 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa294d0c-70db-4798-9346-cd6fb8b107fd admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:48.331542 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c988e-c3bf-4703-ac29-8e3611ad1f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:48.332215 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c988e-c3bf-4703-ac29-8e3611ad1f12 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:48.332495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c988e-c3bf-4703-ac29-8e3611ad1f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:48.332759 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c988e-c3bf-4703-ac29-8e3611ad1f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:48.333538 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c988e-c3bf-4703-ac29-8e3611ad1f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:48.333837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c988e-c3bf-4703-ac29-8e3611ad1f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:48.335389 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c988e-c3bf-4703-ac29-8e3611ad1f12 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:48.347534 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 479/958] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:48.353813 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c10284-d85a-406f-85ec-60f93cc70701 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:48.372107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c10284-d85a-406f-85ec-60f93cc70701 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:48.377978 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44f5f7-2b8e-4189-9384-e2fd90d1a79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:48.378699 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44f5f7-2b8e-4189-9384-e2fd90d1a79c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:48.378974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44f5f7-2b8e-4189-9384-e2fd90d1a79c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:48.379242 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44f5f7-2b8e-4189-9384-e2fd90d1a79c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:48.386978 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44f5f7-2b8e-4189-9384-e2fd90d1a79c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:48.389657 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44f5f7-2b8e-4189-9384-e2fd90d1a79c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:48.403303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-de44f5f7-2b8e-4189-9384-e2fd90d1a79c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 01:11:48.404877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 480/959] 10.222.0.87 () {56 vars in 1114 bytes} [Fri Oct 29 01:11:48 2021] GET /identity/v3/users/nova => generated 82 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:48.411223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c988e-c3bf-4703-ac29-8e3611ad1f12 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:48.421086 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c988e-c3bf-4703-ac29-8e3611ad1f12 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:48.425703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152c32f-b991-40e6-b1fc-0e8f063a6ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:48.426345 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152c32f-b991-40e6-b1fc-0e8f063a6ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:48.426620 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152c32f-b991-40e6-b1fc-0e8f063a6ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:48.426885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152c32f-b991-40e6-b1fc-0e8f063a6ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:48.427724 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152c32f-b991-40e6-b1fc-0e8f063a6ab9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:48.428049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152c32f-b991-40e6-b1fc-0e8f063a6ab9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:48.429864 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152c32f-b991-40e6-b1fc-0e8f063a6ab9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:48.451527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 480/960] 10.222.0.87 () {56 vars in 1154 bytes} [Fri Oct 29 01:11:48 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:48.457697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44f5f7-2b8e-4189-9384-e2fd90d1a79c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:48.467606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44f5f7-2b8e-4189-9384-e2fd90d1a79c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:48.472170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dfb90-bd70-4ee8-bec0-26a860b26684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:48.472948 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dfb90-bd70-4ee8-bec0-26a860b26684 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:48.473232 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dfb90-bd70-4ee8-bec0-26a860b26684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:48.473507 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dfb90-bd70-4ee8-bec0-26a860b26684 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:48.484601 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dfb90-bd70-4ee8-bec0-26a860b26684 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:48.486427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dfb90-bd70-4ee8-bec0-26a860b26684 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:48.504075 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-759dfb90-bd70-4ee8-bec0-26a860b26684 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:48.505303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 481/961] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:48.512035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152c32f-b991-40e6-b1fc-0e8f063a6ab9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:48.521932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152c32f-b991-40e6-b1fc-0e8f063a6ab9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:48.526403 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10060d06-50de-448e-890a-6acfe8456932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:48.527048 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10060d06-50de-448e-890a-6acfe8456932 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:48.527324 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10060d06-50de-448e-890a-6acfe8456932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:48.527592 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10060d06-50de-448e-890a-6acfe8456932 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:48.528353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10060d06-50de-448e-890a-6acfe8456932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:48.528708 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10060d06-50de-448e-890a-6acfe8456932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:48.530280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10060d06-50de-448e-890a-6acfe8456932 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:48.541318 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 481/962] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:48.548206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dfb90-bd70-4ee8-bec0-26a860b26684 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:48.557630 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dfb90-bd70-4ee8-bec0-26a860b26684 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:48.563085 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23110bc3-04ba-4428-a164-74c4330a18b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:48.563905 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110bc3-04ba-4428-a164-74c4330a18b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:48.564187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110bc3-04ba-4428-a164-74c4330a18b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:48.564466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110bc3-04ba-4428-a164-74c4330a18b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:48.571553 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23110bc3-04ba-4428-a164-74c4330a18b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:48.573515 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23110bc3-04ba-4428-a164-74c4330a18b2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:48.586171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-23110bc3-04ba-4428-a164-74c4330a18b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:48.587487 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 482/963] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:48.593734 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10060d06-50de-448e-890a-6acfe8456932 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:48.603322 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10060d06-50de-448e-890a-6acfe8456932 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:48.608369 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d73eef-f21f-4e48-b3fa-2786976fb7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:48.609005 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d73eef-f21f-4e48-b3fa-2786976fb7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:48.609286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d73eef-f21f-4e48-b3fa-2786976fb7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:48.609560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d73eef-f21f-4e48-b3fa-2786976fb7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:48.610350 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d73eef-f21f-4e48-b3fa-2786976fb7e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:48.610656 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d73eef-f21f-4e48-b3fa-2786976fb7e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:48.612506 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d73eef-f21f-4e48-b3fa-2786976fb7e8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:48.624990 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 482/964] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:48.631574 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23110bc3-04ba-4428-a164-74c4330a18b2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:48.642788 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23110bc3-04ba-4428-a164-74c4330a18b2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:48.647328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac0a77-789c-454f-b4ae-2cb8416919ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:48.648227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac0a77-789c-454f-b4ae-2cb8416919ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:48.648508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac0a77-789c-454f-b4ae-2cb8416919ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:48.648778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac0a77-789c-454f-b4ae-2cb8416919ac admin admin] PATH_INFO: `/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/28d331f2997547968c51fec87598420f/roles/ffc892d848ec45c7b84e21038a4ed135` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:48.650987 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac0a77-789c-454f-b4ae-2cb8416919ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579ca0c9e3d480ab7b4f64d199c403b, user_id=28d331f2997547968c51fec87598420f, role_id=ffc892d848ec45c7b84e21038a4ed135)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:48.653618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac0a77-789c-454f-b4ae-2cb8416919ac admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:48.758148 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 483/965] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:11:48 2021] PUT /identity/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/28d331f2997547968c51fec87598420f/roles/ffc892d848ec45c7b84e21038a4ed135 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:11:49.011531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10780f56-3be1-4d7f-8448-bc300e6626ff None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:49.011765 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10780f56-3be1-4d7f-8448-bc300e6626ff None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:49.012040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10780f56-3be1-4d7f-8448-bc300e6626ff None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:49.014173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 483/966] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:49.020311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48036e50-32b2-4154-b44a-8c0b595ba53e None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:49.020600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48036e50-32b2-4154-b44a-8c0b595ba53e None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:49.020876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48036e50-32b2-4154-b44a-8c0b595ba53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:49.038900 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-48036e50-32b2-4154-b44a-8c0b595ba53e None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:49.040102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-48036e50-32b2-4154-b44a-8c0b595ba53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:49.097209 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 484/967] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:49 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:49.122452 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10780f56-3be1-4d7f-8448-bc300e6626ff None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:49.134617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10780f56-3be1-4d7f-8448-bc300e6626ff None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:49.139157 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95acb49-a255-4be2-8f09-c2d04af0e1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:49.139951 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95acb49-a255-4be2-8f09-c2d04af0e1af admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:49.140226 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95acb49-a255-4be2-8f09-c2d04af0e1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:49.140488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95acb49-a255-4be2-8f09-c2d04af0e1af admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:49.150322 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95acb49-a255-4be2-8f09-c2d04af0e1af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:49.157462 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-c95acb49-a255-4be2-8f09-c2d04af0e1af admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:11:49.158629 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 484/968] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:49.165413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48036e50-32b2-4154-b44a-8c0b595ba53e None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:49.174998 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48036e50-32b2-4154-b44a-8c0b595ba53e None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:49.179479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaea6a5-2826-4a49-a417-7bb2d874f704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:49.180167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaea6a5-2826-4a49-a417-7bb2d874f704 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:49.180446 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaea6a5-2826-4a49-a417-7bb2d874f704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:49.180715 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaea6a5-2826-4a49-a417-7bb2d874f704 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:49.181478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaea6a5-2826-4a49-a417-7bb2d874f704 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:49.181785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaea6a5-2826-4a49-a417-7bb2d874f704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:49.183379 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaea6a5-2826-4a49-a417-7bb2d874f704 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:49.191650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 485/969] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:49.198217 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95acb49-a255-4be2-8f09-c2d04af0e1af admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:49.208791 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95acb49-a255-4be2-8f09-c2d04af0e1af admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:49.213237 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e2079-7ed0-40f3-a862-e385608884f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:49.214054 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e2079-7ed0-40f3-a862-e385608884f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:49.214332 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e2079-7ed0-40f3-a862-e385608884f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:49.214600 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e2079-7ed0-40f3-a862-e385608884f4 admin admin] PATH_INFO: `/v3/users/3726bba2a49648118639a905c87fb052` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:49.227470 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e2079-7ed0-40f3-a862-e385608884f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=3726bba2a49648118639a905c87fb052)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:49.229577 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e2079-7ed0-40f3-a862-e385608884f4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:49.231174 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 485/970] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:11:49 2021] GET /identity/v3/users/3726bba2a49648118639a905c87fb052 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:49.238774 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaea6a5-2826-4a49-a417-7bb2d874f704 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:49.248946 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaea6a5-2826-4a49-a417-7bb2d874f704 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:49.253467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b3984-40c3-4224-b34b-02817a4b09b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:49.254108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b3984-40c3-4224-b34b-02817a4b09b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:49.254387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b3984-40c3-4224-b34b-02817a4b09b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:49.254660 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b3984-40c3-4224-b34b-02817a4b09b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:49.262587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b3984-40c3-4224-b34b-02817a4b09b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:49.264420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b3984-40c3-4224-b34b-02817a4b09b5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:49.273422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 486/971] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:49 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:49.280629 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e2079-7ed0-40f3-a862-e385608884f4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:49.290540 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e2079-7ed0-40f3-a862-e385608884f4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:49.295593 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555cadb-48be-426b-8317-a054134e8c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:49.296464 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555cadb-48be-426b-8317-a054134e8c79 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:49.296741 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555cadb-48be-426b-8317-a054134e8c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:49.297009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555cadb-48be-426b-8317-a054134e8c79 admin admin] PATH_INFO: `/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:49.298182 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555cadb-48be-426b-8317-a054134e8c79 admin admin] RBAC: Authorizing `identity:get_project(project_id=1fa68fcfb24b49e6bdff78724f48ed64)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:49.300235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555cadb-48be-426b-8317-a054134e8c79 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:49.301850 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 486/972] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:11:49 2021] GET /identity/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:49.308732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b3984-40c3-4224-b34b-02817a4b09b5 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:49.318245 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b3984-40c3-4224-b34b-02817a4b09b5 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:49.327289 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da76d19-a2b4-4555-b10a-68e9910bac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:49.327289 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da76d19-a2b4-4555-b10a-68e9910bac19 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:49.327289 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da76d19-a2b4-4555-b10a-68e9910bac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:49.327289 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da76d19-a2b4-4555-b10a-68e9910bac19 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:49.327597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da76d19-a2b4-4555-b10a-68e9910bac19 admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=1fa68fcfb24b49e6bdff78724f48ed64, user.id=3726bba2a49648118639a905c87fb052) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:49.327597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da76d19-a2b4-4555-b10a-68e9910bac19 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:49.327597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da76d19-a2b4-4555-b10a-68e9910bac19 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:49.332940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 487/973] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:49 2021] GET /identity/v3/role_assignments?user.id=3726bba2a49648118639a905c87fb052&scope.project.id=1fa68fcfb24b49e6bdff78724f48ed64&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:51.037849 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cf952-1aa8-4aad-9378-f8abe3a6f4ad None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.038417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cf952-1aa8-4aad-9378-f8abe3a6f4ad None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.038417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cf952-1aa8-4aad-9378-f8abe3a6f4ad None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.040227 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 487/974] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:51.047901 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf6468-d3f6-45af-b465-f113766b4332 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.048465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf6468-d3f6-45af-b465-f113766b4332 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.048465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf6468-d3f6-45af-b465-f113766b4332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.066729 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-9fbf6468-d3f6-45af-b465-f113766b4332 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:51.067943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-9fbf6468-d3f6-45af-b465-f113766b4332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:51.076051 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 488/975] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:51 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:51.100840 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cf952-1aa8-4aad-9378-f8abe3a6f4ad None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.114287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cf952-1aa8-4aad-9378-f8abe3a6f4ad None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.118628 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3b72e-0711-46b0-a259-4cfd4803c73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.119423 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3b72e-0711-46b0-a259-4cfd4803c73f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.119703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3b72e-0711-46b0-a259-4cfd4803c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.120008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3b72e-0711-46b0-a259-4cfd4803c73f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.131070 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3b72e-0711-46b0-a259-4cfd4803c73f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:51.138832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-c9e3b72e-0711-46b0-a259-4cfd4803c73f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 01:11:51.140100 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 488/976] 10.222.0.87 () {56 vars in 1141 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:51.146745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf6468-d3f6-45af-b465-f113766b4332 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.156975 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf6468-d3f6-45af-b465-f113766b4332 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.161532 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079a6a5-1eb6-4af4-a029-a5945f5e959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.162279 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a6a5-1eb6-4af4-a029-a5945f5e959f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.162621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a6a5-1eb6-4af4-a029-a5945f5e959f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.162953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a6a5-1eb6-4af4-a029-a5945f5e959f admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.163814 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079a6a5-1eb6-4af4-a029-a5945f5e959f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:51.164118 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079a6a5-1eb6-4af4-a029-a5945f5e959f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.165704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079a6a5-1eb6-4af4-a029-a5945f5e959f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.174881 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 489/977] 10.222.0.87 () {56 vars in 1136 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:51.181175 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3b72e-0711-46b0-a259-4cfd4803c73f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.191705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3b72e-0711-46b0-a259-4cfd4803c73f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.196473 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496133de-a4f9-4dae-b3e9-23159d6dc812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.197235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496133de-a4f9-4dae-b3e9-23159d6dc812 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.197511 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496133de-a4f9-4dae-b3e9-23159d6dc812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.197775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496133de-a4f9-4dae-b3e9-23159d6dc812 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.208269 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496133de-a4f9-4dae-b3e9-23159d6dc812 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.210077 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496133de-a4f9-4dae-b3e9-23159d6dc812 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.227568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-496133de-a4f9-4dae-b3e9-23159d6dc812 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:51.228814 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 489/978] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:51.236029 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079a6a5-1eb6-4af4-a029-a5945f5e959f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.245795 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079a6a5-1eb6-4af4-a029-a5945f5e959f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.251073 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747063dd-fc22-48ea-a58f-2a2f8f939cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.251750 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747063dd-fc22-48ea-a58f-2a2f8f939cca admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.252047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747063dd-fc22-48ea-a58f-2a2f8f939cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.252322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747063dd-fc22-48ea-a58f-2a2f8f939cca admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.253054 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747063dd-fc22-48ea-a58f-2a2f8f939cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:51.253360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747063dd-fc22-48ea-a58f-2a2f8f939cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.254943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747063dd-fc22-48ea-a58f-2a2f8f939cca admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.267589 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 490/979] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:51.274107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496133de-a4f9-4dae-b3e9-23159d6dc812 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.284522 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496133de-a4f9-4dae-b3e9-23159d6dc812 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.289014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa6dca-0de2-41e9-9f14-9d35b3364d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.289785 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa6dca-0de2-41e9-9f14-9d35b3364d2b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.290063 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa6dca-0de2-41e9-9f14-9d35b3364d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.290333 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa6dca-0de2-41e9-9f14-9d35b3364d2b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.298464 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa6dca-0de2-41e9-9f14-9d35b3364d2b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.300477 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa6dca-0de2-41e9-9f14-9d35b3364d2b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.315581 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-88aa6dca-0de2-41e9-9f14-9d35b3364d2b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 01:11:51.316869 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 490/980] 10.222.0.87 () {56 vars in 1114 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:11:51.323589 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747063dd-fc22-48ea-a58f-2a2f8f939cca admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.333706 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747063dd-fc22-48ea-a58f-2a2f8f939cca admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.338349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bcad6-825f-4f0c-adeb-e078ac61b5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.339015 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bcad6-825f-4f0c-adeb-e078ac61b5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.339295 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bcad6-825f-4f0c-adeb-e078ac61b5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.339570 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bcad6-825f-4f0c-adeb-e078ac61b5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.340467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bcad6-825f-4f0c-adeb-e078ac61b5b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:51.340774 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bcad6-825f-4f0c-adeb-e078ac61b5b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.343468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bcad6-825f-4f0c-adeb-e078ac61b5b6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.363514 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 491/981] 10.222.0.87 () {56 vars in 1154 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:51.370459 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa6dca-0de2-41e9-9f14-9d35b3364d2b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.380510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa6dca-0de2-41e9-9f14-9d35b3364d2b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.385121 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7f060-0355-4c6b-9126-08f2be36f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.385676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7f060-0355-4c6b-9126-08f2be36f62c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.385949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7f060-0355-4c6b-9126-08f2be36f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.386214 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7f060-0355-4c6b-9126-08f2be36f62c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.394286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7f060-0355-4c6b-9126-08f2be36f62c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.396062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7f060-0355-4c6b-9126-08f2be36f62c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.405395 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 491/982] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:51.412070 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bcad6-825f-4f0c-adeb-e078ac61b5b6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.422538 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bcad6-825f-4f0c-adeb-e078ac61b5b6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.426968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbabd7-9455-4794-bd16-71d1f24420b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.427756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbabd7-9455-4794-bd16-71d1f24420b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.428040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbabd7-9455-4794-bd16-71d1f24420b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.428310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbabd7-9455-4794-bd16-71d1f24420b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.438949 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbabd7-9455-4794-bd16-71d1f24420b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.440791 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbabd7-9455-4794-bd16-71d1f24420b4 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.457946 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-eafbabd7-9455-4794-bd16-71d1f24420b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:11:51.459154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 492/983] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:51.465935 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7f060-0355-4c6b-9126-08f2be36f62c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.476334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7f060-0355-4c6b-9126-08f2be36f62c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.481283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f470b0d-97d5-4a3e-9735-32a260b8fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.483264 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f470b0d-97d5-4a3e-9735-32a260b8fcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.483611 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f470b0d-97d5-4a3e-9735-32a260b8fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.483976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f470b0d-97d5-4a3e-9735-32a260b8fcc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.484812 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f470b0d-97d5-4a3e-9735-32a260b8fcc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:51.485193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f470b0d-97d5-4a3e-9735-32a260b8fcc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.486908 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f470b0d-97d5-4a3e-9735-32a260b8fcc9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.500744 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 492/984] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:51.507234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbabd7-9455-4794-bd16-71d1f24420b4 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.517728 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbabd7-9455-4794-bd16-71d1f24420b4 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.522157 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7c054-91f9-41fe-8d5b-f26fe00152fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.522925 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c054-91f9-41fe-8d5b-f26fe00152fc admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.523202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c054-91f9-41fe-8d5b-f26fe00152fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.523471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c054-91f9-41fe-8d5b-f26fe00152fc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.531037 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7c054-91f9-41fe-8d5b-f26fe00152fc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.532998 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7c054-91f9-41fe-8d5b-f26fe00152fc admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.545745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-78a7c054-91f9-41fe-8d5b-f26fe00152fc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:11:51.546913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 493/985] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:51.553621 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f470b0d-97d5-4a3e-9735-32a260b8fcc9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.563442 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f470b0d-97d5-4a3e-9735-32a260b8fcc9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.567988 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68213ece-9d10-4e1b-a66a-2bd3eb291ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.568625 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68213ece-9d10-4e1b-a66a-2bd3eb291ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.569150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68213ece-9d10-4e1b-a66a-2bd3eb291ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.569419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68213ece-9d10-4e1b-a66a-2bd3eb291ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.570207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68213ece-9d10-4e1b-a66a-2bd3eb291ba1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:51.570505 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68213ece-9d10-4e1b-a66a-2bd3eb291ba1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.572344 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68213ece-9d10-4e1b-a66a-2bd3eb291ba1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.585553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 493/986] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:51.593676 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7c054-91f9-41fe-8d5b-f26fe00152fc admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.604420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7c054-91f9-41fe-8d5b-f26fe00152fc admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.609295 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1a4c4-2845-4681-b947-567495658747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.610021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1a4c4-2845-4681-b947-567495658747 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.610432 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1a4c4-2845-4681-b947-567495658747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.610843 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1a4c4-2845-4681-b947-567495658747 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.612105 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1a4c4-2845-4681-b947-567495658747 admin admin] RBAC: Adding query filter params (role.id=ffc892d848ec45c7b84e21038a4ed135, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=28d331f2997547968c51fec87598420f) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:51.612550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1a4c4-2845-4681-b947-567495658747 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.615387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1a4c4-2845-4681-b947-567495658747 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.618504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b385-a8ed-444d-91e6-74c9d829f0ab None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.618785 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b385-a8ed-444d-91e6-74c9d829f0ab None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.619055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b385-a8ed-444d-91e6-74c9d829f0ab None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.620857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 494/987] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:11:51.625902 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 494/988] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/role_assignments?user.id=28d331f2997547968c51fec87598420f&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=ffc892d848ec45c7b84e21038a4ed135 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:51.627456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2e9e1-b293-466e-b0d2-32219ec719c1 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.627750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2e9e1-b293-466e-b0d2-32219ec719c1 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.628031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2e9e1-b293-466e-b0d2-32219ec719c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.649565 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-52c2e9e1-b293-466e-b0d2-32219ec719c1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:51.650887 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-52c2e9e1-b293-466e-b0d2-32219ec719c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:51.659822 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 495/989] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:51 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:51.684041 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1a4c4-2845-4681-b947-567495658747 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.694642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1a4c4-2845-4681-b947-567495658747 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.699422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610385a-ca58-4f61-a17e-f2a7164fb0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.700751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610385a-ca58-4f61-a17e-f2a7164fb0ed admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.701033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610385a-ca58-4f61-a17e-f2a7164fb0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.701305 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610385a-ca58-4f61-a17e-f2a7164fb0ed admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.713293 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610385a-ca58-4f61-a17e-f2a7164fb0ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:51.720864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-b610385a-ca58-4f61-a17e-f2a7164fb0ed admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:11:51.722125 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 495/990] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:51.729446 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2e9e1-b293-466e-b0d2-32219ec719c1 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.739166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2e9e1-b293-466e-b0d2-32219ec719c1 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.743853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5b4f5-2bc3-4330-b393-762977991aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.744522 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5b4f5-2bc3-4330-b393-762977991aba admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.744799 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5b4f5-2bc3-4330-b393-762977991aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.745065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5b4f5-2bc3-4330-b393-762977991aba admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.745844 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5b4f5-2bc3-4330-b393-762977991aba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:51.746137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5b4f5-2bc3-4330-b393-762977991aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.747837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5b4f5-2bc3-4330-b393-762977991aba admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.758088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 496/991] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:51.765929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610385a-ca58-4f61-a17e-f2a7164fb0ed admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.776105 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610385a-ca58-4f61-a17e-f2a7164fb0ed admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.781561 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f684dd-c664-4e3b-af12-8de13101eb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.782453 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f684dd-c664-4e3b-af12-8de13101eb11 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.782730 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f684dd-c664-4e3b-af12-8de13101eb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.783003 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f684dd-c664-4e3b-af12-8de13101eb11 admin admin] PATH_INFO: `/v3/users/3726bba2a49648118639a905c87fb052` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.784415 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f684dd-c664-4e3b-af12-8de13101eb11 admin admin] RBAC: Authorizing `identity:get_user(user_id=3726bba2a49648118639a905c87fb052)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.786589 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f684dd-c664-4e3b-af12-8de13101eb11 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.788394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 496/992] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/users/3726bba2a49648118639a905c87fb052 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:51.795281 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5b4f5-2bc3-4330-b393-762977991aba admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.806398 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5b4f5-2bc3-4330-b393-762977991aba admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.814006 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88d8ee-4e66-4323-a3c3-5d152dac4168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.815287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88d8ee-4e66-4323-a3c3-5d152dac4168 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.815601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88d8ee-4e66-4323-a3c3-5d152dac4168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.815934 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88d8ee-4e66-4323-a3c3-5d152dac4168 admin admin] PATH_INFO: `/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.817840 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88d8ee-4e66-4323-a3c3-5d152dac4168 admin admin] RBAC: Authorizing `identity:get_project(project_id=1fa68fcfb24b49e6bdff78724f48ed64)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.820207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88d8ee-4e66-4323-a3c3-5d152dac4168 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.822221 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 497/993] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:11:51 2021] GET /identity/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64 => generated 311 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:51.829700 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f684dd-c664-4e3b-af12-8de13101eb11 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:51.839793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f684dd-c664-4e3b-af12-8de13101eb11 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:51.846782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6644e15-3f40-4b2b-85aa-3dd351ec8fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:51.846782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6644e15-3f40-4b2b-85aa-3dd351ec8fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:51.846782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6644e15-3f40-4b2b-85aa-3dd351ec8fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:51.846782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6644e15-3f40-4b2b-85aa-3dd351ec8fe7 admin admin] PATH_INFO: `/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64/users/3726bba2a49648118639a905c87fb052/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:51.848127 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6644e15-3f40-4b2b-85aa-3dd351ec8fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa68fcfb24b49e6bdff78724f48ed64, user_id=3726bba2a49648118639a905c87fb052, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:51.850716 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6644e15-3f40-4b2b-85aa-3dd351ec8fe7 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:51.976406 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 497/994] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:11:51 2021] PUT /identity/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64/users/3726bba2a49648118639a905c87fb052/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:11:54.377043 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b8aba-cfb1-457c-a8d8-3b6555c6e538 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:54.377659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b8aba-cfb1-457c-a8d8-3b6555c6e538 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:54.377659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b8aba-cfb1-457c-a8d8-3b6555c6e538 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:54.379406 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 498/995] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:54.386133 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78b8ba-50e7-4001-87c3-b1f019970b8f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:54.386678 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78b8ba-50e7-4001-87c3-b1f019970b8f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:54.386678 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78b8ba-50e7-4001-87c3-b1f019970b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:54.404483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-ba78b8ba-50e7-4001-87c3-b1f019970b8f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:54.405780 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-ba78b8ba-50e7-4001-87c3-b1f019970b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:54.479754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 498/996] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:54.504605 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b8aba-cfb1-457c-a8d8-3b6555c6e538 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:54.517947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b8aba-cfb1-457c-a8d8-3b6555c6e538 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:54.522288 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538f859-b28c-4a6c-bf6a-77947761d515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:54.523063 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538f859-b28c-4a6c-bf6a-77947761d515 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:54.523341 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538f859-b28c-4a6c-bf6a-77947761d515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:54.523612 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538f859-b28c-4a6c-bf6a-77947761d515 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:54.537593 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538f859-b28c-4a6c-bf6a-77947761d515 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:11:54.545158 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-b538f859-b28c-4a6c-bf6a-77947761d515 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:11:54.546358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 499/997] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:11:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:11:54.553110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78b8ba-50e7-4001-87c3-b1f019970b8f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:54.562232 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78b8ba-50e7-4001-87c3-b1f019970b8f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:54.566787 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fad1fc-93d6-4b09-b426-9a5883694db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:54.567519 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fad1fc-93d6-4b09-b426-9a5883694db3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:54.567836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fad1fc-93d6-4b09-b426-9a5883694db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:54.568110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fad1fc-93d6-4b09-b426-9a5883694db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:54.569122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fad1fc-93d6-4b09-b426-9a5883694db3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:54.569421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fad1fc-93d6-4b09-b426-9a5883694db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:54.570993 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fad1fc-93d6-4b09-b426-9a5883694db3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:54.579581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 499/998] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:11:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:54.585698 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538f859-b28c-4a6c-bf6a-77947761d515 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:54.597077 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538f859-b28c-4a6c-bf6a-77947761d515 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:54.601595 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3fc78-cdf9-4603-9e65-6ec723bf1fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:54.602428 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fc78-cdf9-4603-9e65-6ec723bf1fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:54.602709 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fc78-cdf9-4603-9e65-6ec723bf1fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:54.602984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fc78-cdf9-4603-9e65-6ec723bf1fa1 admin admin] PATH_INFO: `/v3/users/3726bba2a49648118639a905c87fb052` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:54.604235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3fc78-cdf9-4603-9e65-6ec723bf1fa1 admin admin] RBAC: Authorizing `identity:get_user(user_id=3726bba2a49648118639a905c87fb052)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:54.606306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3fc78-cdf9-4603-9e65-6ec723bf1fa1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:54.608436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 500/999] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:11:54 2021] GET /identity/v3/users/3726bba2a49648118639a905c87fb052 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:54.614413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fad1fc-93d6-4b09-b426-9a5883694db3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:54.623756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fad1fc-93d6-4b09-b426-9a5883694db3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:54.628281 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbc175-8238-49f1-981d-e0fe0aff2cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:54.628838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbc175-8238-49f1-981d-e0fe0aff2cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:54.629118 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbc175-8238-49f1-981d-e0fe0aff2cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:54.629388 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbc175-8238-49f1-981d-e0fe0aff2cb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:54.636894 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbc175-8238-49f1-981d-e0fe0aff2cb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:54.639824 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbc175-8238-49f1-981d-e0fe0aff2cb7 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:54.648429 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 500/1000] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:54 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:54.655386 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3fc78-cdf9-4603-9e65-6ec723bf1fa1 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:54.665054 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3fc78-cdf9-4603-9e65-6ec723bf1fa1 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:54.669769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194d392-f6ec-4cf1-b15c-4f5d044ecae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:54.670617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194d392-f6ec-4cf1-b15c-4f5d044ecae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:54.670893 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194d392-f6ec-4cf1-b15c-4f5d044ecae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:54.671158 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194d392-f6ec-4cf1-b15c-4f5d044ecae0 admin admin] PATH_INFO: `/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:54.672348 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194d392-f6ec-4cf1-b15c-4f5d044ecae0 admin admin] RBAC: Authorizing `identity:get_project(project_id=1fa68fcfb24b49e6bdff78724f48ed64)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:54.674326 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194d392-f6ec-4cf1-b15c-4f5d044ecae0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:54.676007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 501/1001] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:11:54 2021] GET /identity/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:11:54.682546 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbc175-8238-49f1-981d-e0fe0aff2cb7 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:54.691911 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbc175-8238-49f1-981d-e0fe0aff2cb7 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:54.696812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad8126-6932-4ff0-b8c7-0587e695a667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:54.697442 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad8126-6932-4ff0-b8c7-0587e695a667 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:54.697724 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad8126-6932-4ff0-b8c7-0587e695a667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:54.697995 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad8126-6932-4ff0-b8c7-0587e695a667 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:54.698819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad8126-6932-4ff0-b8c7-0587e695a667 admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=1fa68fcfb24b49e6bdff78724f48ed64, user.id=3726bba2a49648118639a905c87fb052) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:54.699132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad8126-6932-4ff0-b8c7-0587e695a667 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:54.701975 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad8126-6932-4ff0-b8c7-0587e695a667 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:54.707620 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 501/1002] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:54 2021] GET /identity/v3/role_assignments?user.id=3726bba2a49648118639a905c87fb052&scope.project.id=1fa68fcfb24b49e6bdff78724f48ed64&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:57.004043 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141415-8a62-40c2-b215-c353a6b23498 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:57.004569 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141415-8a62-40c2-b215-c353a6b23498 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:57.004569 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141415-8a62-40c2-b215-c353a6b23498 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:57.006325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 502/1003] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:57.012189 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55166f64-b91f-44d6-aba1-16ac6015a252 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:57.013243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55166f64-b91f-44d6-aba1-16ac6015a252 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:57.013243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55166f64-b91f-44d6-aba1-16ac6015a252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:57.032807 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-55166f64-b91f-44d6-aba1-16ac6015a252 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:57.034029 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-55166f64-b91f-44d6-aba1-16ac6015a252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:57.041751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 502/1004] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:57.069135 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0141415-8a62-40c2-b215-c353a6b23498 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:57.083549 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0141415-8a62-40c2-b215-c353a6b23498 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:57.087979 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804a99c-4dc8-41b8-81a3-b63ff6123433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:57.088745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804a99c-4dc8-41b8-81a3-b63ff6123433 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:57.089023 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804a99c-4dc8-41b8-81a3-b63ff6123433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:57.089294 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804a99c-4dc8-41b8-81a3-b63ff6123433 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:57.090453 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804a99c-4dc8-41b8-81a3-b63ff6123433 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:57.092673 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804a99c-4dc8-41b8-81a3-b63ff6123433 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:57.094241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 503/1005] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:11:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:57.100578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55166f64-b91f-44d6-aba1-16ac6015a252 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:57.109597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55166f64-b91f-44d6-aba1-16ac6015a252 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:57.114042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af308f19-51f6-4999-b375-cb0125b2d4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:57.114685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af308f19-51f6-4999-b375-cb0125b2d4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:57.114961 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af308f19-51f6-4999-b375-cb0125b2d4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:57.115228 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af308f19-51f6-4999-b375-cb0125b2d4e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:57.116025 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af308f19-51f6-4999-b375-cb0125b2d4e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:57.117913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af308f19-51f6-4999-b375-cb0125b2d4e3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:57.260353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 503/1006] 10.222.0.87 () {60 vars in 1153 bytes} [Fri Oct 29 01:11:57 2021] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:11:59.577693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae69eec-00be-4b2c-abec-dfd55540c877 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:59.578221 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae69eec-00be-4b2c-abec-dfd55540c877 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:59.578221 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae69eec-00be-4b2c-abec-dfd55540c877 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:59.580000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 504/1007] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:11:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:11:59.586191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e67e51-c93e-4311-82cd-b2fd9e0bb914 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:59.586584 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e67e51-c93e-4311-82cd-b2fd9e0bb914 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:59.586747 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e67e51-c93e-4311-82cd-b2fd9e0bb914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:59.609191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-35e67e51-c93e-4311-82cd-b2fd9e0bb914 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:11:59.610381 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-35e67e51-c93e-4311-82cd-b2fd9e0bb914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:11:59.618414 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 504/1008] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:11:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:11:59.644349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae69eec-00be-4b2c-abec-dfd55540c877 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:59.657321 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae69eec-00be-4b2c-abec-dfd55540c877 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:59.661695 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5c985-f5ab-4bfe-a8de-cac8d19dcba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:59.662532 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5c985-f5ab-4bfe-a8de-cac8d19dcba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:59.662809 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5c985-f5ab-4bfe-a8de-cac8d19dcba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:59.663079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5c985-f5ab-4bfe-a8de-cac8d19dcba3 admin admin] PATH_INFO: `/v3/roles/4891c5dc7fab4407b20b35b4e6da58a8` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:59.664586 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5c985-f5ab-4bfe-a8de-cac8d19dcba3 admin admin] RBAC: Authorizing `identity:get_role(role_id=4891c5dc7fab4407b20b35b4e6da58a8)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:59.665584 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-3fd5c985-f5ab-4bfe-a8de-cac8d19dcba3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:11:59.665584 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:11:59.665584 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:11:59.666454 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5c985-f5ab-4bfe-a8de-cac8d19dcba3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:59.667824 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 505/1009] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:11:59 2021] GET /identity/v3/roles/4891c5dc7fab4407b20b35b4e6da58a8 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:59.675188 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e67e51-c93e-4311-82cd-b2fd9e0bb914 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:59.684468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e67e51-c93e-4311-82cd-b2fd9e0bb914 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:59.689049 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7f940-ea6d-4a64-a8db-de5a81a54727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:59.689900 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7f940-ea6d-4a64-a8db-de5a81a54727 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:59.690182 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7f940-ea6d-4a64-a8db-de5a81a54727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:59.690456 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7f940-ea6d-4a64-a8db-de5a81a54727 admin admin] PATH_INFO: `/v3/users/0515364c83794b0a85c949b2616c0ae0` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:59.704473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7f940-ea6d-4a64-a8db-de5a81a54727 admin admin] RBAC: Authorizing `identity:get_user(user_id=0515364c83794b0a85c949b2616c0ae0)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:59.706587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7f940-ea6d-4a64-a8db-de5a81a54727 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:59.708248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 505/1010] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:11:59 2021] GET /identity/v3/users/0515364c83794b0a85c949b2616c0ae0 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:59.714654 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5c985-f5ab-4bfe-a8de-cac8d19dcba3 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:59.725145 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5c985-f5ab-4bfe-a8de-cac8d19dcba3 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:59.730353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dbbca-135b-43d0-a4d6-a311d4f28fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:59.731783 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dbbca-135b-43d0-a4d6-a311d4f28fef admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:59.732176 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dbbca-135b-43d0-a4d6-a311d4f28fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:59.732594 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dbbca-135b-43d0-a4d6-a311d4f28fef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:59.743364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dbbca-135b-43d0-a4d6-a311d4f28fef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:59.745108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dbbca-135b-43d0-a4d6-a311d4f28fef admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:59.754482 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 506/1011] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:11:59 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:11:59.761149 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7f940-ea6d-4a64-a8db-de5a81a54727 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:59.770791 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7f940-ea6d-4a64-a8db-de5a81a54727 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:59.775225 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe5058-2cda-41ef-b9c7-5fe886cbac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:59.776088 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe5058-2cda-41ef-b9c7-5fe886cbac60 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:59.776371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe5058-2cda-41ef-b9c7-5fe886cbac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:59.776634 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe5058-2cda-41ef-b9c7-5fe886cbac60 admin admin] PATH_INFO: `/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:59.777796 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe5058-2cda-41ef-b9c7-5fe886cbac60 admin admin] RBAC: Authorizing `identity:get_project(project_id=1fa68fcfb24b49e6bdff78724f48ed64)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:59.779874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe5058-2cda-41ef-b9c7-5fe886cbac60 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:59.781510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 506/1012] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:11:59 2021] GET /identity/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:11:59.788593 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dbbca-135b-43d0-a4d6-a311d4f28fef admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:11:59.797926 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dbbca-135b-43d0-a4d6-a311d4f28fef admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:11:59.802580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c75c9-46e6-4ce3-9991-cf33e4498867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:11:59.803205 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c75c9-46e6-4ce3-9991-cf33e4498867 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:11:59.803483 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c75c9-46e6-4ce3-9991-cf33e4498867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:11:59.803783 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c75c9-46e6-4ce3-9991-cf33e4498867 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:11:59.804615 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c75c9-46e6-4ce3-9991-cf33e4498867 admin admin] RBAC: Adding query filter params (role.id=4891c5dc7fab4407b20b35b4e6da58a8, scope.project.id=1fa68fcfb24b49e6bdff78724f48ed64, user.id=0515364c83794b0a85c949b2616c0ae0) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:11:59.804925 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c75c9-46e6-4ce3-9991-cf33e4498867 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:11:59.806745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c75c9-46e6-4ce3-9991-cf33e4498867 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:11:59.813073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 507/1013] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:11:59 2021] GET /identity/v3/role_assignments?user.id=0515364c83794b0a85c949b2616c0ae0&scope.project.id=1fa68fcfb24b49e6bdff78724f48ed64&role.id=4891c5dc7fab4407b20b35b4e6da58a8 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:02.041876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca22db7-4062-4597-8f28-fc70af6f4a6e None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:02.042443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca22db7-4062-4597-8f28-fc70af6f4a6e None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:02.042443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca22db7-4062-4597-8f28-fc70af6f4a6e None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:02.044920 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 507/1014] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:12:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:12:02.051005 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5988e30-b9fb-4c43-80a9-8a727fb644c1 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:02.051419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5988e30-b9fb-4c43-80a9-8a727fb644c1 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:02.051540 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5988e30-b9fb-4c43-80a9-8a727fb644c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:02.069964 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-c5988e30-b9fb-4c43-80a9-8a727fb644c1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:12:02.071157 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c5988e30-b9fb-4c43-80a9-8a727fb644c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:12:02.079544 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 508/1015] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:12:02 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:12:02.103422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca22db7-4062-4597-8f28-fc70af6f4a6e None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:02.116214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca22db7-4062-4597-8f28-fc70af6f4a6e None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:02.120539 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542d396-01af-4b62-95c6-afd8f4567b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:02.121328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542d396-01af-4b62-95c6-afd8f4567b03 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:02.121702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542d396-01af-4b62-95c6-afd8f4567b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:02.122524 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542d396-01af-4b62-95c6-afd8f4567b03 admin admin] PATH_INFO: `/v3/roles/4891c5dc7fab4407b20b35b4e6da58a8` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:02.124074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542d396-01af-4b62-95c6-afd8f4567b03 admin admin] RBAC: Authorizing `identity:get_role(role_id=4891c5dc7fab4407b20b35b4e6da58a8)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:02.125080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-f542d396-01af-4b62-95c6-afd8f4567b03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:12:02.125080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:12:02.125080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:12:02.125941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542d396-01af-4b62-95c6-afd8f4567b03 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:02.127292 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 508/1016] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:12:02 2021] GET /identity/v3/roles/4891c5dc7fab4407b20b35b4e6da58a8 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:02.134062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5988e30-b9fb-4c43-80a9-8a727fb644c1 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:02.143251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5988e30-b9fb-4c43-80a9-8a727fb644c1 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:02.147864 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c9721-cf92-47c2-ac1f-c3608fda60a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:02.148718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c9721-cf92-47c2-ac1f-c3608fda60a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:02.148993 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c9721-cf92-47c2-ac1f-c3608fda60a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:02.149260 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c9721-cf92-47c2-ac1f-c3608fda60a4 admin admin] PATH_INFO: `/v3/users/0515364c83794b0a85c949b2616c0ae0` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:02.150457 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c9721-cf92-47c2-ac1f-c3608fda60a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=0515364c83794b0a85c949b2616c0ae0)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:02.152580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c9721-cf92-47c2-ac1f-c3608fda60a4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:02.154545 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 509/1017] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:12:02 2021] GET /identity/v3/users/0515364c83794b0a85c949b2616c0ae0 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:02.161245 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542d396-01af-4b62-95c6-afd8f4567b03 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:02.171929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542d396-01af-4b62-95c6-afd8f4567b03 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:02.176473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080fd16-f453-4fa2-a300-4b4328236e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:02.177302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080fd16-f453-4fa2-a300-4b4328236e0c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:02.177588 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080fd16-f453-4fa2-a300-4b4328236e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:02.177866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080fd16-f453-4fa2-a300-4b4328236e0c admin admin] PATH_INFO: `/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:02.179067 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080fd16-f453-4fa2-a300-4b4328236e0c admin admin] RBAC: Authorizing `identity:get_project(project_id=1fa68fcfb24b49e6bdff78724f48ed64)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:02.181119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080fd16-f453-4fa2-a300-4b4328236e0c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:02.182751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 509/1018] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:12:02 2021] GET /identity/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:02.189872 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c9721-cf92-47c2-ac1f-c3608fda60a4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:02.199395 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c9721-cf92-47c2-ac1f-c3608fda60a4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:02.204191 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8726a-e931-45ea-b677-3ae874f9e0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:02.205043 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8726a-e931-45ea-b677-3ae874f9e0cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:02.205318 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8726a-e931-45ea-b677-3ae874f9e0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:02.205614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8726a-e931-45ea-b677-3ae874f9e0cb admin admin] PATH_INFO: `/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64/users/0515364c83794b0a85c949b2616c0ae0/roles/4891c5dc7fab4407b20b35b4e6da58a8` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:02.207835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8726a-e931-45ea-b677-3ae874f9e0cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa68fcfb24b49e6bdff78724f48ed64, user_id=0515364c83794b0a85c949b2616c0ae0, role_id=4891c5dc7fab4407b20b35b4e6da58a8)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:02.210392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8726a-e931-45ea-b677-3ae874f9e0cb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:02.277759 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 510/1019] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:12:02 2021] PUT /identity/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64/users/0515364c83794b0a85c949b2616c0ae0/roles/4891c5dc7fab4407b20b35b4e6da58a8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:12:04.570055 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc4cc9-a503-456f-bfcb-0be33ca46526 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:04.570592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc4cc9-a503-456f-bfcb-0be33ca46526 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:04.570592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc4cc9-a503-456f-bfcb-0be33ca46526 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:04.572396 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 510/1020] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:12:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:12:04.579377 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c50eab-f87a-489a-b1ff-629646999cda None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:04.579838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c50eab-f87a-489a-b1ff-629646999cda None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:04.579934 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c50eab-f87a-489a-b1ff-629646999cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:04.597548 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-66c50eab-f87a-489a-b1ff-629646999cda None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:12:04.598725 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-66c50eab-f87a-489a-b1ff-629646999cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:12:04.653561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 511/1021] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:12:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:12:04.678650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc4cc9-a503-456f-bfcb-0be33ca46526 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:04.690634 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc4cc9-a503-456f-bfcb-0be33ca46526 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:04.695160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572769d-bd15-4c1f-a73c-1ef8b774f99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:04.696017 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572769d-bd15-4c1f-a73c-1ef8b774f99b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:04.696302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572769d-bd15-4c1f-a73c-1ef8b774f99b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:04.696572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572769d-bd15-4c1f-a73c-1ef8b774f99b admin admin] PATH_INFO: `/v3/roles/4891c5dc7fab4407b20b35b4e6da58a8` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:04.698027 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572769d-bd15-4c1f-a73c-1ef8b774f99b admin admin] RBAC: Authorizing `identity:get_role(role_id=4891c5dc7fab4407b20b35b4e6da58a8)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:04.699860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572769d-bd15-4c1f-a73c-1ef8b774f99b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:04.701186 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 511/1022] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:12:04 2021] GET /identity/v3/roles/4891c5dc7fab4407b20b35b4e6da58a8 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:04.707676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c50eab-f87a-489a-b1ff-629646999cda None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:04.717299 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c50eab-f87a-489a-b1ff-629646999cda None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:04.721972 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0960ac9-e870-41dc-8087-d63bc884f498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:04.722849 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0960ac9-e870-41dc-8087-d63bc884f498 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:04.723125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0960ac9-e870-41dc-8087-d63bc884f498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:04.723393 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0960ac9-e870-41dc-8087-d63bc884f498 admin admin] PATH_INFO: `/v3/users/0515364c83794b0a85c949b2616c0ae0` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:04.724647 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0960ac9-e870-41dc-8087-d63bc884f498 admin admin] RBAC: Authorizing `identity:get_user(user_id=0515364c83794b0a85c949b2616c0ae0)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:04.726732 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0960ac9-e870-41dc-8087-d63bc884f498 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:04.728384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 512/1023] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:12:04 2021] GET /identity/v3/users/0515364c83794b0a85c949b2616c0ae0 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:12:04.735966 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572769d-bd15-4c1f-a73c-1ef8b774f99b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:04.745826 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572769d-bd15-4c1f-a73c-1ef8b774f99b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:04.750851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c331e-be61-4517-8302-2b7418ff9cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:04.751504 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c331e-be61-4517-8302-2b7418ff9cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:04.751852 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c331e-be61-4517-8302-2b7418ff9cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:04.752086 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c331e-be61-4517-8302-2b7418ff9cbe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:04.760572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c331e-be61-4517-8302-2b7418ff9cbe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:04.762754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c331e-be61-4517-8302-2b7418ff9cbe admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:04.772017 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 512/1024] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:12:04 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:12:04.779501 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0960ac9-e870-41dc-8087-d63bc884f498 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:04.789381 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0960ac9-e870-41dc-8087-d63bc884f498 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:04.794578 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e09c92-729d-469a-b7ea-febf4865aab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:04.795423 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e09c92-729d-469a-b7ea-febf4865aab8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:04.795695 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e09c92-729d-469a-b7ea-febf4865aab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:04.795993 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e09c92-729d-469a-b7ea-febf4865aab8 admin admin] PATH_INFO: `/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:04.797185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e09c92-729d-469a-b7ea-febf4865aab8 admin admin] RBAC: Authorizing `identity:get_project(project_id=1fa68fcfb24b49e6bdff78724f48ed64)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:04.799191 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e09c92-729d-469a-b7ea-febf4865aab8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:04.800889 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 513/1025] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:12:04 2021] GET /identity/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:04.807708 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c331e-be61-4517-8302-2b7418ff9cbe admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:04.816510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c331e-be61-4517-8302-2b7418ff9cbe admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:04.821551 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c04e0-5d2d-4882-9be5-a7d85f814b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:04.822131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c04e0-5d2d-4882-9be5-a7d85f814b34 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:04.822412 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c04e0-5d2d-4882-9be5-a7d85f814b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:04.822684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c04e0-5d2d-4882-9be5-a7d85f814b34 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:04.823504 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c04e0-5d2d-4882-9be5-a7d85f814b34 admin admin] RBAC: Adding query filter params (role.id=4891c5dc7fab4407b20b35b4e6da58a8, scope.project.id=1fa68fcfb24b49e6bdff78724f48ed64, user.id=0515364c83794b0a85c949b2616c0ae0) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:12:04.823851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c04e0-5d2d-4882-9be5-a7d85f814b34 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:04.825735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c04e0-5d2d-4882-9be5-a7d85f814b34 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:04.831531 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 513/1026] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:12:04 2021] GET /identity/v3/role_assignments?user.id=0515364c83794b0a85c949b2616c0ae0&scope.project.id=1fa68fcfb24b49e6bdff78724f48ed64&role.id=4891c5dc7fab4407b20b35b4e6da58a8 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:07.098510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ba431-1afb-4305-a0c9-99d30c17433c None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:07.099075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ba431-1afb-4305-a0c9-99d30c17433c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:07.099075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ba431-1afb-4305-a0c9-99d30c17433c None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:07.100861 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 514/1027] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:12:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:12:07.107604 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7a26f-a5bf-4d18-92e1-bb24e7b3adcc None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:07.108034 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7a26f-a5bf-4d18-92e1-bb24e7b3adcc None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:07.108181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7a26f-a5bf-4d18-92e1-bb24e7b3adcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:07.125379 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-b0d7a26f-a5bf-4d18-92e1-bb24e7b3adcc None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:12:07.126490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b0d7a26f-a5bf-4d18-92e1-bb24e7b3adcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:12:07.133966 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 514/1028] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:12:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:12:07.158372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ba431-1afb-4305-a0c9-99d30c17433c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:07.171090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ba431-1afb-4305-a0c9-99d30c17433c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:07.175437 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646aeb41-627f-4661-9713-49acddac7969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:07.176228 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646aeb41-627f-4661-9713-49acddac7969 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:07.176510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646aeb41-627f-4661-9713-49acddac7969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:07.176784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646aeb41-627f-4661-9713-49acddac7969 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:07.177956 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646aeb41-627f-4661-9713-49acddac7969 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:07.179637 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646aeb41-627f-4661-9713-49acddac7969 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:07.181213 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 515/1029] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:12:07 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:07.187277 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7a26f-a5bf-4d18-92e1-bb24e7b3adcc None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:07.196140 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7a26f-a5bf-4d18-92e1-bb24e7b3adcc None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:07.201271 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fabe0-521f-47a1-91bf-872708ab3a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:07.201892 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fabe0-521f-47a1-91bf-872708ab3a0b admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:07.202170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fabe0-521f-47a1-91bf-872708ab3a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:07.202439 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fabe0-521f-47a1-91bf-872708ab3a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:07.203142 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fabe0-521f-47a1-91bf-872708ab3a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:07.205033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fabe0-521f-47a1-91bf-872708ab3a0b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:07.260973 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 515/1030] 10.222.0.87 () {60 vars in 1162 bytes} [Fri Oct 29 01:12:07 2021] POST /identity/v3/projects => generated 311 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:12:09.576078 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c0bff-26ec-471f-923e-c49ba3f7153b None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:09.576651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c0bff-26ec-471f-923e-c49ba3f7153b None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:09.576651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c0bff-26ec-471f-923e-c49ba3f7153b None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:09.578356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 516/1031] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:12:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:12:09.584564 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512d190-eea2-43f1-90f9-bacc76ea53f5 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:09.585013 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512d190-eea2-43f1-90f9-bacc76ea53f5 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:09.585122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512d190-eea2-43f1-90f9-bacc76ea53f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:09.603081 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d512d190-eea2-43f1-90f9-bacc76ea53f5 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:12:09.604301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d512d190-eea2-43f1-90f9-bacc76ea53f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:12:09.660154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 516/1032] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:12:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:12:09.685982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c0bff-26ec-471f-923e-c49ba3f7153b None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:09.698409 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c0bff-26ec-471f-923e-c49ba3f7153b None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:09.703400 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5801ad-40e1-42bd-b0d8-e8e8c7698e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:09.704201 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5801ad-40e1-42bd-b0d8-e8e8c7698e1b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:09.704478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5801ad-40e1-42bd-b0d8-e8e8c7698e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:09.704745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5801ad-40e1-42bd-b0d8-e8e8c7698e1b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:09.705942 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5801ad-40e1-42bd-b0d8-e8e8c7698e1b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:09.707604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5801ad-40e1-42bd-b0d8-e8e8c7698e1b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:09.709219 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 517/1033] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:12:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:09.716318 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512d190-eea2-43f1-90f9-bacc76ea53f5 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:09.725185 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512d190-eea2-43f1-90f9-bacc76ea53f5 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:09.729634 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ea870-181d-4ca0-909e-5e92cfbc0cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:09.730284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ea870-181d-4ca0-909e-5e92cfbc0cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:09.730563 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ea870-181d-4ca0-909e-5e92cfbc0cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:09.730840 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ea870-181d-4ca0-909e-5e92cfbc0cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:09.731558 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ea870-181d-4ca0-909e-5e92cfbc0cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:09.733486 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ea870-181d-4ca0-909e-5e92cfbc0cb0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:09.809166 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 517/1034] 10.222.0.87 () {60 vars in 1153 bytes} [Fri Oct 29 01:12:09 2021] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:12:12.122219 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec075c-de3e-4510-8b4d-5d4e095035d5 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:12.122749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec075c-de3e-4510-8b4d-5d4e095035d5 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:12.122749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec075c-de3e-4510-8b4d-5d4e095035d5 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:12.124478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 518/1035] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:12:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:12:12.130371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a78f-5a84-406f-b15d-38f1542797f6 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:12.130771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a78f-5a84-406f-b15d-38f1542797f6 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:12.130941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a78f-5a84-406f-b15d-38f1542797f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:12.148442 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-9719a78f-5a84-406f-b15d-38f1542797f6 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:12:12.149625 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-9719a78f-5a84-406f-b15d-38f1542797f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:12:12.158120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 518/1036] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:12:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:12:12.183271 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec075c-de3e-4510-8b4d-5d4e095035d5 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:12.196653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec075c-de3e-4510-8b4d-5d4e095035d5 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:12.201682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e56e-114d-4339-958d-0e9391b5a448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:12.202443 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e56e-114d-4339-958d-0e9391b5a448 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:12.202718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e56e-114d-4339-958d-0e9391b5a448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:12.202984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e56e-114d-4339-958d-0e9391b5a448 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:12.212876 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701e56e-114d-4339-958d-0e9391b5a448 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:12:12.219684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-7701e56e-114d-4339-958d-0e9391b5a448 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:12:12.220843 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 519/1037] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:12:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:12:12.227298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a78f-5a84-406f-b15d-38f1542797f6 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:12.236220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a78f-5a84-406f-b15d-38f1542797f6 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:12.240652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31957728-e63f-4f15-94ed-4f877a44ee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:12.241301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31957728-e63f-4f15-94ed-4f877a44ee2d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:12.241580 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31957728-e63f-4f15-94ed-4f877a44ee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:12.241852 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31957728-e63f-4f15-94ed-4f877a44ee2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:12.242608 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31957728-e63f-4f15-94ed-4f877a44ee2d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:12:12.242914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31957728-e63f-4f15-94ed-4f877a44ee2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:12.244518 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31957728-e63f-4f15-94ed-4f877a44ee2d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:12.253151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 519/1038] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:12:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:12:12.259599 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e56e-114d-4339-958d-0e9391b5a448 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:12.270185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e56e-114d-4339-958d-0e9391b5a448 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:12.274731 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564e8ea-bdae-40de-a625-4a697a26ff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:12.275554 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564e8ea-bdae-40de-a625-4a697a26ff4a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:12.275865 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564e8ea-bdae-40de-a625-4a697a26ff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:12.276135 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564e8ea-bdae-40de-a625-4a697a26ff4a admin admin] PATH_INFO: `/v3/users/ed0d91f383d94e5f9ef0c62a21fcd7d4` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:12.296658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564e8ea-bdae-40de-a625-4a697a26ff4a admin admin] RBAC: Authorizing `identity:get_user(user_id=ed0d91f383d94e5f9ef0c62a21fcd7d4)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:12.298755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564e8ea-bdae-40de-a625-4a697a26ff4a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:12.300435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 520/1039] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:12:12 2021] GET /identity/v3/users/ed0d91f383d94e5f9ef0c62a21fcd7d4 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:12.306829 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31957728-e63f-4f15-94ed-4f877a44ee2d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:12.316828 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31957728-e63f-4f15-94ed-4f877a44ee2d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:12.321577 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603fb07-e153-435e-b25e-8ea794dfee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:12.338725 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603fb07-e153-435e-b25e-8ea794dfee4f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:12.338725 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603fb07-e153-435e-b25e-8ea794dfee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:12.338725 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603fb07-e153-435e-b25e-8ea794dfee4f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:12.338725 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603fb07-e153-435e-b25e-8ea794dfee4f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:12.338725 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603fb07-e153-435e-b25e-8ea794dfee4f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:12.341209 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 520/1040] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:12:12 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:12:12.347589 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564e8ea-bdae-40de-a625-4a697a26ff4a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:12.357278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564e8ea-bdae-40de-a625-4a697a26ff4a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:12.361750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c975950-d7c1-4bc5-a38a-0c4c458e945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:12.362581 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c975950-d7c1-4bc5-a38a-0c4c458e945c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:12.362862 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c975950-d7c1-4bc5-a38a-0c4c458e945c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:12.363130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c975950-d7c1-4bc5-a38a-0c4c458e945c admin admin] PATH_INFO: `/v3/projects/6cc18f9818ad4f228efabe4414127a40` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:12.364324 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c975950-d7c1-4bc5-a38a-0c4c458e945c admin admin] RBAC: Authorizing `identity:get_project(project_id=6cc18f9818ad4f228efabe4414127a40)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:12.366310 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c975950-d7c1-4bc5-a38a-0c4c458e945c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:12.367983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 521/1041] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:12:12 2021] GET /identity/v3/projects/6cc18f9818ad4f228efabe4414127a40 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:12.378060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603fb07-e153-435e-b25e-8ea794dfee4f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:12.387320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603fb07-e153-435e-b25e-8ea794dfee4f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:12.391758 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867e979-c06e-43d4-ad87-5514dba72b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:12.392392 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867e979-c06e-43d4-ad87-5514dba72b1d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:12.392672 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867e979-c06e-43d4-ad87-5514dba72b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:12.392941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867e979-c06e-43d4-ad87-5514dba72b1d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:12.393764 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867e979-c06e-43d4-ad87-5514dba72b1d admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=6cc18f9818ad4f228efabe4414127a40, user.id=ed0d91f383d94e5f9ef0c62a21fcd7d4) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:12:12.394077 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867e979-c06e-43d4-ad87-5514dba72b1d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:12.395915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867e979-c06e-43d4-ad87-5514dba72b1d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:12.401162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 521/1042] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:12:12 2021] GET /identity/v3/role_assignments?user.id=ed0d91f383d94e5f9ef0c62a21fcd7d4&scope.project.id=6cc18f9818ad4f228efabe4414127a40&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:14.678320 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b21a6-fa5b-4c39-9cfd-724bf52685e5 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:14.678881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b21a6-fa5b-4c39-9cfd-724bf52685e5 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:14.678881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b21a6-fa5b-4c39-9cfd-724bf52685e5 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:14.680677 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 522/1043] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:12:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:12:14.686669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d15796-d59a-48ed-9ec2-ebae77ec5068 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:14.687107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d15796-d59a-48ed-9ec2-ebae77ec5068 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:14.687198 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d15796-d59a-48ed-9ec2-ebae77ec5068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:14.705698 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-f9d15796-d59a-48ed-9ec2-ebae77ec5068 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:12:14.706863 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-f9d15796-d59a-48ed-9ec2-ebae77ec5068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:12:14.714337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 522/1044] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:12:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:12:14.738490 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b21a6-fa5b-4c39-9cfd-724bf52685e5 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:14.750832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b21a6-fa5b-4c39-9cfd-724bf52685e5 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:14.755197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800e21b-27db-4895-93c8-440bbf8d8050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:14.755991 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800e21b-27db-4895-93c8-440bbf8d8050 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:14.756277 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800e21b-27db-4895-93c8-440bbf8d8050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:14.756553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800e21b-27db-4895-93c8-440bbf8d8050 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:14.767193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800e21b-27db-4895-93c8-440bbf8d8050 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:12:14.773951 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-5800e21b-27db-4895-93c8-440bbf8d8050 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:12:14.775082 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 523/1045] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:12:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:12:14.782266 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d15796-d59a-48ed-9ec2-ebae77ec5068 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:14.790953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d15796-d59a-48ed-9ec2-ebae77ec5068 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:14.795700 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b8e09-9823-435e-a07f-b14d821e3764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:14.796377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b8e09-9823-435e-a07f-b14d821e3764 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:14.796640 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b8e09-9823-435e-a07f-b14d821e3764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:14.796910 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b8e09-9823-435e-a07f-b14d821e3764 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:14.797658 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b8e09-9823-435e-a07f-b14d821e3764 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:12:14.797956 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b8e09-9823-435e-a07f-b14d821e3764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:14.799504 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b8e09-9823-435e-a07f-b14d821e3764 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:14.807419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 523/1046] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:12:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:14.814227 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800e21b-27db-4895-93c8-440bbf8d8050 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:14.825482 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800e21b-27db-4895-93c8-440bbf8d8050 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:14.829952 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c712f-8d8f-4ba9-9202-e8092e1ce14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:14.830776 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c712f-8d8f-4ba9-9202-e8092e1ce14e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:14.831055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c712f-8d8f-4ba9-9202-e8092e1ce14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:14.831324 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c712f-8d8f-4ba9-9202-e8092e1ce14e admin admin] PATH_INFO: `/v3/users/ed0d91f383d94e5f9ef0c62a21fcd7d4` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:14.832570 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c712f-8d8f-4ba9-9202-e8092e1ce14e admin admin] RBAC: Authorizing `identity:get_user(user_id=ed0d91f383d94e5f9ef0c62a21fcd7d4)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:14.834637 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c712f-8d8f-4ba9-9202-e8092e1ce14e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:14.836226 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 524/1047] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:12:14 2021] GET /identity/v3/users/ed0d91f383d94e5f9ef0c62a21fcd7d4 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:14.842696 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b8e09-9823-435e-a07f-b14d821e3764 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:14.851930 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b8e09-9823-435e-a07f-b14d821e3764 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:14.856372 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc60f1-3996-4cf0-8211-34c6d77ffa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:14.857190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc60f1-3996-4cf0-8211-34c6d77ffa37 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:14.857476 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc60f1-3996-4cf0-8211-34c6d77ffa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:14.857748 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc60f1-3996-4cf0-8211-34c6d77ffa37 admin admin] PATH_INFO: `/v3/projects/6cc18f9818ad4f228efabe4414127a40` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:14.858921 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc60f1-3996-4cf0-8211-34c6d77ffa37 admin admin] RBAC: Authorizing `identity:get_project(project_id=6cc18f9818ad4f228efabe4414127a40)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:14.860956 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc60f1-3996-4cf0-8211-34c6d77ffa37 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:14.862556 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 524/1048] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:12:14 2021] GET /identity/v3/projects/6cc18f9818ad4f228efabe4414127a40 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:14.868961 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c712f-8d8f-4ba9-9202-e8092e1ce14e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:14.878975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c712f-8d8f-4ba9-9202-e8092e1ce14e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:14.883527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc51fd-9aeb-4312-985e-466a729e4d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:14.884423 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc51fd-9aeb-4312-985e-466a729e4d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:14.884704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc51fd-9aeb-4312-985e-466a729e4d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:14.884977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc51fd-9aeb-4312-985e-466a729e4d08 admin admin] PATH_INFO: `/v3/projects/6cc18f9818ad4f228efabe4414127a40/users/ed0d91f383d94e5f9ef0c62a21fcd7d4/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:14.887979 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc51fd-9aeb-4312-985e-466a729e4d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc18f9818ad4f228efabe4414127a40, user_id=ed0d91f383d94e5f9ef0c62a21fcd7d4, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:14.890543 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc51fd-9aeb-4312-985e-466a729e4d08 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:14.985510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 525/1049] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:12:14 2021] PUT /identity/v3/projects/6cc18f9818ad4f228efabe4414127a40/users/ed0d91f383d94e5f9ef0c62a21fcd7d4/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:12:17.211911 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0e7ba-c4f4-4997-bcb4-aa9779fb8ebd None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:17.212422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0e7ba-c4f4-4997-bcb4-aa9779fb8ebd None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:17.212422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0e7ba-c4f4-4997-bcb4-aa9779fb8ebd None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:17.214128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 525/1050] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:12:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:12:17.220472 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29784e-d80a-498d-9a45-b2dc3c5e4eab None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:17.220981 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29784e-d80a-498d-9a45-b2dc3c5e4eab None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:17.222327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29784e-d80a-498d-9a45-b2dc3c5e4eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:17.240536 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-4b29784e-d80a-498d-9a45-b2dc3c5e4eab None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:12:17.241723 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4b29784e-d80a-498d-9a45-b2dc3c5e4eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:12:17.298623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 526/1051] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:12:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:12:17.324482 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0e7ba-c4f4-4997-bcb4-aa9779fb8ebd None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:17.336307 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0e7ba-c4f4-4997-bcb4-aa9779fb8ebd None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:17.341251 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3027f59-80b2-42b5-b0d7-5c9656012c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:17.342008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3027f59-80b2-42b5-b0d7-5c9656012c64 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:17.342285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3027f59-80b2-42b5-b0d7-5c9656012c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:17.342553 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3027f59-80b2-42b5-b0d7-5c9656012c64 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:17.352345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3027f59-80b2-42b5-b0d7-5c9656012c64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:12:17.359493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-f3027f59-80b2-42b5-b0d7-5c9656012c64 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:12:17.360659 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 526/1052] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:12:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:12:17.367247 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29784e-d80a-498d-9a45-b2dc3c5e4eab None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:17.376657 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29784e-d80a-498d-9a45-b2dc3c5e4eab None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:17.381167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2d025-f037-4ead-96a0-2fb9329a2300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:17.381810 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2d025-f037-4ead-96a0-2fb9329a2300 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:17.382094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2d025-f037-4ead-96a0-2fb9329a2300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:17.382368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2d025-f037-4ead-96a0-2fb9329a2300 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:17.383126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2d025-f037-4ead-96a0-2fb9329a2300 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:12:17.383431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2d025-f037-4ead-96a0-2fb9329a2300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:17.385044 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2d025-f037-4ead-96a0-2fb9329a2300 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:17.393535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 527/1053] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:12:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:17.399943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3027f59-80b2-42b5-b0d7-5c9656012c64 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:17.410394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3027f59-80b2-42b5-b0d7-5c9656012c64 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:17.414840 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb7689-047f-4775-8957-22a1fb129a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:17.415675 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb7689-047f-4775-8957-22a1fb129a8f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:17.415978 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb7689-047f-4775-8957-22a1fb129a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:17.416244 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb7689-047f-4775-8957-22a1fb129a8f admin admin] PATH_INFO: `/v3/users/ed0d91f383d94e5f9ef0c62a21fcd7d4` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:17.417424 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb7689-047f-4775-8957-22a1fb129a8f admin admin] RBAC: Authorizing `identity:get_user(user_id=ed0d91f383d94e5f9ef0c62a21fcd7d4)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:17.419836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb7689-047f-4775-8957-22a1fb129a8f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:17.421418 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 527/1054] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:12:17 2021] GET /identity/v3/users/ed0d91f383d94e5f9ef0c62a21fcd7d4 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:17.427786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2d025-f037-4ead-96a0-2fb9329a2300 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:17.438555 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2d025-f037-4ead-96a0-2fb9329a2300 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:17.443170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fd24f-e158-4415-81c6-95b697f20cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:17.444083 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fd24f-e158-4415-81c6-95b697f20cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:17.444364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fd24f-e158-4415-81c6-95b697f20cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:17.444633 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fd24f-e158-4415-81c6-95b697f20cb8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:17.453579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fd24f-e158-4415-81c6-95b697f20cb8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:17.455291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fd24f-e158-4415-81c6-95b697f20cb8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:17.464094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 528/1055] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:12:17 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:12:17.470937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb7689-047f-4775-8957-22a1fb129a8f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:17.480511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb7689-047f-4775-8957-22a1fb129a8f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:17.484993 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc230a-ce9b-4bcf-b3eb-ca46fbee97f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:17.485827 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc230a-ce9b-4bcf-b3eb-ca46fbee97f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:17.486105 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc230a-ce9b-4bcf-b3eb-ca46fbee97f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:17.486374 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc230a-ce9b-4bcf-b3eb-ca46fbee97f9 admin admin] PATH_INFO: `/v3/projects/6cc18f9818ad4f228efabe4414127a40` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:17.487540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc230a-ce9b-4bcf-b3eb-ca46fbee97f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=6cc18f9818ad4f228efabe4414127a40)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:17.489578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc230a-ce9b-4bcf-b3eb-ca46fbee97f9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:17.491191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 528/1056] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:12:17 2021] GET /identity/v3/projects/6cc18f9818ad4f228efabe4414127a40 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:17.498471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fd24f-e158-4415-81c6-95b697f20cb8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:17.507559 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fd24f-e158-4415-81c6-95b697f20cb8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:17.514706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579e9ab-3595-4192-8a6e-ad0ea48fbc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:17.515357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579e9ab-3595-4192-8a6e-ad0ea48fbc07 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:17.515636 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579e9ab-3595-4192-8a6e-ad0ea48fbc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:17.515935 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579e9ab-3595-4192-8a6e-ad0ea48fbc07 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:17.516773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579e9ab-3595-4192-8a6e-ad0ea48fbc07 admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=6cc18f9818ad4f228efabe4414127a40, user.id=ed0d91f383d94e5f9ef0c62a21fcd7d4) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:12:17.517078 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579e9ab-3595-4192-8a6e-ad0ea48fbc07 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:17.518898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579e9ab-3595-4192-8a6e-ad0ea48fbc07 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:17.525242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 529/1057] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:12:17 2021] GET /identity/v3/role_assignments?user.id=ed0d91f383d94e5f9ef0c62a21fcd7d4&scope.project.id=6cc18f9818ad4f228efabe4414127a40&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:19.801861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec12c0-27f8-4814-a373-abbe4e8c76a9 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:19.802404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec12c0-27f8-4814-a373-abbe4e8c76a9 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:19.802404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec12c0-27f8-4814-a373-abbe4e8c76a9 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:19.804231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 529/1058] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:12:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:12:19.810335 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7ca1c-a990-4f29-b889-4fc14960c5d0 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:19.810817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7ca1c-a990-4f29-b889-4fc14960c5d0 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:19.810923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7ca1c-a990-4f29-b889-4fc14960c5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:19.828566 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-93d7ca1c-a990-4f29-b889-4fc14960c5d0 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:12:19.829789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-93d7ca1c-a990-4f29-b889-4fc14960c5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:12:19.837556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 530/1059] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:12:19 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:12:19.862649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec12c0-27f8-4814-a373-abbe4e8c76a9 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:19.875608 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec12c0-27f8-4814-a373-abbe4e8c76a9 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:19.879936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcf245-41c9-41e5-8b99-25fde72e043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:19.880576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf245-41c9-41e5-8b99-25fde72e043f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:19.880853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf245-41c9-41e5-8b99-25fde72e043f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:19.881122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf245-41c9-41e5-8b99-25fde72e043f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:19.889129 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcf245-41c9-41e5-8b99-25fde72e043f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:19.890853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcf245-41c9-41e5-8b99-25fde72e043f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:19.899519 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 530/1060] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:12:19 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:12:19.907484 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7ca1c-a990-4f29-b889-4fc14960c5d0 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:19.916500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7ca1c-a990-4f29-b889-4fc14960c5d0 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:19.921970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc576579-69ab-4cb4-b440-c5d69a2cb763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:19.922748 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc576579-69ab-4cb4-b440-c5d69a2cb763 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:19.923021 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc576579-69ab-4cb4-b440-c5d69a2cb763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:19.923284 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc576579-69ab-4cb4-b440-c5d69a2cb763 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:19.929938 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc576579-69ab-4cb4-b440-c5d69a2cb763 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:19.931756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc576579-69ab-4cb4-b440-c5d69a2cb763 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:19.947055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-bc576579-69ab-4cb4-b440-c5d69a2cb763 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 29 01:12:19.948231 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 531/1061] 10.222.0.87 () {56 vars in 1138 bytes} [Fri Oct 29 01:12:19 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:12:19.955510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcf245-41c9-41e5-8b99-25fde72e043f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:19.964277 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcf245-41c9-41e5-8b99-25fde72e043f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:19.969435 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dcec9-c3b5-4114-a9c2-1bf46b2346d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:19.970069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dcec9-c3b5-4114-a9c2-1bf46b2346d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:19.970343 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dcec9-c3b5-4114-a9c2-1bf46b2346d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:19.970610 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dcec9-c3b5-4114-a9c2-1bf46b2346d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:19.971331 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dcec9-c3b5-4114-a9c2-1bf46b2346d8 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:12:19.971631 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dcec9-c3b5-4114-a9c2-1bf46b2346d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:19.973244 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dcec9-c3b5-4114-a9c2-1bf46b2346d8 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:19.980298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 531/1062] 10.222.0.87 () {56 vars in 1136 bytes} [Fri Oct 29 01:12:19 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:22.243386 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a25f1-0770-401e-9980-adc7dc86c710 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:22.243933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a25f1-0770-401e-9980-adc7dc86c710 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:22.243933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a25f1-0770-401e-9980-adc7dc86c710 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:22.246221 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 532/1063] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:12:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:12:22.252100 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f62f4-564c-4653-b92d-c8d106ca2114 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:22.252505 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f62f4-564c-4653-b92d-c8d106ca2114 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:22.252660 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f62f4-564c-4653-b92d-c8d106ca2114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:22.270587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-254f62f4-564c-4653-b92d-c8d106ca2114 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:12:22.271800 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-254f62f4-564c-4653-b92d-c8d106ca2114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:12:22.280088 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 532/1064] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:12:22 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:12:22.304129 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a25f1-0770-401e-9980-adc7dc86c710 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:22.316148 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a25f1-0770-401e-9980-adc7dc86c710 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:22.320686 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4dc00-4829-4d13-8fac-c2fe0d2941be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:22.321313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4dc00-4829-4d13-8fac-c2fe0d2941be admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:22.321588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4dc00-4829-4d13-8fac-c2fe0d2941be admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:22.321854 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4dc00-4829-4d13-8fac-c2fe0d2941be admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:22.322597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4dc00-4829-4d13-8fac-c2fe0d2941be admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:22.323578 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-eba4dc00-4829-4d13-8fac-c2fe0d2941be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:12:22.323578 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:12:22.323578 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:12:22.325181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4dc00-4829-4d13-8fac-c2fe0d2941be admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:22.410103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 533/1065] 10.222.0.87 () {60 vars in 1159 bytes} [Fri Oct 29 01:12:22 2021] POST /identity/v3/domains => generated 267 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:12:24.696866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5d3a3-cf3d-4a41-983e-baad7e1281f7 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:24.697495 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5d3a3-cf3d-4a41-983e-baad7e1281f7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:24.697495 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5d3a3-cf3d-4a41-983e-baad7e1281f7 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:24.699788 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 533/1066] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:12:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:12:24.706513 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07a1ba-4b2e-4095-89f0-838a592fb2cc None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:24.706988 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07a1ba-4b2e-4095-89f0-838a592fb2cc None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:24.707179 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07a1ba-4b2e-4095-89f0-838a592fb2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:24.725385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-bc07a1ba-4b2e-4095-89f0-838a592fb2cc None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:12:24.726592 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-bc07a1ba-4b2e-4095-89f0-838a592fb2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:12:24.781516 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 534/1067] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:12:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:12:24.806761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5d3a3-cf3d-4a41-983e-baad7e1281f7 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:24.819616 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5d3a3-cf3d-4a41-983e-baad7e1281f7 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:24.824184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2946e-6cc1-431e-8ea8-38fa07590bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:24.825231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2946e-6cc1-431e-8ea8-38fa07590bed admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:24.825508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2946e-6cc1-431e-8ea8-38fa07590bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:24.825777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2946e-6cc1-431e-8ea8-38fa07590bed admin admin] PATH_INFO: `/v3/domains/92fedc15268147a99e2a041de45b0110` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:24.836119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2946e-6cc1-431e-8ea8-38fa07590bed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=92fedc15268147a99e2a041de45b0110)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:24.838056 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2946e-6cc1-431e-8ea8-38fa07590bed admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:24.840185 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 534/1068] 10.222.0.87 () {56 vars in 1204 bytes} [Fri Oct 29 01:12:24 2021] GET /identity/v3/domains/92fedc15268147a99e2a041de45b0110 => generated 267 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:24.846787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07a1ba-4b2e-4095-89f0-838a592fb2cc None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:24.856329 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07a1ba-4b2e-4095-89f0-838a592fb2cc None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:24.860869 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24587bdc-2aac-412a-a3c4-a18557befa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:24.861509 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24587bdc-2aac-412a-a3c4-a18557befa39 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:24.861791 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24587bdc-2aac-412a-a3c4-a18557befa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:24.862065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24587bdc-2aac-412a-a3c4-a18557befa39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:24.862783 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24587bdc-2aac-412a-a3c4-a18557befa39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:24.864678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24587bdc-2aac-412a-a3c4-a18557befa39 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:24.997973 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 535/1069] 10.222.0.87 () {60 vars in 1162 bytes} [Fri Oct 29 01:12:24 2021] POST /identity/v3/projects => generated 361 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:12:27.304390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf3e5-8eec-419c-88db-c5c2ef33c131 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:27.304954 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf3e5-8eec-419c-88db-c5c2ef33c131 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:27.304954 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf3e5-8eec-419c-88db-c5c2ef33c131 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:27.306687 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 535/1070] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:12:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:12:27.313212 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f9a9e-3dc8-41a4-be5c-1b631b09cdf8 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:27.313658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f9a9e-3dc8-41a4-be5c-1b631b09cdf8 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:27.313770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f9a9e-3dc8-41a4-be5c-1b631b09cdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:27.331922 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-5e4f9a9e-3dc8-41a4-be5c-1b631b09cdf8 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:12:27.333218 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-5e4f9a9e-3dc8-41a4-be5c-1b631b09cdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:12:27.388301 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 536/1071] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:12:27 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:12:27.413813 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcf3e5-8eec-419c-88db-c5c2ef33c131 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:27.425941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcf3e5-8eec-419c-88db-c5c2ef33c131 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:27.430261 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc0097-1660-4885-8090-9cb438084bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:27.431101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0097-1660-4885-8090-9cb438084bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:27.431376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0097-1660-4885-8090-9cb438084bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:27.431642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0097-1660-4885-8090-9cb438084bc1 admin admin] PATH_INFO: `/v3/domains/92fedc15268147a99e2a041de45b0110` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:27.433404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc0097-1660-4885-8090-9cb438084bc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=92fedc15268147a99e2a041de45b0110)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:27.435510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc0097-1660-4885-8090-9cb438084bc1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:27.437115 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 536/1072] 10.222.0.87 () {56 vars in 1204 bytes} [Fri Oct 29 01:12:27 2021] GET /identity/v3/domains/92fedc15268147a99e2a041de45b0110 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:27.443290 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f9a9e-3dc8-41a4-be5c-1b631b09cdf8 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:27.453018 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f9a9e-3dc8-41a4-be5c-1b631b09cdf8 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:27.457480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc7756-75ea-4595-85df-0255f347d0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:27.458137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc7756-75ea-4595-85df-0255f347d0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:27.458416 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc7756-75ea-4595-85df-0255f347d0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:27.458687 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc7756-75ea-4595-85df-0255f347d0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:27.459448 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc7756-75ea-4595-85df-0255f347d0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:27.461354 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc7756-75ea-4595-85df-0255f347d0c8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:27.529356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 537/1073] 10.222.0.87 () {60 vars in 1153 bytes} [Fri Oct 29 01:12:27 2021] POST /identity/v3/users => generated 311 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:12:29.846221 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce3a8e-aab4-4e8c-a5a9-fc8122d01eee None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:29.846798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce3a8e-aab4-4e8c-a5a9-fc8122d01eee None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:29.846798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce3a8e-aab4-4e8c-a5a9-fc8122d01eee None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:29.848552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 537/1074] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:12:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:12:29.855102 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec265cd9-9d4d-44d2-a837-168a54ed525f None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:29.856101 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec265cd9-9d4d-44d2-a837-168a54ed525f None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:29.856101 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec265cd9-9d4d-44d2-a837-168a54ed525f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:29.874123 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ec265cd9-9d4d-44d2-a837-168a54ed525f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:12:29.875307 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ec265cd9-9d4d-44d2-a837-168a54ed525f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:12:29.882967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 538/1075] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:12:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:12:29.910056 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce3a8e-aab4-4e8c-a5a9-fc8122d01eee None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:29.922579 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce3a8e-aab4-4e8c-a5a9-fc8122d01eee None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:29.926911 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4939930-61aa-4aa8-b8b7-fc402fa08bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:29.927670 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4939930-61aa-4aa8-b8b7-fc402fa08bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:29.927980 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4939930-61aa-4aa8-b8b7-fc402fa08bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:29.928249 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4939930-61aa-4aa8-b8b7-fc402fa08bc8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:29.939424 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4939930-61aa-4aa8-b8b7-fc402fa08bc8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:12:29.946321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-e4939930-61aa-4aa8-b8b7-fc402fa08bc8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:12:29.947440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 538/1076] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:12:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:12:29.954073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec265cd9-9d4d-44d2-a837-168a54ed525f None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:29.962967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec265cd9-9d4d-44d2-a837-168a54ed525f None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:29.967515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88241112-a0f0-4c41-a43b-f4a7a183987e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:29.968204 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88241112-a0f0-4c41-a43b-f4a7a183987e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:29.968486 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88241112-a0f0-4c41-a43b-f4a7a183987e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:29.968764 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88241112-a0f0-4c41-a43b-f4a7a183987e admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:29.969525 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88241112-a0f0-4c41-a43b-f4a7a183987e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:12:29.969828 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88241112-a0f0-4c41-a43b-f4a7a183987e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:29.971377 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88241112-a0f0-4c41-a43b-f4a7a183987e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:29.979432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 539/1077] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:12:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:29.986867 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4939930-61aa-4aa8-b8b7-fc402fa08bc8 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:29.997426 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4939930-61aa-4aa8-b8b7-fc402fa08bc8 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:30.001931 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4cba4-4fcd-4725-9088-93bdfba9ac04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:30.002762 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4cba4-4fcd-4725-9088-93bdfba9ac04 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:30.003040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4cba4-4fcd-4725-9088-93bdfba9ac04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:30.003312 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4cba4-4fcd-4725-9088-93bdfba9ac04 admin admin] PATH_INFO: `/v3/users/67780d4a28e64630a7641273d43b85e2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:30.016778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4cba4-4fcd-4725-9088-93bdfba9ac04 admin admin] RBAC: Authorizing `identity:get_user(user_id=67780d4a28e64630a7641273d43b85e2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:30.018902 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4cba4-4fcd-4725-9088-93bdfba9ac04 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:30.020523 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 539/1078] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:12:29 2021] GET /identity/v3/users/67780d4a28e64630a7641273d43b85e2 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:30.027003 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88241112-a0f0-4c41-a43b-f4a7a183987e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:30.036274 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88241112-a0f0-4c41-a43b-f4a7a183987e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:30.040690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb340e-a8a7-43ed-9971-a2ac773bec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:30.041300 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb340e-a8a7-43ed-9971-a2ac773bec29 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:30.041576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb340e-a8a7-43ed-9971-a2ac773bec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:30.041842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb340e-a8a7-43ed-9971-a2ac773bec29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:30.050199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb340e-a8a7-43ed-9971-a2ac773bec29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:30.051925 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb340e-a8a7-43ed-9971-a2ac773bec29 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:30.061249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 540/1079] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:12:30 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:12:30.068123 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4cba4-4fcd-4725-9088-93bdfba9ac04 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:30.078609 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4cba4-4fcd-4725-9088-93bdfba9ac04 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:30.083337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97564d-f4a8-4bb5-af5e-8eedd6b1293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:30.084207 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97564d-f4a8-4bb5-af5e-8eedd6b1293e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:30.084491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97564d-f4a8-4bb5-af5e-8eedd6b1293e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:30.084768 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97564d-f4a8-4bb5-af5e-8eedd6b1293e admin admin] PATH_INFO: `/v3/projects/ffde9ad838444a8e935af4447dbb2e2e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:30.086005 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97564d-f4a8-4bb5-af5e-8eedd6b1293e admin admin] RBAC: Authorizing `identity:get_project(project_id=ffde9ad838444a8e935af4447dbb2e2e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:30.088040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97564d-f4a8-4bb5-af5e-8eedd6b1293e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:30.090679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 540/1080] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:12:30 2021] GET /identity/v3/projects/ffde9ad838444a8e935af4447dbb2e2e => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:30.099472 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb340e-a8a7-43ed-9971-a2ac773bec29 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:30.108844 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb340e-a8a7-43ed-9971-a2ac773bec29 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:30.113392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed405120-e0c7-4ee5-a49f-da803a3ecb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:30.114005 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed405120-e0c7-4ee5-a49f-da803a3ecb7c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:30.114281 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed405120-e0c7-4ee5-a49f-da803a3ecb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:30.114544 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed405120-e0c7-4ee5-a49f-da803a3ecb7c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:30.115360 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed405120-e0c7-4ee5-a49f-da803a3ecb7c admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=ffde9ad838444a8e935af4447dbb2e2e, user.id=67780d4a28e64630a7641273d43b85e2) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:12:30.115661 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed405120-e0c7-4ee5-a49f-da803a3ecb7c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:30.117465 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed405120-e0c7-4ee5-a49f-da803a3ecb7c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:30.122693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 541/1081] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:12:30 2021] GET /identity/v3/role_assignments?user.id=67780d4a28e64630a7641273d43b85e2&scope.project.id=ffde9ad838444a8e935af4447dbb2e2e&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:32.366914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a071d-397b-4639-9350-d63a186276ef None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:32.367486 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a071d-397b-4639-9350-d63a186276ef None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:32.367486 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a071d-397b-4639-9350-d63a186276ef None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:32.369261 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 541/1082] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:12:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:12:32.376336 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f279-687e-4aec-84dd-db7fff790dbc None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:32.376870 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f279-687e-4aec-84dd-db7fff790dbc None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:32.376870 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f279-687e-4aec-84dd-db7fff790dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:32.395130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-3b29f279-687e-4aec-84dd-db7fff790dbc None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:12:32.396351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3b29f279-687e-4aec-84dd-db7fff790dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:12:32.404077 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 542/1083] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:12:32 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:12:32.428306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a071d-397b-4639-9350-d63a186276ef None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:32.441090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a071d-397b-4639-9350-d63a186276ef None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:32.445728 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111ae9-3bef-4029-bcdb-acb446ca588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:32.446605 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111ae9-3bef-4029-bcdb-acb446ca588d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:32.446980 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111ae9-3bef-4029-bcdb-acb446ca588d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:32.447341 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111ae9-3bef-4029-bcdb-acb446ca588d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:32.459042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d111ae9-3bef-4029-bcdb-acb446ca588d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:12:32.466559 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-1d111ae9-3bef-4029-bcdb-acb446ca588d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:12:32.467780 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 542/1084] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:12:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:12:32.474767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29f279-687e-4aec-84dd-db7fff790dbc None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:32.484351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29f279-687e-4aec-84dd-db7fff790dbc None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:32.488773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ac5bf-fb69-49e1-8f61-034472d505a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:32.489420 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ac5bf-fb69-49e1-8f61-034472d505a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:32.489692 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ac5bf-fb69-49e1-8f61-034472d505a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:32.489960 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ac5bf-fb69-49e1-8f61-034472d505a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:32.490714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ac5bf-fb69-49e1-8f61-034472d505a5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:12:32.491011 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ac5bf-fb69-49e1-8f61-034472d505a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:32.492605 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ac5bf-fb69-49e1-8f61-034472d505a5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:32.501096 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 543/1085] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:12:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:12:32.507791 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111ae9-3bef-4029-bcdb-acb446ca588d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:32.518421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111ae9-3bef-4029-bcdb-acb446ca588d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:32.522917 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4676459-86e1-41a8-ac29-b877c7dbda11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:32.523777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676459-86e1-41a8-ac29-b877c7dbda11 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:32.524061 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676459-86e1-41a8-ac29-b877c7dbda11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:32.524332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676459-86e1-41a8-ac29-b877c7dbda11 admin admin] PATH_INFO: `/v3/users/67780d4a28e64630a7641273d43b85e2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:32.525512 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4676459-86e1-41a8-ac29-b877c7dbda11 admin admin] RBAC: Authorizing `identity:get_user(user_id=67780d4a28e64630a7641273d43b85e2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:32.528183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4676459-86e1-41a8-ac29-b877c7dbda11 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:32.529909 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 543/1086] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:12:32 2021] GET /identity/v3/users/67780d4a28e64630a7641273d43b85e2 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:32.536356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ac5bf-fb69-49e1-8f61-034472d505a5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:32.546452 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ac5bf-fb69-49e1-8f61-034472d505a5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:32.550866 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f9e91-ed14-4bf5-ae5d-a8d618e87708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:32.551695 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f9e91-ed14-4bf5-ae5d-a8d618e87708 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:32.551998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f9e91-ed14-4bf5-ae5d-a8d618e87708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:32.552263 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f9e91-ed14-4bf5-ae5d-a8d618e87708 admin admin] PATH_INFO: `/v3/projects/ffde9ad838444a8e935af4447dbb2e2e` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:32.553452 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f9e91-ed14-4bf5-ae5d-a8d618e87708 admin admin] RBAC: Authorizing `identity:get_project(project_id=ffde9ad838444a8e935af4447dbb2e2e)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:32.555442 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f9e91-ed14-4bf5-ae5d-a8d618e87708 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:32.557126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 544/1087] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:12:32 2021] GET /identity/v3/projects/ffde9ad838444a8e935af4447dbb2e2e => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:32.563701 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4676459-86e1-41a8-ac29-b877c7dbda11 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:32.573720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4676459-86e1-41a8-ac29-b877c7dbda11 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:32.578238 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505cd00-5caf-4479-abac-0af5d6af6daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:32.579098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505cd00-5caf-4479-abac-0af5d6af6daf admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:32.579376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505cd00-5caf-4479-abac-0af5d6af6daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:32.579646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505cd00-5caf-4479-abac-0af5d6af6daf admin admin] PATH_INFO: `/v3/projects/ffde9ad838444a8e935af4447dbb2e2e/users/67780d4a28e64630a7641273d43b85e2/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:32.581588 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505cd00-5caf-4479-abac-0af5d6af6daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffde9ad838444a8e935af4447dbb2e2e, user_id=67780d4a28e64630a7641273d43b85e2, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:32.584186 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505cd00-5caf-4479-abac-0af5d6af6daf admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:32.688457 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 544/1088] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:12:32 2021] PUT /identity/v3/projects/ffde9ad838444a8e935af4447dbb2e2e/users/67780d4a28e64630a7641273d43b85e2/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:12:34.953264 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaad75-a25e-4796-ab56-2dcb3d2b1962 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:34.953808 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaad75-a25e-4796-ab56-2dcb3d2b1962 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:34.953808 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaad75-a25e-4796-ab56-2dcb3d2b1962 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:34.955574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 545/1089] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:12:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:12:34.961626 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc194c-6a12-4748-aa30-35f0d14c72a7 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:34.962054 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc194c-6a12-4748-aa30-35f0d14c72a7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:34.962162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc194c-6a12-4748-aa30-35f0d14c72a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:34.980456 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-9adc194c-6a12-4748-aa30-35f0d14c72a7 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:12:34.981640 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-9adc194c-6a12-4748-aa30-35f0d14c72a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:12:35.035996 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 545/1090] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:12:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:12:35.061455 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaad75-a25e-4796-ab56-2dcb3d2b1962 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:35.073566 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaad75-a25e-4796-ab56-2dcb3d2b1962 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:35.077857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f00f9-098f-45b3-831c-e8122ca2ed65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:35.078609 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f00f9-098f-45b3-831c-e8122ca2ed65 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:35.078885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f00f9-098f-45b3-831c-e8122ca2ed65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:35.079153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f00f9-098f-45b3-831c-e8122ca2ed65 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:35.088983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f00f9-098f-45b3-831c-e8122ca2ed65 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:12:35.095676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-1e4f00f9-098f-45b3-831c-e8122ca2ed65 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:12:35.096864 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 546/1091] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:12:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:12:35.103493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc194c-6a12-4748-aa30-35f0d14c72a7 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:35.112777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc194c-6a12-4748-aa30-35f0d14c72a7 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:35.117201 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11450c1-171b-432c-a3b6-138ed2bcf0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:35.117847 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11450c1-171b-432c-a3b6-138ed2bcf0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:35.118121 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11450c1-171b-432c-a3b6-138ed2bcf0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:35.118386 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11450c1-171b-432c-a3b6-138ed2bcf0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:35.119140 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11450c1-171b-432c-a3b6-138ed2bcf0b0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:12:35.119438 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11450c1-171b-432c-a3b6-138ed2bcf0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:35.121904 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11450c1-171b-432c-a3b6-138ed2bcf0b0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:35.130128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 546/1092] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:12:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:35.137384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f00f9-098f-45b3-831c-e8122ca2ed65 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:35.147437 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f00f9-098f-45b3-831c-e8122ca2ed65 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:35.152096 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de8811-2b2f-4bd2-927f-06ad24fd989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:35.152923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8811-2b2f-4bd2-927f-06ad24fd989a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:35.153200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8811-2b2f-4bd2-927f-06ad24fd989a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:35.153494 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8811-2b2f-4bd2-927f-06ad24fd989a admin admin] PATH_INFO: `/v3/users/67780d4a28e64630a7641273d43b85e2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:35.154654 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de8811-2b2f-4bd2-927f-06ad24fd989a admin admin] RBAC: Authorizing `identity:get_user(user_id=67780d4a28e64630a7641273d43b85e2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:35.156765 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de8811-2b2f-4bd2-927f-06ad24fd989a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:35.158339 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 547/1093] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:12:35 2021] GET /identity/v3/users/67780d4a28e64630a7641273d43b85e2 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:12:35.164707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11450c1-171b-432c-a3b6-138ed2bcf0b0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:35.174864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11450c1-171b-432c-a3b6-138ed2bcf0b0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:35.179392 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0387ab-d70e-4253-82c0-adeecb3a7806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:35.180048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0387ab-d70e-4253-82c0-adeecb3a7806 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:35.180330 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0387ab-d70e-4253-82c0-adeecb3a7806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:35.180600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0387ab-d70e-4253-82c0-adeecb3a7806 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:35.188802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0387ab-d70e-4253-82c0-adeecb3a7806 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:35.190534 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0387ab-d70e-4253-82c0-adeecb3a7806 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:35.200074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 547/1094] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:12:35 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:12:35.206773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de8811-2b2f-4bd2-927f-06ad24fd989a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:35.217252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de8811-2b2f-4bd2-927f-06ad24fd989a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:35.221788 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39f620-67b7-48f9-83e2-016abe333888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:35.222615 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39f620-67b7-48f9-83e2-016abe333888 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:35.222910 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39f620-67b7-48f9-83e2-016abe333888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:35.223169 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39f620-67b7-48f9-83e2-016abe333888 admin admin] PATH_INFO: `/v3/projects/ffde9ad838444a8e935af4447dbb2e2e` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:35.224373 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39f620-67b7-48f9-83e2-016abe333888 admin admin] RBAC: Authorizing `identity:get_project(project_id=ffde9ad838444a8e935af4447dbb2e2e)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:35.226377 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39f620-67b7-48f9-83e2-016abe333888 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:35.228124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 548/1095] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:12:35 2021] GET /identity/v3/projects/ffde9ad838444a8e935af4447dbb2e2e => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:12:35.235324 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0387ab-d70e-4253-82c0-adeecb3a7806 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:12:35.244129 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0387ab-d70e-4253-82c0-adeecb3a7806 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:12:35.250121 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aa407-a453-49ef-ad84-ed022ed6d52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:12:35.250788 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa407-a453-49ef-ad84-ed022ed6d52c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:12:35.251067 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa407-a453-49ef-ad84-ed022ed6d52c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:12:35.251337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa407-a453-49ef-ad84-ed022ed6d52c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:12:35.252239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aa407-a453-49ef-ad84-ed022ed6d52c admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=ffde9ad838444a8e935af4447dbb2e2e, user.id=67780d4a28e64630a7641273d43b85e2) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:12:35.252546 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aa407-a453-49ef-ad84-ed022ed6d52c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:12:35.254362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aa407-a453-49ef-ad84-ed022ed6d52c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:12:35.260535 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 548/1096] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:12:35 2021] GET /identity/v3/role_assignments?user.id=67780d4a28e64630a7641273d43b85e2&scope.project.id=ffde9ad838444a8e935af4447dbb2e2e&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:49.276172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52fcee-cb3a-44c1-aab0-de7af333e3d5 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:49.276743 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52fcee-cb3a-44c1-aab0-de7af333e3d5 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:49.276743 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52fcee-cb3a-44c1-aab0-de7af333e3d5 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:49.278430 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 549/1097] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:13:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:13:49.284525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eb4df-9e97-48a5-a953-ed24a2e203df None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:49.284993 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eb4df-9e97-48a5-a953-ed24a2e203df None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:49.285158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eb4df-9e97-48a5-a953-ed24a2e203df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:49.303131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-e47eb4df-9e97-48a5-a953-ed24a2e203df None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:13:49.306020 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e47eb4df-9e97-48a5-a953-ed24a2e203df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:13:49.312968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 549/1098] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:13:49 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:13:49.338752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52fcee-cb3a-44c1-aab0-de7af333e3d5 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:49.351579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52fcee-cb3a-44c1-aab0-de7af333e3d5 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:49.355931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc7be7-f46b-4843-b082-589e9dcdbabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:49.356706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc7be7-f46b-4843-b082-589e9dcdbabf admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:49.356989 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc7be7-f46b-4843-b082-589e9dcdbabf admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:49.357256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc7be7-f46b-4843-b082-589e9dcdbabf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:49.368615 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc7be7-f46b-4843-b082-589e9dcdbabf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:49.370516 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc7be7-f46b-4843-b082-589e9dcdbabf admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:49.387538 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-f7bc7be7-f46b-4843-b082-589e9dcdbabf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:13:49.388744 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 550/1099] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:13:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:13:49.395573 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47eb4df-9e97-48a5-a953-ed24a2e203df None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:49.406215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47eb4df-9e97-48a5-a953-ed24a2e203df None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:49.410760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4c123-d285-4f09-bb61-578b1b0ff9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:49.411418 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4c123-d285-4f09-bb61-578b1b0ff9fe admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:49.411695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4c123-d285-4f09-bb61-578b1b0ff9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:49.412005 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4c123-d285-4f09-bb61-578b1b0ff9fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:49.412732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4c123-d285-4f09-bb61-578b1b0ff9fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:49.413537 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4c123-d285-4f09-bb61-578b1b0ff9fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:49.415116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4c123-d285-4f09-bb61-578b1b0ff9fe admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:49.426676 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 550/1100] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:13:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:13:49.433786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc7be7-f46b-4843-b082-589e9dcdbabf admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:49.443999 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc7be7-f46b-4843-b082-589e9dcdbabf admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:49.448790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a6d70-592a-4581-99a0-74be43a2858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:49.449451 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a6d70-592a-4581-99a0-74be43a2858e admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:49.449730 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a6d70-592a-4581-99a0-74be43a2858e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:49.450007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a6d70-592a-4581-99a0-74be43a2858e admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:49.450736 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a6d70-592a-4581-99a0-74be43a2858e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:49.452665 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a6d70-592a-4581-99a0-74be43a2858e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:49.623758 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 551/1101] 10.222.0.87 () {60 vars in 1153 bytes} [Fri Oct 29 01:13:49 2021] POST /identity/v3/users => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:13:51.951474 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96caf-2ceb-4d63-876a-f2c1cf4e750a None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:51.952053 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96caf-2ceb-4d63-876a-f2c1cf4e750a None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:51.952053 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96caf-2ceb-4d63-876a-f2c1cf4e750a None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:51.953905 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 551/1102] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:13:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:13:51.960574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14976da6-e68d-466c-8559-c174308ae688 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:51.961016 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14976da6-e68d-466c-8559-c174308ae688 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:51.961168 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14976da6-e68d-466c-8559-c174308ae688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:51.979574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-14976da6-e68d-466c-8559-c174308ae688 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:13:51.980803 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-14976da6-e68d-466c-8559-c174308ae688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:13:51.988560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 552/1103] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:13:51 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:13:52.013958 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f96caf-2ceb-4d63-876a-f2c1cf4e750a None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:52.026632 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f96caf-2ceb-4d63-876a-f2c1cf4e750a None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:52.030989 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7529b-a9f3-4137-bb45-3a0000f7dd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:52.036138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7529b-a9f3-4137-bb45-3a0000f7dd1d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:52.036138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7529b-a9f3-4137-bb45-3a0000f7dd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:52.036138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7529b-a9f3-4137-bb45-3a0000f7dd1d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:52.043705 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7529b-a9f3-4137-bb45-3a0000f7dd1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:13:52.050608 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-f6d7529b-a9f3-4137-bb45-3a0000f7dd1d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:13:52.053391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 552/1104] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:13:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:13:52.058659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14976da6-e68d-466c-8559-c174308ae688 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:52.067665 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14976da6-e68d-466c-8559-c174308ae688 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:52.073147 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276c8e3-6849-4681-b9fd-7a95504d1332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:52.073809 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276c8e3-6849-4681-b9fd-7a95504d1332 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:52.074090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276c8e3-6849-4681-b9fd-7a95504d1332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:52.074362 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276c8e3-6849-4681-b9fd-7a95504d1332 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:52.075123 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276c8e3-6849-4681-b9fd-7a95504d1332 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:52.075427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276c8e3-6849-4681-b9fd-7a95504d1332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:52.077062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276c8e3-6849-4681-b9fd-7a95504d1332 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:52.086208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 553/1105] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:13:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:52.092741 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7529b-a9f3-4137-bb45-3a0000f7dd1d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:52.103043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7529b-a9f3-4137-bb45-3a0000f7dd1d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:52.107508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a298c-1ba6-4a80-bb9b-57e467052145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:52.108322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a298c-1ba6-4a80-bb9b-57e467052145 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:52.108597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a298c-1ba6-4a80-bb9b-57e467052145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:52.108873 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a298c-1ba6-4a80-bb9b-57e467052145 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:52.119284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a298c-1ba6-4a80-bb9b-57e467052145 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:52.122463 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a298c-1ba6-4a80-bb9b-57e467052145 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:52.137823 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-118a298c-1ba6-4a80-bb9b-57e467052145 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:13:52.139701 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 553/1106] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:13:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:13:52.145444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276c8e3-6849-4681-b9fd-7a95504d1332 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:52.156045 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276c8e3-6849-4681-b9fd-7a95504d1332 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:52.160769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42fdaf-647d-4c2a-8d26-7a21ee4b5bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:52.161437 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42fdaf-647d-4c2a-8d26-7a21ee4b5bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:52.161774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42fdaf-647d-4c2a-8d26-7a21ee4b5bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:52.162048 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42fdaf-647d-4c2a-8d26-7a21ee4b5bd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:52.162805 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42fdaf-647d-4c2a-8d26-7a21ee4b5bd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:52.163794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42fdaf-647d-4c2a-8d26-7a21ee4b5bd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:52.165851 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42fdaf-647d-4c2a-8d26-7a21ee4b5bd1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:52.178423 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 554/1107] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:13:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:52.185445 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a298c-1ba6-4a80-bb9b-57e467052145 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:52.196367 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a298c-1ba6-4a80-bb9b-57e467052145 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:52.200970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a8ef5-d012-4d55-a53d-42c6f8d3ddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:52.201750 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a8ef5-d012-4d55-a53d-42c6f8d3ddd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:52.202030 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a8ef5-d012-4d55-a53d-42c6f8d3ddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:52.202298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a8ef5-d012-4d55-a53d-42c6f8d3ddd9 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:52.209479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a8ef5-d012-4d55-a53d-42c6f8d3ddd9 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:52.212535 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a8ef5-d012-4d55-a53d-42c6f8d3ddd9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:52.226710 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-f43a8ef5-d012-4d55-a53d-42c6f8d3ddd9 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 01:13:52.227873 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 554/1108] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:13:52 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:13:52.234302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42fdaf-647d-4c2a-8d26-7a21ee4b5bd1 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:52.243976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42fdaf-647d-4c2a-8d26-7a21ee4b5bd1 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:52.248775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fe7b6-06d6-46ad-98d3-bf67c277fd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:52.249312 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fe7b6-06d6-46ad-98d3-bf67c277fd08 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:52.249586 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fe7b6-06d6-46ad-98d3-bf67c277fd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:52.249853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fe7b6-06d6-46ad-98d3-bf67c277fd08 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:52.250685 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fe7b6-06d6-46ad-98d3-bf67c277fd08 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:52.250983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fe7b6-06d6-46ad-98d3-bf67c277fd08 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:52.252824 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fe7b6-06d6-46ad-98d3-bf67c277fd08 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:52.270565 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 555/1109] 10.222.0.87 () {56 vars in 1164 bytes} [Fri Oct 29 01:13:52 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:52.278595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a8ef5-d012-4d55-a53d-42c6f8d3ddd9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:52.288913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a8ef5-d012-4d55-a53d-42c6f8d3ddd9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:52.293467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7ee3c-56ad-44e3-8e2a-0b32632f5df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:52.294099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7ee3c-56ad-44e3-8e2a-0b32632f5df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:52.294379 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7ee3c-56ad-44e3-8e2a-0b32632f5df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:52.294650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7ee3c-56ad-44e3-8e2a-0b32632f5df0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:52.302279 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7ee3c-56ad-44e3-8e2a-0b32632f5df0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:52.304733 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7ee3c-56ad-44e3-8e2a-0b32632f5df0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:52.313414 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 555/1110] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:13:52 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:13:52.320794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fe7b6-06d6-46ad-98d3-bf67c277fd08 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:52.330328 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fe7b6-06d6-46ad-98d3-bf67c277fd08 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:52.335570 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd0368-08a1-42ca-a725-ff0e4f152d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:52.336433 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd0368-08a1-42ca-a725-ff0e4f152d9b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:52.336709 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd0368-08a1-42ca-a725-ff0e4f152d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:52.338055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd0368-08a1-42ca-a725-ff0e4f152d9b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:52.347180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd0368-08a1-42ca-a725-ff0e4f152d9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:52.349013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd0368-08a1-42ca-a725-ff0e4f152d9b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:52.366574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-34dd0368-08a1-42ca-a725-ff0e4f152d9b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:13:52.367652 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 556/1111] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:13:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:13:52.374139 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7ee3c-56ad-44e3-8e2a-0b32632f5df0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:52.383685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7ee3c-56ad-44e3-8e2a-0b32632f5df0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:52.388312 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8228df6-6b13-4b91-993b-d4ad4c0e44e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:52.395410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8228df6-6b13-4b91-993b-d4ad4c0e44e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:52.395410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8228df6-6b13-4b91-993b-d4ad4c0e44e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:52.395410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8228df6-6b13-4b91-993b-d4ad4c0e44e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:52.395410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8228df6-6b13-4b91-993b-d4ad4c0e44e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:52.395410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8228df6-6b13-4b91-993b-d4ad4c0e44e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:52.395410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8228df6-6b13-4b91-993b-d4ad4c0e44e7 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:52.403815 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 556/1112] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:13:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:52.410196 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd0368-08a1-42ca-a725-ff0e4f152d9b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:52.420442 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd0368-08a1-42ca-a725-ff0e4f152d9b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:52.424954 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f94ce2-dc9f-462f-9a5a-2ad22d70b988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:52.425709 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f94ce2-dc9f-462f-9a5a-2ad22d70b988 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:52.429982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f94ce2-dc9f-462f-9a5a-2ad22d70b988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:52.429982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f94ce2-dc9f-462f-9a5a-2ad22d70b988 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:52.433630 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f94ce2-dc9f-462f-9a5a-2ad22d70b988 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:52.435532 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f94ce2-dc9f-462f-9a5a-2ad22d70b988 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:52.448802 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-96f94ce2-dc9f-462f-9a5a-2ad22d70b988 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:13:52.449931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 557/1113] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:13:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:13:52.456860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8228df6-6b13-4b91-993b-d4ad4c0e44e7 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:52.466967 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8228df6-6b13-4b91-993b-d4ad4c0e44e7 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:52.471598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae5808-7a69-4c28-ac47-97a10fcdbbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:52.472270 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae5808-7a69-4c28-ac47-97a10fcdbbea admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:52.477685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae5808-7a69-4c28-ac47-97a10fcdbbea admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:52.477685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae5808-7a69-4c28-ac47-97a10fcdbbea admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:52.477685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae5808-7a69-4c28-ac47-97a10fcdbbea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:52.477685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae5808-7a69-4c28-ac47-97a10fcdbbea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:52.477685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae5808-7a69-4c28-ac47-97a10fcdbbea admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:52.488831 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 557/1114] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:13:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:13:52.497251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f94ce2-dc9f-462f-9a5a-2ad22d70b988 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:52.508030 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f94ce2-dc9f-462f-9a5a-2ad22d70b988 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:52.512580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91833934-7d45-4f71-804e-f7e2f8c97907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:52.513200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91833934-7d45-4f71-804e-f7e2f8c97907 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:52.513477 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91833934-7d45-4f71-804e-f7e2f8c97907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:52.513745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91833934-7d45-4f71-804e-f7e2f8c97907 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:52.514567 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91833934-7d45-4f71-804e-f7e2f8c97907 admin admin] RBAC: Adding query filter params (role.id=0811ae5a177643f9b2b86ec5feb7b163, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=9aa303a60fec4ac5aaeb96c6618b387e) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:52.514872 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91833934-7d45-4f71-804e-f7e2f8c97907 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:52.516717 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91833934-7d45-4f71-804e-f7e2f8c97907 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:52.522043 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 558/1115] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:13:52 2021] GET /identity/v3/role_assignments?user.id=9aa303a60fec4ac5aaeb96c6618b387e&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=0811ae5a177643f9b2b86ec5feb7b163 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:13:54.774066 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5494eb-7086-4c96-87c7-8a825c6f083a None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:54.774629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5494eb-7086-4c96-87c7-8a825c6f083a None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:54.774629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5494eb-7086-4c96-87c7-8a825c6f083a None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:54.776440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 558/1116] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:13:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:13:54.783658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c783b32-16c7-42ff-b22d-500584084a4c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:54.784172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c783b32-16c7-42ff-b22d-500584084a4c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:54.784619 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c783b32-16c7-42ff-b22d-500584084a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:54.803287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-9c783b32-16c7-42ff-b22d-500584084a4c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:13:54.805965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9c783b32-16c7-42ff-b22d-500584084a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:13:54.815159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 559/1117] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:13:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:13:54.840501 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5494eb-7086-4c96-87c7-8a825c6f083a None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:54.855493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5494eb-7086-4c96-87c7-8a825c6f083a None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:54.860491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271bcff-3e49-4cd4-8d06-ebcc6c22f9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:54.861711 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271bcff-3e49-4cd4-8d06-ebcc6c22f9ea admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:54.861957 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271bcff-3e49-4cd4-8d06-ebcc6c22f9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:54.862404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271bcff-3e49-4cd4-8d06-ebcc6c22f9ea admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:54.877892 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271bcff-3e49-4cd4-8d06-ebcc6c22f9ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:13:54.886336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-9271bcff-3e49-4cd4-8d06-ebcc6c22f9ea admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:13:54.887562 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 559/1118] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:13:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:13:54.894416 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c783b32-16c7-42ff-b22d-500584084a4c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:54.903874 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c783b32-16c7-42ff-b22d-500584084a4c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:54.908532 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351960ae-dd7d-45ef-aa52-e520a6d53fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:54.909271 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351960ae-dd7d-45ef-aa52-e520a6d53fda admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:54.909546 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351960ae-dd7d-45ef-aa52-e520a6d53fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:54.909842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351960ae-dd7d-45ef-aa52-e520a6d53fda admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:54.910606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351960ae-dd7d-45ef-aa52-e520a6d53fda admin admin] RBAC: Adding query filter params (name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:54.910900 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351960ae-dd7d-45ef-aa52-e520a6d53fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:54.912700 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351960ae-dd7d-45ef-aa52-e520a6d53fda admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:54.921466 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 560/1119] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:13:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:54.928096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271bcff-3e49-4cd4-8d06-ebcc6c22f9ea admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:54.942120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271bcff-3e49-4cd4-8d06-ebcc6c22f9ea admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:54.947972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ffba8-c2b7-4090-ade3-a5140b8afa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:54.948750 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ffba8-c2b7-4090-ade3-a5140b8afa39 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:54.949032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ffba8-c2b7-4090-ade3-a5140b8afa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:54.949303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ffba8-c2b7-4090-ade3-a5140b8afa39 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:54.960673 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ffba8-c2b7-4090-ade3-a5140b8afa39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:54.962548 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ffba8-c2b7-4090-ade3-a5140b8afa39 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:54.981213 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-ea6ffba8-c2b7-4090-ade3-a5140b8afa39 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:13:54.983033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 560/1120] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:13:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:13:54.989670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351960ae-dd7d-45ef-aa52-e520a6d53fda admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:54.999970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351960ae-dd7d-45ef-aa52-e520a6d53fda admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:55.004487 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c92f1-4e76-415f-bc1f-924621e6f9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:55.005129 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c92f1-4e76-415f-bc1f-924621e6f9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:55.005403 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c92f1-4e76-415f-bc1f-924621e6f9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:55.005674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c92f1-4e76-415f-bc1f-924621e6f9a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:55.006401 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c92f1-4e76-415f-bc1f-924621e6f9a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:55.007308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c92f1-4e76-415f-bc1f-924621e6f9a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:55.008905 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c92f1-4e76-415f-bc1f-924621e6f9a6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:55.021498 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 561/1121] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:13:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:55.028107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ffba8-c2b7-4090-ade3-a5140b8afa39 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:55.039310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ffba8-c2b7-4090-ade3-a5140b8afa39 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:55.043916 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e73c9-e6bd-4b59-a8f0-46bf06f6c96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:55.044768 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e73c9-e6bd-4b59-a8f0-46bf06f6c96e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:55.045048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e73c9-e6bd-4b59-a8f0-46bf06f6c96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:55.045316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e73c9-e6bd-4b59-a8f0-46bf06f6c96e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:55.054584 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e73c9-e6bd-4b59-a8f0-46bf06f6c96e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:55.056628 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e73c9-e6bd-4b59-a8f0-46bf06f6c96e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:55.071635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-333e73c9-e6bd-4b59-a8f0-46bf06f6c96e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 01:13:55.072858 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 561/1122] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:13:55 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:13:55.079573 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c92f1-4e76-415f-bc1f-924621e6f9a6 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:55.089521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c92f1-4e76-415f-bc1f-924621e6f9a6 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:55.094120 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c27b9-aaae-4276-9fc9-485ce99ca3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:55.094791 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c27b9-aaae-4276-9fc9-485ce99ca3ce admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:55.095070 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c27b9-aaae-4276-9fc9-485ce99ca3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:55.095340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c27b9-aaae-4276-9fc9-485ce99ca3ce admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:55.096236 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c27b9-aaae-4276-9fc9-485ce99ca3ce admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:55.096538 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c27b9-aaae-4276-9fc9-485ce99ca3ce admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:55.098353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c27b9-aaae-4276-9fc9-485ce99ca3ce admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:55.115857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 562/1123] 10.222.0.87 () {56 vars in 1164 bytes} [Fri Oct 29 01:13:55 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:55.122962 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e73c9-e6bd-4b59-a8f0-46bf06f6c96e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:55.134111 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e73c9-e6bd-4b59-a8f0-46bf06f6c96e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:55.138983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894ce4d-ef1e-4f43-9063-de5e2add1f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:55.139786 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894ce4d-ef1e-4f43-9063-de5e2add1f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:55.140067 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894ce4d-ef1e-4f43-9063-de5e2add1f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:55.140334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894ce4d-ef1e-4f43-9063-de5e2add1f93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:55.151490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894ce4d-ef1e-4f43-9063-de5e2add1f93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:55.153341 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894ce4d-ef1e-4f43-9063-de5e2add1f93 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:55.170241 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-7894ce4d-ef1e-4f43-9063-de5e2add1f93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:13:55.171649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 562/1124] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:13:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:13:55.178019 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c27b9-aaae-4276-9fc9-485ce99ca3ce admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:55.188498 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c27b9-aaae-4276-9fc9-485ce99ca3ce admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:55.193211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baadb36-6a1d-490c-8b58-a6482291e473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:55.194111 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baadb36-6a1d-490c-8b58-a6482291e473 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:55.194977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baadb36-6a1d-490c-8b58-a6482291e473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:55.195251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baadb36-6a1d-490c-8b58-a6482291e473 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:55.196014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baadb36-6a1d-490c-8b58-a6482291e473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:55.196321 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baadb36-6a1d-490c-8b58-a6482291e473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:55.197915 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baadb36-6a1d-490c-8b58-a6482291e473 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:55.209783 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 563/1125] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:13:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:55.217119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894ce4d-ef1e-4f43-9063-de5e2add1f93 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:55.231010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894ce4d-ef1e-4f43-9063-de5e2add1f93 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:55.236264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87694b6-2c0a-4f60-8070-46e58a8d8f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:55.237135 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87694b6-2c0a-4f60-8070-46e58a8d8f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:55.240637 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87694b6-2c0a-4f60-8070-46e58a8d8f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:55.240637 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87694b6-2c0a-4f60-8070-46e58a8d8f38 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:55.248230 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87694b6-2c0a-4f60-8070-46e58a8d8f38 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:55.250202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87694b6-2c0a-4f60-8070-46e58a8d8f38 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:55.269207 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-b87694b6-2c0a-4f60-8070-46e58a8d8f38 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:13:55.270417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 563/1126] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:13:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:13:55.277242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baadb36-6a1d-490c-8b58-a6482291e473 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:55.288507 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baadb36-6a1d-490c-8b58-a6482291e473 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:55.292395 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cef2ce-7b54-469f-958c-21db76146957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:55.293041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cef2ce-7b54-469f-958c-21db76146957 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:55.293353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cef2ce-7b54-469f-958c-21db76146957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:55.293817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cef2ce-7b54-469f-958c-21db76146957 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:55.295144 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cef2ce-7b54-469f-958c-21db76146957 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:55.295144 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cef2ce-7b54-469f-958c-21db76146957 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:55.296823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cef2ce-7b54-469f-958c-21db76146957 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:55.310102 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 564/1127] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:13:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:55.317040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87694b6-2c0a-4f60-8070-46e58a8d8f38 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:55.327943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87694b6-2c0a-4f60-8070-46e58a8d8f38 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:55.332606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061aa75-c7a4-4b01-94b7-71bd3e2331bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:55.333471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061aa75-c7a4-4b01-94b7-71bd3e2331bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:55.338334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061aa75-c7a4-4b01-94b7-71bd3e2331bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:55.338334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061aa75-c7a4-4b01-94b7-71bd3e2331bf admin admin] PATH_INFO: `/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/9aa303a60fec4ac5aaeb96c6618b387e/roles/0811ae5a177643f9b2b86ec5feb7b163` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:55.349033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061aa75-c7a4-4b01-94b7-71bd3e2331bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579ca0c9e3d480ab7b4f64d199c403b, user_id=9aa303a60fec4ac5aaeb96c6618b387e, role_id=0811ae5a177643f9b2b86ec5feb7b163)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:55.352386 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061aa75-c7a4-4b01-94b7-71bd3e2331bf admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:55.447151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 564/1128] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:13:55 2021] PUT /identity/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/9aa303a60fec4ac5aaeb96c6618b387e/roles/0811ae5a177643f9b2b86ec5feb7b163 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:13:57.726715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326972a-3ab0-412c-9780-90e75953bdf5 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:57.727325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326972a-3ab0-412c-9780-90e75953bdf5 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:57.727325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326972a-3ab0-412c-9780-90e75953bdf5 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:57.729078 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 565/1129] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:13:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:13:57.735033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033437b8-4ba2-4be3-b683-da3be426e4ba None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:57.735468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033437b8-4ba2-4be3-b683-da3be426e4ba None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:57.735613 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033437b8-4ba2-4be3-b683-da3be426e4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:57.753832 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-033437b8-4ba2-4be3-b683-da3be426e4ba None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:13:57.755065 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-033437b8-4ba2-4be3-b683-da3be426e4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:13:57.812995 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 565/1130] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:13:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:13:57.839585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326972a-3ab0-412c-9780-90e75953bdf5 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:57.852928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326972a-3ab0-412c-9780-90e75953bdf5 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:57.857357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959e472-e0ed-4681-8c81-a8f842dc6dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:57.858127 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e472-e0ed-4681-8c81-a8f842dc6dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:57.858409 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e472-e0ed-4681-8c81-a8f842dc6dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:57.858682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e472-e0ed-4681-8c81-a8f842dc6dc2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:57.873743 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959e472-e0ed-4681-8c81-a8f842dc6dc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:13:57.879182 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-0959e472-e0ed-4681-8c81-a8f842dc6dc2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 01:13:57.880448 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 566/1131] 10.222.0.87 () {56 vars in 1123 bytes} [Fri Oct 29 01:13:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:13:57.887514 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033437b8-4ba2-4be3-b683-da3be426e4ba None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:57.896793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033437b8-4ba2-4be3-b683-da3be426e4ba None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:57.902290 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c27c4-7dd7-4ef9-b144-a0a7e7f9d059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:57.902953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c27c4-7dd7-4ef9-b144-a0a7e7f9d059 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:57.903233 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c27c4-7dd7-4ef9-b144-a0a7e7f9d059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:57.903503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c27c4-7dd7-4ef9-b144-a0a7e7f9d059 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:57.904295 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c27c4-7dd7-4ef9-b144-a0a7e7f9d059 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:57.904598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c27c4-7dd7-4ef9-b144-a0a7e7f9d059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:57.906171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c27c4-7dd7-4ef9-b144-a0a7e7f9d059 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:57.915286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 566/1132] 10.222.0.87 () {56 vars in 1124 bytes} [Fri Oct 29 01:13:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:57.921710 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959e472-e0ed-4681-8c81-a8f842dc6dc2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:57.932021 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959e472-e0ed-4681-8c81-a8f842dc6dc2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:57.936704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5ddd4-05c2-4f0b-80a0-3135df37213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:57.937518 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5ddd4-05c2-4f0b-80a0-3135df37213a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:57.937797 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5ddd4-05c2-4f0b-80a0-3135df37213a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:57.938067 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5ddd4-05c2-4f0b-80a0-3135df37213a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:57.948746 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5ddd4-05c2-4f0b-80a0-3135df37213a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:57.950556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5ddd4-05c2-4f0b-80a0-3135df37213a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:57.967980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-caf5ddd4-05c2-4f0b-80a0-3135df37213a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:13:57.969185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 567/1133] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:13:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:13:57.977334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c27c4-7dd7-4ef9-b144-a0a7e7f9d059 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:57.987143 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c27c4-7dd7-4ef9-b144-a0a7e7f9d059 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:57.992526 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219114f-bb86-49c0-bf97-618b099c7a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:57.993177 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219114f-bb86-49c0-bf97-618b099c7a40 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:57.993460 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219114f-bb86-49c0-bf97-618b099c7a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:57.993738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219114f-bb86-49c0-bf97-618b099c7a40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:57.994476 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219114f-bb86-49c0-bf97-618b099c7a40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:57.994784 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219114f-bb86-49c0-bf97-618b099c7a40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:57.996411 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219114f-bb86-49c0-bf97-618b099c7a40 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:58.009025 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 567/1134] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:13:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:58.015471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5ddd4-05c2-4f0b-80a0-3135df37213a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:58.026332 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5ddd4-05c2-4f0b-80a0-3135df37213a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:58.031166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143586b4-a4e8-4eb8-abad-d70d7a00c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:58.031685 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143586b4-a4e8-4eb8-abad-d70d7a00c8ca admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:58.032010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143586b4-a4e8-4eb8-abad-d70d7a00c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:58.032287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143586b4-a4e8-4eb8-abad-d70d7a00c8ca admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:58.040388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143586b4-a4e8-4eb8-abad-d70d7a00c8ca admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:58.042393 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143586b4-a4e8-4eb8-abad-d70d7a00c8ca admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:58.057044 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-143586b4-a4e8-4eb8-abad-d70d7a00c8ca admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 01:13:58.058234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 568/1135] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:13:58 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:13:58.064792 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219114f-bb86-49c0-bf97-618b099c7a40 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:58.074884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219114f-bb86-49c0-bf97-618b099c7a40 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:58.079393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f25b35-aa08-4042-b917-a0fd131e3065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:58.080219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f25b35-aa08-4042-b917-a0fd131e3065 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:58.080493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f25b35-aa08-4042-b917-a0fd131e3065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:58.082996 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f25b35-aa08-4042-b917-a0fd131e3065 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:58.082996 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f25b35-aa08-4042-b917-a0fd131e3065 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:58.082996 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f25b35-aa08-4042-b917-a0fd131e3065 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:58.083792 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f25b35-aa08-4042-b917-a0fd131e3065 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:58.102226 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 568/1136] 10.222.0.87 () {56 vars in 1164 bytes} [Fri Oct 29 01:13:58 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:58.108777 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143586b4-a4e8-4eb8-abad-d70d7a00c8ca admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:58.118342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143586b4-a4e8-4eb8-abad-d70d7a00c8ca admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:58.122863 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb1096-aff3-480e-9c78-4a26fc0b4037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:58.123482 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb1096-aff3-480e-9c78-4a26fc0b4037 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:58.123792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb1096-aff3-480e-9c78-4a26fc0b4037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:58.124067 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb1096-aff3-480e-9c78-4a26fc0b4037 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:58.139914 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb1096-aff3-480e-9c78-4a26fc0b4037 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:58.141666 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb1096-aff3-480e-9c78-4a26fc0b4037 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:58.151041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 569/1137] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:13:58 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:13:58.157726 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f25b35-aa08-4042-b917-a0fd131e3065 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:58.168413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f25b35-aa08-4042-b917-a0fd131e3065 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:58.173231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb93e08-bb84-42a6-a360-12d52cb628a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:58.174009 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb93e08-bb84-42a6-a360-12d52cb628a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:58.174285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb93e08-bb84-42a6-a360-12d52cb628a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:58.174590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb93e08-bb84-42a6-a360-12d52cb628a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:58.184718 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb93e08-bb84-42a6-a360-12d52cb628a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:58.186520 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb93e08-bb84-42a6-a360-12d52cb628a9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:58.203680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-7cb93e08-bb84-42a6-a360-12d52cb628a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:13:58.204880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 569/1138] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:13:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:13:58.212133 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb1096-aff3-480e-9c78-4a26fc0b4037 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:58.221545 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb1096-aff3-480e-9c78-4a26fc0b4037 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:58.226521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e49b8-0645-41a8-8102-b1f89171bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:58.227183 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e49b8-0645-41a8-8102-b1f89171bfb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:58.227516 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e49b8-0645-41a8-8102-b1f89171bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:58.227788 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e49b8-0645-41a8-8102-b1f89171bfb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:58.228571 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e49b8-0645-41a8-8102-b1f89171bfb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:58.228875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e49b8-0645-41a8-8102-b1f89171bfb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:58.230425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e49b8-0645-41a8-8102-b1f89171bfb4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:58.242187 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 570/1139] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:13:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:58.248422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb93e08-bb84-42a6-a360-12d52cb628a9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:58.258649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb93e08-bb84-42a6-a360-12d52cb628a9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:58.263352 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3d04a-9efe-4037-8a27-1f1f066d1f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:58.264207 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3d04a-9efe-4037-8a27-1f1f066d1f78 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:58.264489 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3d04a-9efe-4037-8a27-1f1f066d1f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:58.264761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3d04a-9efe-4037-8a27-1f1f066d1f78 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:58.272058 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3d04a-9efe-4037-8a27-1f1f066d1f78 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:58.275297 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3d04a-9efe-4037-8a27-1f1f066d1f78 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:58.288759 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-29c3d04a-9efe-4037-8a27-1f1f066d1f78 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:13:58.289936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 570/1140] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:13:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:13:58.296532 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e49b8-0645-41a8-8102-b1f89171bfb4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:58.306159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e49b8-0645-41a8-8102-b1f89171bfb4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:58.310695 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de1a88-4aa6-4148-ae92-f46236148f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:58.311340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de1a88-4aa6-4148-ae92-f46236148f11 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:58.311622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de1a88-4aa6-4148-ae92-f46236148f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:58.311931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de1a88-4aa6-4148-ae92-f46236148f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:58.312722 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de1a88-4aa6-4148-ae92-f46236148f11 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:58.313029 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de1a88-4aa6-4148-ae92-f46236148f11 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:58.314834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de1a88-4aa6-4148-ae92-f46236148f11 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:58.327638 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 571/1141] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:13:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:13:58.334692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3d04a-9efe-4037-8a27-1f1f066d1f78 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:13:58.345496 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3d04a-9efe-4037-8a27-1f1f066d1f78 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:13:58.350018 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b7e7c-f82a-4d19-9867-d70c8f8aec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:13:58.350723 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7e7c-f82a-4d19-9867-d70c8f8aec72 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:13:58.350723 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7e7c-f82a-4d19-9867-d70c8f8aec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:13:58.351409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7e7c-f82a-4d19-9867-d70c8f8aec72 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:13:58.352271 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b7e7c-f82a-4d19-9867-d70c8f8aec72 admin admin] RBAC: Adding query filter params (role.id=0811ae5a177643f9b2b86ec5feb7b163, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=9aa303a60fec4ac5aaeb96c6618b387e) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:13:58.352616 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b7e7c-f82a-4d19-9867-d70c8f8aec72 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:13:58.354425 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b7e7c-f82a-4d19-9867-d70c8f8aec72 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:13:58.360530 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 571/1142] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:13:58 2021] GET /identity/v3/role_assignments?user.id=9aa303a60fec4ac5aaeb96c6618b387e&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=0811ae5a177643f9b2b86ec5feb7b163 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:00.680455 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa798649-0274-41ef-9b78-75ed9ec095de None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:00.681044 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa798649-0274-41ef-9b78-75ed9ec095de None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:00.681044 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa798649-0274-41ef-9b78-75ed9ec095de None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:00.682756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 572/1143] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:14:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:14:00.688891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a860feb-1029-41ac-a5b5-d94c6436b477 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:00.689382 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a860feb-1029-41ac-a5b5-d94c6436b477 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:00.689490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a860feb-1029-41ac-a5b5-d94c6436b477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:00.707127 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-4a860feb-1029-41ac-a5b5-d94c6436b477 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:14:00.708337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4a860feb-1029-41ac-a5b5-d94c6436b477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:14:00.716021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 572/1144] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:14:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:14:00.742833 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa798649-0274-41ef-9b78-75ed9ec095de None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:00.755241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa798649-0274-41ef-9b78-75ed9ec095de None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:00.764700 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd69c5-c90a-4a42-97d6-3a040e1061c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:00.765493 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd69c5-c90a-4a42-97d6-3a040e1061c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:00.765774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd69c5-c90a-4a42-97d6-3a040e1061c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:00.766044 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd69c5-c90a-4a42-97d6-3a040e1061c5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:00.777341 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd69c5-c90a-4a42-97d6-3a040e1061c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:14:00.784144 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-46bd69c5-c90a-4a42-97d6-3a040e1061c5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:14:00.785335 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 573/1145] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:14:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:00.792592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a860feb-1029-41ac-a5b5-d94c6436b477 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:00.801488 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a860feb-1029-41ac-a5b5-d94c6436b477 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:00.807293 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78600b6d-729f-4273-a848-f726b38b8ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:00.807992 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78600b6d-729f-4273-a848-f726b38b8ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:00.808301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78600b6d-729f-4273-a848-f726b38b8ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:00.808575 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78600b6d-729f-4273-a848-f726b38b8ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:00.809405 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78600b6d-729f-4273-a848-f726b38b8ef6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:00.809705 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78600b6d-729f-4273-a848-f726b38b8ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:00.811347 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78600b6d-729f-4273-a848-f726b38b8ef6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:00.820823 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 573/1146] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:14:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:00.828232 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd69c5-c90a-4a42-97d6-3a040e1061c5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:00.839419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd69c5-c90a-4a42-97d6-3a040e1061c5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:00.844103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5269b-58f5-4624-9e0b-90ba2682f50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:00.844920 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5269b-58f5-4624-9e0b-90ba2682f50c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:00.845161 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5269b-58f5-4624-9e0b-90ba2682f50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:00.845432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5269b-58f5-4624-9e0b-90ba2682f50c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:00.856394 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5269b-58f5-4624-9e0b-90ba2682f50c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:00.858203 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5269b-58f5-4624-9e0b-90ba2682f50c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:00.875090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-1dd5269b-58f5-4624-9e0b-90ba2682f50c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:14:00.876321 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 574/1147] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:14:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:00.883156 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78600b6d-729f-4273-a848-f726b38b8ef6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:00.892789 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78600b6d-729f-4273-a848-f726b38b8ef6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:00.898616 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d6e8d-95c7-46b0-838d-7ccbcffb0426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:00.899264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d6e8d-95c7-46b0-838d-7ccbcffb0426 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:00.899542 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d6e8d-95c7-46b0-838d-7ccbcffb0426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:00.899846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d6e8d-95c7-46b0-838d-7ccbcffb0426 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:00.900576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d6e8d-95c7-46b0-838d-7ccbcffb0426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:00.900876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d6e8d-95c7-46b0-838d-7ccbcffb0426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:00.902462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d6e8d-95c7-46b0-838d-7ccbcffb0426 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:00.914789 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 574/1148] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:14:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:14:00.921005 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5269b-58f5-4624-9e0b-90ba2682f50c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:00.931258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5269b-58f5-4624-9e0b-90ba2682f50c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:00.935851 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd8459-fcb5-46bb-b383-56e4eb74b0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:00.936628 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd8459-fcb5-46bb-b383-56e4eb74b0ea admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:00.939412 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd8459-fcb5-46bb-b383-56e4eb74b0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:00.939412 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd8459-fcb5-46bb-b383-56e4eb74b0ea admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:00.944847 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd8459-fcb5-46bb-b383-56e4eb74b0ea admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:00.946816 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd8459-fcb5-46bb-b383-56e4eb74b0ea admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:00.960942 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-94dd8459-fcb5-46bb-b383-56e4eb74b0ea admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 01:14:00.962064 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 575/1149] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:14:00 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:00.968418 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d6e8d-95c7-46b0-838d-7ccbcffb0426 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:00.978782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d6e8d-95c7-46b0-838d-7ccbcffb0426 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:00.983275 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842f82b-77c2-43a2-9549-49c8916e58bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:00.984047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842f82b-77c2-43a2-9549-49c8916e58bd admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:00.985241 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842f82b-77c2-43a2-9549-49c8916e58bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:00.985241 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842f82b-77c2-43a2-9549-49c8916e58bd admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:00.985523 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842f82b-77c2-43a2-9549-49c8916e58bd admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:00.985830 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842f82b-77c2-43a2-9549-49c8916e58bd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:00.987628 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842f82b-77c2-43a2-9549-49c8916e58bd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:01.005361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 575/1150] 10.222.0.87 () {56 vars in 1164 bytes} [Fri Oct 29 01:14:00 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:01.011644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd8459-fcb5-46bb-b383-56e4eb74b0ea admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:01.021436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd8459-fcb5-46bb-b383-56e4eb74b0ea admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:01.027344 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a146e-c028-44b0-8f3d-ed9d30c7427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:01.028133 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a146e-c028-44b0-8f3d-ed9d30c7427d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:01.028432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a146e-c028-44b0-8f3d-ed9d30c7427d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:01.028688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a146e-c028-44b0-8f3d-ed9d30c7427d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:01.036882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a146e-c028-44b0-8f3d-ed9d30c7427d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:01.041488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a146e-c028-44b0-8f3d-ed9d30c7427d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:01.048482 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 576/1151] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:14:01 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:14:01.055642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842f82b-77c2-43a2-9549-49c8916e58bd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:01.065611 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842f82b-77c2-43a2-9549-49c8916e58bd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:01.071479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3abb0-9e64-4050-a6f2-bde51c4fc03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:01.072291 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3abb0-9e64-4050-a6f2-bde51c4fc03f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:01.072564 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3abb0-9e64-4050-a6f2-bde51c4fc03f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:01.072826 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3abb0-9e64-4050-a6f2-bde51c4fc03f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:01.083406 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3abb0-9e64-4050-a6f2-bde51c4fc03f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:01.085484 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3abb0-9e64-4050-a6f2-bde51c4fc03f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:01.102088 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-32d3abb0-9e64-4050-a6f2-bde51c4fc03f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:14:01.103304 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 576/1152] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:14:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:01.109883 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a146e-c028-44b0-8f3d-ed9d30c7427d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:01.119614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a146e-c028-44b0-8f3d-ed9d30c7427d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:01.124317 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67456353-01e1-4a5a-90fb-d7b390289342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:01.124958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456353-01e1-4a5a-90fb-d7b390289342 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:01.125238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456353-01e1-4a5a-90fb-d7b390289342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:01.125534 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456353-01e1-4a5a-90fb-d7b390289342 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:01.126265 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67456353-01e1-4a5a-90fb-d7b390289342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:01.126568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67456353-01e1-4a5a-90fb-d7b390289342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:01.128156 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67456353-01e1-4a5a-90fb-d7b390289342 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:01.140138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 577/1153] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:14:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:01.146466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3abb0-9e64-4050-a6f2-bde51c4fc03f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:01.156340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3abb0-9e64-4050-a6f2-bde51c4fc03f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:01.160855 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fafa6f-1d17-491c-9b65-99105074184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:01.161621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fafa6f-1d17-491c-9b65-99105074184a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:01.161899 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fafa6f-1d17-491c-9b65-99105074184a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:01.162167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fafa6f-1d17-491c-9b65-99105074184a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:01.168992 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fafa6f-1d17-491c-9b65-99105074184a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:01.170969 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fafa6f-1d17-491c-9b65-99105074184a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:01.184424 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-59fafa6f-1d17-491c-9b65-99105074184a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:14:01.185541 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 577/1154] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:14:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:01.192124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67456353-01e1-4a5a-90fb-d7b390289342 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:01.202863 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67456353-01e1-4a5a-90fb-d7b390289342 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:01.207699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319bb07-a061-4647-8dc8-d9c4a4e8a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:01.208382 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319bb07-a061-4647-8dc8-d9c4a4e8a9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:01.208672 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319bb07-a061-4647-8dc8-d9c4a4e8a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:01.208927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319bb07-a061-4647-8dc8-d9c4a4e8a9c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:01.209878 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319bb07-a061-4647-8dc8-d9c4a4e8a9c6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:01.210331 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319bb07-a061-4647-8dc8-d9c4a4e8a9c6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:01.212333 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319bb07-a061-4647-8dc8-d9c4a4e8a9c6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:01.226316 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 578/1155] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:14:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:01.233136 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fafa6f-1d17-491c-9b65-99105074184a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:01.244773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fafa6f-1d17-491c-9b65-99105074184a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:01.249213 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c85993-21a0-447e-91db-e0a3c97f7b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:01.249840 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c85993-21a0-447e-91db-e0a3c97f7b9c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:01.250212 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c85993-21a0-447e-91db-e0a3c97f7b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:01.250471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c85993-21a0-447e-91db-e0a3c97f7b9c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:01.251292 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c85993-21a0-447e-91db-e0a3c97f7b9c admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=9aa303a60fec4ac5aaeb96c6618b387e) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:01.251596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c85993-21a0-447e-91db-e0a3c97f7b9c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:01.253442 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c85993-21a0-447e-91db-e0a3c97f7b9c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:01.258936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 578/1156] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:14:01 2021] GET /identity/v3/role_assignments?user.id=9aa303a60fec4ac5aaeb96c6618b387e&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:03.618579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9b296-c1de-4e41-b287-67106079b57d None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:03.619122 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9b296-c1de-4e41-b287-67106079b57d None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:03.619122 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9b296-c1de-4e41-b287-67106079b57d None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:03.620921 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 579/1157] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:14:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:14:03.626888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1046f2-4b35-4b29-8683-e002257a369c None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:03.627327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1046f2-4b35-4b29-8683-e002257a369c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:03.627419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1046f2-4b35-4b29-8683-e002257a369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:03.644746 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-dc1046f2-4b35-4b29-8683-e002257a369c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:14:03.645970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-dc1046f2-4b35-4b29-8683-e002257a369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:14:03.654137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 579/1158] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:14:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:14:03.677940 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9b296-c1de-4e41-b287-67106079b57d None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:03.690619 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9b296-c1de-4e41-b287-67106079b57d None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:03.695268 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70d447-1e9f-4d92-81bc-3a81700c053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:03.696070 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70d447-1e9f-4d92-81bc-3a81700c053b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:03.696346 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70d447-1e9f-4d92-81bc-3a81700c053b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:03.696611 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70d447-1e9f-4d92-81bc-3a81700c053b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:03.706407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70d447-1e9f-4d92-81bc-3a81700c053b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:14:03.713530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-9e70d447-1e9f-4d92-81bc-3a81700c053b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:14:03.714695 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 580/1159] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:14:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:03.721623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1046f2-4b35-4b29-8683-e002257a369c None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:03.731356 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1046f2-4b35-4b29-8683-e002257a369c None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:03.736031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d7393-436e-4581-bb51-f7be83800b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:03.736692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d7393-436e-4581-bb51-f7be83800b65 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:03.736968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d7393-436e-4581-bb51-f7be83800b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:03.737241 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d7393-436e-4581-bb51-f7be83800b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:03.737988 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d7393-436e-4581-bb51-f7be83800b65 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:03.738287 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d7393-436e-4581-bb51-f7be83800b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:03.739877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d7393-436e-4581-bb51-f7be83800b65 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:03.748932 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 580/1160] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:14:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:03.755418 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70d447-1e9f-4d92-81bc-3a81700c053b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:03.765800 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70d447-1e9f-4d92-81bc-3a81700c053b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:03.770352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2cbbc-3f11-4dfc-87fe-c547dfa10966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:03.771129 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2cbbc-3f11-4dfc-87fe-c547dfa10966 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:03.771408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2cbbc-3f11-4dfc-87fe-c547dfa10966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:03.771679 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2cbbc-3f11-4dfc-87fe-c547dfa10966 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:03.782784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2cbbc-3f11-4dfc-87fe-c547dfa10966 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:03.784625 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2cbbc-3f11-4dfc-87fe-c547dfa10966 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:03.801199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-15a2cbbc-3f11-4dfc-87fe-c547dfa10966 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:14:03.802357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 581/1161] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:14:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:03.809507 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d7393-436e-4581-bb51-f7be83800b65 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:03.819499 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d7393-436e-4581-bb51-f7be83800b65 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:03.824079 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdf195-996a-446a-adb7-1bf3493089f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:03.824715 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdf195-996a-446a-adb7-1bf3493089f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:03.824992 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdf195-996a-446a-adb7-1bf3493089f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:03.825261 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdf195-996a-446a-adb7-1bf3493089f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:03.825983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdf195-996a-446a-adb7-1bf3493089f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:03.826283 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdf195-996a-446a-adb7-1bf3493089f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:03.827866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdf195-996a-446a-adb7-1bf3493089f1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:03.839879 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 581/1162] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:14:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:03.846231 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2cbbc-3f11-4dfc-87fe-c547dfa10966 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:03.856642 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2cbbc-3f11-4dfc-87fe-c547dfa10966 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:03.861116 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d90d75-30d0-4368-8579-6cf77cf74556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:03.861880 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d90d75-30d0-4368-8579-6cf77cf74556 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:03.862154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d90d75-30d0-4368-8579-6cf77cf74556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:03.862452 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d90d75-30d0-4368-8579-6cf77cf74556 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:03.871165 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d90d75-30d0-4368-8579-6cf77cf74556 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:03.872846 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d90d75-30d0-4368-8579-6cf77cf74556 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:03.886622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-b8d90d75-30d0-4368-8579-6cf77cf74556 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 01:14:03.887986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 582/1163] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:14:03 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:03.894306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdf195-996a-446a-adb7-1bf3493089f1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:03.905078 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdf195-996a-446a-adb7-1bf3493089f1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:03.910822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e6d6d-2237-4450-8fb2-9b936ec64e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:03.911782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e6d6d-2237-4450-8fb2-9b936ec64e23 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:03.912107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e6d6d-2237-4450-8fb2-9b936ec64e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:03.912413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e6d6d-2237-4450-8fb2-9b936ec64e23 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:03.914006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e6d6d-2237-4450-8fb2-9b936ec64e23 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:03.916545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e6d6d-2237-4450-8fb2-9b936ec64e23 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:03.916545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e6d6d-2237-4450-8fb2-9b936ec64e23 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:03.933573 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 582/1164] 10.222.0.87 () {56 vars in 1164 bytes} [Fri Oct 29 01:14:03 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:03.940173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d90d75-30d0-4368-8579-6cf77cf74556 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:03.950100 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d90d75-30d0-4368-8579-6cf77cf74556 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:03.954642 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f91a11-2409-4cf5-a655-ca6c6513058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:03.955408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f91a11-2409-4cf5-a655-ca6c6513058e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:03.955687 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f91a11-2409-4cf5-a655-ca6c6513058e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:03.956052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f91a11-2409-4cf5-a655-ca6c6513058e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:03.967376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f91a11-2409-4cf5-a655-ca6c6513058e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:03.977062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f91a11-2409-4cf5-a655-ca6c6513058e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:03.986273 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-92f91a11-2409-4cf5-a655-ca6c6513058e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:14:03.987454 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 583/1165] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:14:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:03.993898 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e6d6d-2237-4450-8fb2-9b936ec64e23 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:04.003462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e6d6d-2237-4450-8fb2-9b936ec64e23 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:04.008716 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f211a-6d15-4597-a9ec-a1f9d3127494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:04.009362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f211a-6d15-4597-a9ec-a1f9d3127494 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:04.009639 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f211a-6d15-4597-a9ec-a1f9d3127494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:04.009906 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f211a-6d15-4597-a9ec-a1f9d3127494 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:04.010626 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f211a-6d15-4597-a9ec-a1f9d3127494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:04.010926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f211a-6d15-4597-a9ec-a1f9d3127494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:04.012525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f211a-6d15-4597-a9ec-a1f9d3127494 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:04.025046 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 583/1166] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:14:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:04.031347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f91a11-2409-4cf5-a655-ca6c6513058e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:04.041775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f91a11-2409-4cf5-a655-ca6c6513058e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:04.046458 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a0b96-7671-4746-8e51-17bfabd15d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:04.047252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a0b96-7671-4746-8e51-17bfabd15d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:04.047528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a0b96-7671-4746-8e51-17bfabd15d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:04.047835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a0b96-7671-4746-8e51-17bfabd15d9a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:04.055060 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a0b96-7671-4746-8e51-17bfabd15d9a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:04.057345 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a0b96-7671-4746-8e51-17bfabd15d9a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:04.071254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-aa6a0b96-7671-4746-8e51-17bfabd15d9a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:14:04.072460 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 584/1167] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:14:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:04.079066 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f211a-6d15-4597-a9ec-a1f9d3127494 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:04.089359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f211a-6d15-4597-a9ec-a1f9d3127494 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:04.093926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7969f-2871-4060-9fbf-0f851fbafcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:04.094574 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7969f-2871-4060-9fbf-0f851fbafcfd admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:04.094855 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7969f-2871-4060-9fbf-0f851fbafcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:04.095130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7969f-2871-4060-9fbf-0f851fbafcfd admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:04.095956 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7969f-2871-4060-9fbf-0f851fbafcfd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:04.096265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7969f-2871-4060-9fbf-0f851fbafcfd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:04.098095 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7969f-2871-4060-9fbf-0f851fbafcfd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:04.111233 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 584/1168] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:14:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:04.118239 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a0b96-7671-4746-8e51-17bfabd15d9a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:04.128023 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a0b96-7671-4746-8e51-17bfabd15d9a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:04.132631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813915-57de-4c92-9344-c57df19d01e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:04.133494 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813915-57de-4c92-9344-c57df19d01e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:04.133769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813915-57de-4c92-9344-c57df19d01e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:04.134035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813915-57de-4c92-9344-c57df19d01e6 admin admin] PATH_INFO: `/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/9aa303a60fec4ac5aaeb96c6618b387e/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:04.136061 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80813915-57de-4c92-9344-c57df19d01e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579ca0c9e3d480ab7b4f64d199c403b, user_id=9aa303a60fec4ac5aaeb96c6618b387e, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:04.138730 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80813915-57de-4c92-9344-c57df19d01e6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:04.212944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 585/1169] 10.222.0.87 () {58 vars in 1460 bytes} [Fri Oct 29 01:14:04 2021] PUT /identity/v3/projects/6579ca0c9e3d480ab7b4f64d199c403b/users/9aa303a60fec4ac5aaeb96c6618b387e/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:14:06.458391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a18dc9-0a95-4e83-bbb2-d94b11a73c69 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:06.458930 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a18dc9-0a95-4e83-bbb2-d94b11a73c69 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:06.458930 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a18dc9-0a95-4e83-bbb2-d94b11a73c69 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:06.460745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 585/1170] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:14:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:14:06.467208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e22da4-823c-4fe7-8542-49e0b05d9139 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:06.467666 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e22da4-823c-4fe7-8542-49e0b05d9139 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:06.467834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e22da4-823c-4fe7-8542-49e0b05d9139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:06.485570 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-a4e22da4-823c-4fe7-8542-49e0b05d9139 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:14:06.486739 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a4e22da4-823c-4fe7-8542-49e0b05d9139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:14:06.543620 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 586/1171] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:14:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:14:06.570042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a18dc9-0a95-4e83-bbb2-d94b11a73c69 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:06.582095 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a18dc9-0a95-4e83-bbb2-d94b11a73c69 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:06.587012 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56904a38-35ab-4afc-9394-9547365f873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:06.587834 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56904a38-35ab-4afc-9394-9547365f873b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:06.588186 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56904a38-35ab-4afc-9394-9547365f873b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:06.588449 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56904a38-35ab-4afc-9394-9547365f873b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:06.598433 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56904a38-35ab-4afc-9394-9547365f873b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 01:14:06.605255 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-56904a38-35ab-4afc-9394-9547365f873b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 01:14:06.606420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 586/1172] 10.222.0.87 () {56 vars in 1117 bytes} [Fri Oct 29 01:14:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:06.613261 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e22da4-823c-4fe7-8542-49e0b05d9139 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:06.622148 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e22da4-823c-4fe7-8542-49e0b05d9139 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:06.626823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b566ba0-0691-4c70-8315-a480a660e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:06.627471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b566ba0-0691-4c70-8315-a480a660e8cd admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:06.627775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b566ba0-0691-4c70-8315-a480a660e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:06.628048 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b566ba0-0691-4c70-8315-a480a660e8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:06.628805 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b566ba0-0691-4c70-8315-a480a660e8cd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:06.629107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b566ba0-0691-4c70-8315-a480a660e8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:06.630669 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b566ba0-0691-4c70-8315-a480a660e8cd admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:06.639387 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 587/1173] 10.222.0.87 () {56 vars in 1120 bytes} [Fri Oct 29 01:14:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:06.645839 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56904a38-35ab-4afc-9394-9547365f873b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:06.656435 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56904a38-35ab-4afc-9394-9547365f873b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:06.660885 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939fed1-d0a4-4a28-b568-aa49d3c7978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:06.661638 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939fed1-d0a4-4a28-b568-aa49d3c7978d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:06.661916 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939fed1-d0a4-4a28-b568-aa49d3c7978d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:06.662181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939fed1-d0a4-4a28-b568-aa49d3c7978d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:06.672625 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939fed1-d0a4-4a28-b568-aa49d3c7978d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:06.674422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939fed1-d0a4-4a28-b568-aa49d3c7978d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:06.690885 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-9939fed1-d0a4-4a28-b568-aa49d3c7978d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:14:06.692083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 587/1174] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:14:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:14:06.699333 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b566ba0-0691-4c70-8315-a480a660e8cd admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:06.711391 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b566ba0-0691-4c70-8315-a480a660e8cd admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:06.714727 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfbefb-7f10-46f5-86d6-f051858ab660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:06.715374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfbefb-7f10-46f5-86d6-f051858ab660 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:06.715654 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfbefb-7f10-46f5-86d6-f051858ab660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:06.715958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfbefb-7f10-46f5-86d6-f051858ab660 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:06.716690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfbefb-7f10-46f5-86d6-f051858ab660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:06.716994 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfbefb-7f10-46f5-86d6-f051858ab660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:06.718666 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfbefb-7f10-46f5-86d6-f051858ab660 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:06.730918 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 588/1175] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:14:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:14:06.737373 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939fed1-d0a4-4a28-b568-aa49d3c7978d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:06.747571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939fed1-d0a4-4a28-b568-aa49d3c7978d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:06.752145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee501d-1d78-4f65-9863-f2775df3641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:06.752945 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee501d-1d78-4f65-9863-f2775df3641a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:06.753227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee501d-1d78-4f65-9863-f2775df3641a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:06.753503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee501d-1d78-4f65-9863-f2775df3641a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:06.761681 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee501d-1d78-4f65-9863-f2775df3641a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:06.763682 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee501d-1d78-4f65-9863-f2775df3641a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:06.778253 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-10ee501d-1d78-4f65-9863-f2775df3641a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 01:14:06.779396 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 588/1176] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:14:06 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:06.785891 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfbefb-7f10-46f5-86d6-f051858ab660 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:06.795542 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfbefb-7f10-46f5-86d6-f051858ab660 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:06.801691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fbb9c-c418-4fa8-8f3c-21ea3d6c020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:06.801691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fbb9c-c418-4fa8-8f3c-21ea3d6c020d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:06.801691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fbb9c-c418-4fa8-8f3c-21ea3d6c020d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:06.801691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fbb9c-c418-4fa8-8f3c-21ea3d6c020d admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:06.802280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fbb9c-c418-4fa8-8f3c-21ea3d6c020d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:06.802586 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fbb9c-c418-4fa8-8f3c-21ea3d6c020d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:06.805109 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fbb9c-c418-4fa8-8f3c-21ea3d6c020d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:06.822873 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 589/1177] 10.222.0.87 () {56 vars in 1164 bytes} [Fri Oct 29 01:14:06 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:14:06.829304 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee501d-1d78-4f65-9863-f2775df3641a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:06.838851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee501d-1d78-4f65-9863-f2775df3641a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:06.843433 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174b641-0367-4708-b575-dac9d42711a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:06.846915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174b641-0367-4708-b575-dac9d42711a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:06.846915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174b641-0367-4708-b575-dac9d42711a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:06.846915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174b641-0367-4708-b575-dac9d42711a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:06.852255 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174b641-0367-4708-b575-dac9d42711a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:06.854000 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174b641-0367-4708-b575-dac9d42711a6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:06.862644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 589/1178] 10.222.0.87 () {58 vars in 1324 bytes} [Fri Oct 29 01:14:06 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:14:06.869885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fbb9c-c418-4fa8-8f3c-21ea3d6c020d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:06.879962 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fbb9c-c418-4fa8-8f3c-21ea3d6c020d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:06.885900 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562798a9-59c8-4da9-9744-c83850a6b380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:06.886681 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562798a9-59c8-4da9-9744-c83850a6b380 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:06.886962 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562798a9-59c8-4da9-9744-c83850a6b380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:06.887246 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562798a9-59c8-4da9-9744-c83850a6b380 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:06.898619 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562798a9-59c8-4da9-9744-c83850a6b380 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:06.900481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562798a9-59c8-4da9-9744-c83850a6b380 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:06.917394 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-562798a9-59c8-4da9-9744-c83850a6b380 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 01:14:06.918598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 590/1179] 10.222.0.87 () {56 vars in 1129 bytes} [Fri Oct 29 01:14:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:06.924896 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174b641-0367-4708-b575-dac9d42711a6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:06.934330 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174b641-0367-4708-b575-dac9d42711a6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:06.938830 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b96b68-0074-4479-b336-a6ae4d73f619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:06.939480 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b96b68-0074-4479-b336-a6ae4d73f619 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:06.939829 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b96b68-0074-4479-b336-a6ae4d73f619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:06.940099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b96b68-0074-4479-b336-a6ae4d73f619 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:06.940813 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b96b68-0074-4479-b336-a6ae4d73f619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:06.941112 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b96b68-0074-4479-b336-a6ae4d73f619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:06.942735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b96b68-0074-4479-b336-a6ae4d73f619 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:06.955601 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 590/1180] 10.222.0.87 () {56 vars in 1130 bytes} [Fri Oct 29 01:14:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:06.962721 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562798a9-59c8-4da9-9744-c83850a6b380 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:06.972298 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562798a9-59c8-4da9-9744-c83850a6b380 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:06.977339 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80e1a9-149f-420b-a131-d940395b3c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:06.978102 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80e1a9-149f-420b-a131-d940395b3c77 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:06.978384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80e1a9-149f-420b-a131-d940395b3c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:06.982090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80e1a9-149f-420b-a131-d940395b3c77 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:06.985399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80e1a9-149f-420b-a131-d940395b3c77 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:06.987307 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80e1a9-149f-420b-a131-d940395b3c77 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:07.000949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING keystone.server.flask.application [None req-5c80e1a9-149f-420b-a131-d940395b3c77 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 01:14:07.002101 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 591/1181] 10.222.0.87 () {56 vars in 1132 bytes} [Fri Oct 29 01:14:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:07.009209 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b96b68-0074-4479-b336-a6ae4d73f619 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:07.019061 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b96b68-0074-4479-b336-a6ae4d73f619 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:07.024157 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7109fb-e42b-4c90-87d8-8a1902617c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:07.024521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7109fb-e42b-4c90-87d8-8a1902617c25 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:07.024803 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7109fb-e42b-4c90-87d8-8a1902617c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:07.025078 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7109fb-e42b-4c90-87d8-8a1902617c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:07.025878 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7109fb-e42b-4c90-87d8-8a1902617c25 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:07.026185 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7109fb-e42b-4c90-87d8-8a1902617c25 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:07.028107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7109fb-e42b-4c90-87d8-8a1902617c25 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:07.040611 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 591/1182] 10.222.0.87 () {56 vars in 1169 bytes} [Fri Oct 29 01:14:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:07.047790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80e1a9-149f-420b-a131-d940395b3c77 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:07.059321 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80e1a9-149f-420b-a131-d940395b3c77 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:07.063951 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985329ff-e9d2-40e8-8674-5b6fcfb706a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:07.070351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985329ff-e9d2-40e8-8674-5b6fcfb706a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:07.070351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985329ff-e9d2-40e8-8674-5b6fcfb706a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:07.070351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985329ff-e9d2-40e8-8674-5b6fcfb706a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:07.070351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985329ff-e9d2-40e8-8674-5b6fcfb706a2 admin admin] RBAC: Adding query filter params (role.id=73614ed1e8e44534990dc6c04e8f9137, scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b, user.id=9aa303a60fec4ac5aaeb96c6618b387e) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:07.070351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985329ff-e9d2-40e8-8674-5b6fcfb706a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:07.070759 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985329ff-e9d2-40e8-8674-5b6fcfb706a2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:07.075315 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 592/1183] 10.222.0.87 () {56 vars in 1395 bytes} [Fri Oct 29 01:14:07 2021] GET /identity/v3/role_assignments?user.id=9aa303a60fec4ac5aaeb96c6618b387e&scope.project.id=6579ca0c9e3d480ab7b4f64d199c403b&role.id=73614ed1e8e44534990dc6c04e8f9137 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:09.462160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0190c2-a8b3-401a-ae6d-9b8e74893f50 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:09.462730 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0190c2-a8b3-401a-ae6d-9b8e74893f50 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:09.462730 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0190c2-a8b3-401a-ae6d-9b8e74893f50 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:09.464522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 592/1184] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:14:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:14:09.470582 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf219c-682b-4539-a1ff-134c28cd77b1 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:09.471019 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf219c-682b-4539-a1ff-134c28cd77b1 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:09.471129 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf219c-682b-4539-a1ff-134c28cd77b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:09.488434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-b8cf219c-682b-4539-a1ff-134c28cd77b1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:14:09.489607 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b8cf219c-682b-4539-a1ff-134c28cd77b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:14:09.497379 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 593/1185] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:14:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:14:09.520969 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0190c2-a8b3-401a-ae6d-9b8e74893f50 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:09.533587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0190c2-a8b3-401a-ae6d-9b8e74893f50 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:09.538168 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19eb579-d20f-4f18-9102-2ced2d7e7e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:09.538961 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eb579-d20f-4f18-9102-2ced2d7e7e43 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:09.539238 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eb579-d20f-4f18-9102-2ced2d7e7e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:09.539503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eb579-d20f-4f18-9102-2ced2d7e7e43 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:09.540201 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19eb579-d20f-4f18-9102-2ced2d7e7e43 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:09.541782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19eb579-d20f-4f18-9102-2ced2d7e7e43 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:09.552456 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-f19eb579-d20f-4f18-9102-2ced2d7e7e43 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 01:14:09.553587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 593/1186] 10.222.0.87 () {56 vars in 1138 bytes} [Fri Oct 29 01:14:09 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:09.560360 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf219c-682b-4539-a1ff-134c28cd77b1 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:09.570529 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf219c-682b-4539-a1ff-134c28cd77b1 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:09.575427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7ebcd-70e1-491b-a68e-56dea22041c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:09.576117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7ebcd-70e1-491b-a68e-56dea22041c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:09.576388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7ebcd-70e1-491b-a68e-56dea22041c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:09.576656 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7ebcd-70e1-491b-a68e-56dea22041c9 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:09.577362 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7ebcd-70e1-491b-a68e-56dea22041c9 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:09.577658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7ebcd-70e1-491b-a68e-56dea22041c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:09.579209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7ebcd-70e1-491b-a68e-56dea22041c9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:09.584027 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 594/1187] 10.222.0.87 () {56 vars in 1137 bytes} [Fri Oct 29 01:14:09 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:09.592362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19eb579-d20f-4f18-9102-2ced2d7e7e43 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:09.602224 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19eb579-d20f-4f18-9102-2ced2d7e7e43 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:09.606770 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3e501-c6d3-47c7-918c-b46a689c13b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:09.607411 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3e501-c6d3-47c7-918c-b46a689c13b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:09.607689 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3e501-c6d3-47c7-918c-b46a689c13b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:09.610542 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3e501-c6d3-47c7-918c-b46a689c13b9 admin admin] PATH_INFO: `/v3/services` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:09.610542 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3e501-c6d3-47c7-918c-b46a689c13b9 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:09.610542 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3e501-c6d3-47c7-918c-b46a689c13b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:09.610542 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3e501-c6d3-47c7-918c-b46a689c13b9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:09.614934 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 594/1188] 10.222.0.87 () {56 vars in 1137 bytes} [Fri Oct 29 01:14:09 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:11.865092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56866-cc3e-4265-adcf-206aba2ef2c9 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:11.865762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56866-cc3e-4265-adcf-206aba2ef2c9 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:11.865762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56866-cc3e-4265-adcf-206aba2ef2c9 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:11.869265 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 595/1189] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:14:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:14:11.875639 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbb879-5590-4c6d-8a14-4f4d2bd5b526 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:11.876128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbb879-5590-4c6d-8a14-4f4d2bd5b526 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:11.876219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbb879-5590-4c6d-8a14-4f4d2bd5b526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:11.894052 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-a2bbb879-5590-4c6d-8a14-4f4d2bd5b526 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:14:11.901372 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a2bbb879-5590-4c6d-8a14-4f4d2bd5b526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:14:11.903551 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 595/1190] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:14:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:14:11.927227 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a56866-cc3e-4265-adcf-206aba2ef2c9 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:11.939396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a56866-cc3e-4265-adcf-206aba2ef2c9 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:11.944400 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960a94b-eba9-4a45-902d-4226c173849d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:11.945076 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a94b-eba9-4a45-902d-4226c173849d admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:11.945358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a94b-eba9-4a45-902d-4226c173849d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:11.945630 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a94b-eba9-4a45-902d-4226c173849d admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:11.946368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960a94b-eba9-4a45-902d-4226c173849d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:11.948024 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960a94b-eba9-4a45-902d-4226c173849d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:12.041105 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 596/1191] 10.222.0.87 () {60 vars in 1162 bytes} [Fri Oct 29 01:14:11 2021] POST /identity/v3/services => generated 246 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:14:14.431067 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1f7a-c565-4e82-b84e-d26632f45b9a None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:14.431615 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1f7a-c565-4e82-b84e-d26632f45b9a None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:14.431707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1f7a-c565-4e82-b84e-d26632f45b9a None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:14.435173 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 596/1192] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:14:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:14:14.440674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f6c0-0de4-4655-8a5e-35b965134f4a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:14.441213 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f6c0-0de4-4655-8a5e-35b965134f4a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:14.441213 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f6c0-0de4-4655-8a5e-35b965134f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:14.461677 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-68f7f6c0-0de4-4655-8a5e-35b965134f4a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:14:14.463066 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-68f7f6c0-0de4-4655-8a5e-35b965134f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:14:14.491704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 597/1193] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:14:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:14:14.516431 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1f7a-c565-4e82-b84e-d26632f45b9a None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:14.529967 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1f7a-c565-4e82-b84e-d26632f45b9a None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:14.539761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba742db-e5f6-4c78-8a67-90410b571968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:14.539761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba742db-e5f6-4c78-8a67-90410b571968 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:14.539761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba742db-e5f6-4c78-8a67-90410b571968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:14.539761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba742db-e5f6-4c78-8a67-90410b571968 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:14.540200 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba742db-e5f6-4c78-8a67-90410b571968 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:14.540563 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba742db-e5f6-4c78-8a67-90410b571968 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:14.552428 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-bba742db-e5f6-4c78-8a67-90410b571968 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 01:14:14.553691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 597/1194] 10.222.0.87 () {56 vars in 1138 bytes} [Fri Oct 29 01:14:14 2021] GET /identity/v3/services/placement => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 01:14:14.560625 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7f6c0-0de4-4655-8a5e-35b965134f4a None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:14.571415 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7f6c0-0de4-4655-8a5e-35b965134f4a None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:14.577048 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25df47-515c-437d-b2c3-f6348db0126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:14.577763 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25df47-515c-437d-b2c3-f6348db0126e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:14.578048 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25df47-515c-437d-b2c3-f6348db0126e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:14.578316 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25df47-515c-437d-b2c3-f6348db0126e admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:14.579030 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25df47-515c-437d-b2c3-f6348db0126e admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:14.579330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25df47-515c-437d-b2c3-f6348db0126e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:14.582209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25df47-515c-437d-b2c3-f6348db0126e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:14.589051 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 598/1195] 10.222.0.87 () {56 vars in 1137 bytes} [Fri Oct 29 01:14:14 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:14.595679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba742db-e5f6-4c78-8a67-90410b571968 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:14.608793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba742db-e5f6-4c78-8a67-90410b571968 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:14.613738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a517f-d9cc-4655-a570-9129c7140fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:14.614392 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a517f-d9cc-4655-a570-9129c7140fba admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:14.614752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a517f-d9cc-4655-a570-9129c7140fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:14.614985 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a517f-d9cc-4655-a570-9129c7140fba admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:14.615929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a517f-d9cc-4655-a570-9129c7140fba admin admin] RBAC: Adding query filter params (interface=public, service_id=0250a7578c6044688819362b57ff0a91, region_id=RegionOne) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:14.616257 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a517f-d9cc-4655-a570-9129c7140fba admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:14.617949 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a517f-d9cc-4655-a570-9129c7140fba admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:14.623625 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 598/1196] 10.222.0.87 () {56 vars in 1272 bytes} [Fri Oct 29 01:14:14 2021] GET /identity/v3/endpoints?service_id=0250a7578c6044688819362b57ff0a91&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:14.630043 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25df47-515c-437d-b2c3-f6348db0126e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:14.640527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25df47-515c-437d-b2c3-f6348db0126e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:14.645361 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae80dae-c219-41e5-9aef-2914f4b2bcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:14.646024 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae80dae-c219-41e5-9aef-2914f4b2bcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:14.646304 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae80dae-c219-41e5-9aef-2914f4b2bcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:14.646575 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae80dae-c219-41e5-9aef-2914f4b2bcf1 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:14.647845 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae80dae-c219-41e5-9aef-2914f4b2bcf1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:14.649420 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae80dae-c219-41e5-9aef-2914f4b2bcf1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:14.656697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 599/1197] 10.222.0.87 () {56 vars in 1108 bytes} [Fri Oct 29 01:14:14 2021] GET /identity/v3/services => generated 2191 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:14:16.908836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a587e3c-8eb0-43e9-845f-dea6af89b8c4 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:16.909358 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a587e3c-8eb0-43e9-845f-dea6af89b8c4 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:16.909451 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a587e3c-8eb0-43e9-845f-dea6af89b8c4 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:16.911145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 599/1198] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:14:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:14:16.917122 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be575f-541b-40de-b72a-695e099116f3 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:16.917553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be575f-541b-40de-b72a-695e099116f3 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:16.917665 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be575f-541b-40de-b72a-695e099116f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:16.936546 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-99be575f-541b-40de-b72a-695e099116f3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:14:16.937725 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-99be575f-541b-40de-b72a-695e099116f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:14:16.946093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 600/1199] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:14:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:14:16.969806 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a587e3c-8eb0-43e9-845f-dea6af89b8c4 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:16.982511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a587e3c-8eb0-43e9-845f-dea6af89b8c4 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:16.986950 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40c1d1-e9fc-4813-9de0-2a33ea7b4daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:16.987739 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40c1d1-e9fc-4813-9de0-2a33ea7b4daf admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:16.988032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40c1d1-e9fc-4813-9de0-2a33ea7b4daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:16.988302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40c1d1-e9fc-4813-9de0-2a33ea7b4daf admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:16.988961 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40c1d1-e9fc-4813-9de0-2a33ea7b4daf admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:16.990523 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40c1d1-e9fc-4813-9de0-2a33ea7b4daf admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:17.001990 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING keystone.server.flask.application [None req-8a40c1d1-e9fc-4813-9de0-2a33ea7b4daf admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 01:14:17.003116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 600/1200] 10.222.0.87 () {56 vars in 1138 bytes} [Fri Oct 29 01:14:16 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 01:14:17.009725 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be575f-541b-40de-b72a-695e099116f3 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:17.018598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be575f-541b-40de-b72a-695e099116f3 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:17.023217 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06ab2d-0bcf-4c35-bd05-4d87b7999d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:17.023896 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06ab2d-0bcf-4c35-bd05-4d87b7999d96 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:17.024175 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06ab2d-0bcf-4c35-bd05-4d87b7999d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:17.024598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06ab2d-0bcf-4c35-bd05-4d87b7999d96 admin admin] PATH_INFO: `/v3/services` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:17.026249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06ab2d-0bcf-4c35-bd05-4d87b7999d96 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:14:17.026249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06ab2d-0bcf-4c35-bd05-4d87b7999d96 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:17.026985 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06ab2d-0bcf-4c35-bd05-4d87b7999d96 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:17.032019 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 601/1201] 10.222.0.87 () {56 vars in 1137 bytes} [Fri Oct 29 01:14:17 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:14:17.038821 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40c1d1-e9fc-4813-9de0-2a33ea7b4daf admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:14:17.048785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40c1d1-e9fc-4813-9de0-2a33ea7b4daf admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:14:17.053427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04d568-49e3-4990-9baa-2cac4b88c905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:14:17.054055 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04d568-49e3-4990-9baa-2cac4b88c905 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:14:17.054341 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04d568-49e3-4990-9baa-2cac4b88c905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:14:17.054613 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04d568-49e3-4990-9baa-2cac4b88c905 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:14:17.055883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04d568-49e3-4990-9baa-2cac4b88c905 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:14:17.057449 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04d568-49e3-4990-9baa-2cac4b88c905 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:14:17.144057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 601/1202] 10.222.0.87 () {60 vars in 1165 bytes} [Fri Oct 29 01:14:17 2021] POST /identity/v3/endpoints => generated 331 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:20:30.787068 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190783c-271f-4d6c-92c1-2e8d3b676993 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:30.787638 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190783c-271f-4d6c-92c1-2e8d3b676993 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:30.787638 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190783c-271f-4d6c-92c1-2e8d3b676993 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:30.790434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 602/1203] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:20:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:20:30.796613 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3ca80-b90d-46a1-8b00-2623cc29ea2f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:30.797619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3ca80-b90d-46a1-8b00-2623cc29ea2f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:30.798109 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3ca80-b90d-46a1-8b00-2623cc29ea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:30.965873 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-67b3ca80-b90d-46a1-8b00-2623cc29ea2f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:20:30.998314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-67b3ca80-b90d-46a1-8b00-2623cc29ea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:31.184771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 602/1204] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:20:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:20:31.210297 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190783c-271f-4d6c-92c1-2e8d3b676993 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:20:31.212276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-0190783c-271f-4d6c-92c1-2e8d3b676993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:31.388462 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190783c-271f-4d6c-92c1-2e8d3b676993 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:20:31.506826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c8744-fbce-4ab6-8341-2935f500ef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:20:31.507841 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c8744-fbce-4ab6-8341-2935f500ef1a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:31.509727 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c8744-fbce-4ab6-8341-2935f500ef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:31.510210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c8744-fbce-4ab6-8341-2935f500ef1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:31.511185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c8744-fbce-4ab6-8341-2935f500ef1a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:20:31.513720 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c8744-fbce-4ab6-8341-2935f500ef1a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:20:31.537019 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 603/1205] 10.222.0.87 () {56 vars in 1108 bytes} [Fri Oct 29 01:20:31 2021] GET /identity/v3/projects => generated 2553 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:20:33.925266 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12b6de-8c1f-4a17-9c93-275eed72164d None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:33.925788 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12b6de-8c1f-4a17-9c93-275eed72164d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:33.925788 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12b6de-8c1f-4a17-9c93-275eed72164d None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:33.927598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 603/1206] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:20:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:20:33.933585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf595e4-f6a8-4512-8d76-12057b92dfb4 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:33.934010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf595e4-f6a8-4512-8d76-12057b92dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:33.934125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf595e4-f6a8-4512-8d76-12057b92dfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:34.012520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-5cf595e4-f6a8-4512-8d76-12057b92dfb4 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:20:34.013717 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-5cf595e4-f6a8-4512-8d76-12057b92dfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:34.106363 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 604/1207] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:20:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:20:34.163692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b326f7-6e36-4f3c-a0e5-baa97f1630fc None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:34.164007 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b326f7-6e36-4f3c-a0e5-baa97f1630fc None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:34.164442 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b326f7-6e36-4f3c-a0e5-baa97f1630fc None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:34.166342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 604/1208] 10.222.0.87 () {54 vars in 964 bytes} [Fri Oct 29 01:20:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:20:34.172758 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c80097-46e8-4457-9b7e-60810c334b5a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:34.173042 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c80097-46e8-4457-9b7e-60810c334b5a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:34.173315 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c80097-46e8-4457-9b7e-60810c334b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:34.245446 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-a2c80097-46e8-4457-9b7e-60810c334b5a None None] MFA Rules not processed for user `48b92ce8a3bd4d1ebfd94249d525addb`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:20:34.246651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a2c80097-46e8-4457-9b7e-60810c334b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:34.319358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 605/1209] 10.222.0.87 () {58 vars in 1061 bytes} [Fri Oct 29 01:20:34 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:20:34.330738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b326f7-6e36-4f3c-a0e5-baa97f1630fc None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:20:34.332276 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-f9b326f7-6e36-4f3c-a0e5-baa97f1630fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:34.433501 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b326f7-6e36-4f3c-a0e5-baa97f1630fc None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:20:34.504028 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281913d-1ba6-4c46-b15b-a0b8123f07b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:20:34.504674 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281913d-1ba6-4c46-b15b-a0b8123f07b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:34.504950 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281913d-1ba6-4c46-b15b-a0b8123f07b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:34.505220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281913d-1ba6-4c46-b15b-a0b8123f07b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:34.506832 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7281913d-1ba6-4c46-b15b-a0b8123f07b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:34.611064 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281913d-1ba6-4c46-b15b-a0b8123f07b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:20:34.612526 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281913d-1ba6-4c46-b15b-a0b8123f07b9 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:20:34.630380 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 605/1210] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:20:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:20:37.165848 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236be3c1-1d42-4e29-8e83-73e396dffd5e None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:37.166407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236be3c1-1d42-4e29-8e83-73e396dffd5e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:37.166407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236be3c1-1d42-4e29-8e83-73e396dffd5e None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:37.168116 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 606/1211] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:20:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:20:37.174096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8fd29-2ca9-485d-9760-2579ea2b526b None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:37.174559 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8fd29-2ca9-485d-9760-2579ea2b526b None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:37.174666 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8fd29-2ca9-485d-9760-2579ea2b526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:37.240126 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-a8a8fd29-2ca9-485d-9760-2579ea2b526b None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:20:37.241378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a8a8fd29-2ca9-485d-9760-2579ea2b526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:37.344238 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 606/1212] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:20:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:20:37.385863 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236be3c1-1d42-4e29-8e83-73e396dffd5e None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:20:37.387361 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-236be3c1-1d42-4e29-8e83-73e396dffd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:37.489163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236be3c1-1d42-4e29-8e83-73e396dffd5e None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:20:37.563333 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b62dc-6a4e-436a-a3e2-c8f4f38546e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:20:37.564006 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b62dc-6a4e-436a-a3e2-c8f4f38546e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:37.564290 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b62dc-6a4e-436a-a3e2-c8f4f38546e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:37.564564 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b62dc-6a4e-436a-a3e2-c8f4f38546e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:37.566210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e93b62dc-6a4e-436a-a3e2-c8f4f38546e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:37.672803 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b62dc-6a4e-436a-a3e2-c8f4f38546e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:20:37.674208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b62dc-6a4e-436a-a3e2-c8f4f38546e0 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:20:37.692176 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 607/1213] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:20:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:20:40.559033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8260-544d-4a75-b036-7951a366fcac None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:40.559611 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8260-544d-4a75-b036-7951a366fcac None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:40.559611 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8260-544d-4a75-b036-7951a366fcac None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:40.561390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 607/1214] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:20:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:20:40.567246 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10238e6e-759f-4474-a349-e5d175d19c2d None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:40.567682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10238e6e-759f-4474-a349-e5d175d19c2d None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:40.567816 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10238e6e-759f-4474-a349-e5d175d19c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:40.634213 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-10238e6e-759f-4474-a349-e5d175d19c2d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:20:40.635444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-10238e6e-759f-4474-a349-e5d175d19c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:40.728262 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 608/1215] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:20:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:20:40.764779 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de8260-544d-4a75-b036-7951a366fcac None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:20:40.766301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-72de8260-544d-4a75-b036-7951a366fcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:40.886313 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de8260-544d-4a75-b036-7951a366fcac None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:20:40.974750 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2add3-500e-41de-b211-d8921bcc8bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:20:40.975598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2add3-500e-41de-b211-d8921bcc8bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:40.975912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2add3-500e-41de-b211-d8921bcc8bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:40.976184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2add3-500e-41de-b211-d8921bcc8bfa admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:40.985759 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2add3-500e-41de-b211-d8921bcc8bfa admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:20:40.987847 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2add3-500e-41de-b211-d8921bcc8bfa admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:20:40.989556 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 608/1216] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:20:40 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:20:41.016581 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a742-d923-4719-9422-340b7a435049 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:41.016866 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a742-d923-4719-9422-340b7a435049 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:41.017139 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a742-d923-4719-9422-340b7a435049 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:41.018982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 609/1217] 10.222.0.87 () {54 vars in 964 bytes} [Fri Oct 29 01:20:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 01:20:41.025208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa810d2-bb00-49b4-9524-eebf63d5817c None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:41.025494 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa810d2-bb00-49b4-9524-eebf63d5817c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:41.025770 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa810d2-bb00-49b4-9524-eebf63d5817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:41.099656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-7aa810d2-bb00-49b4-9524-eebf63d5817c None None] MFA Rules not processed for user `48b92ce8a3bd4d1ebfd94249d525addb`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:20:41.100889 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7aa810d2-bb00-49b4-9524-eebf63d5817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:41.175819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 609/1218] 10.222.0.87 () {58 vars in 1061 bytes} [Fri Oct 29 01:20:41 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:20:41.185651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6a742-d923-4719-9422-340b7a435049 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:20:41.187211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8ac6a742-d923-4719-9422-340b7a435049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:41.286665 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6a742-d923-4719-9422-340b7a435049 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:20:41.357488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62639fac-86af-4ead-ab94-cf488bd3a34e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:20:41.358128 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62639fac-86af-4ead-ab94-cf488bd3a34e service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:41.358405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62639fac-86af-4ead-ab94-cf488bd3a34e service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:41.358683 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62639fac-86af-4ead-ab94-cf488bd3a34e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:41.360313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-62639fac-86af-4ead-ab94-cf488bd3a34e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:41.463458 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62639fac-86af-4ead-ab94-cf488bd3a34e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:20:41.464842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62639fac-86af-4ead-ab94-cf488bd3a34e service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:20:41.482071 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 610/1219] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:20:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:20:45.094635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd1e2e-a15c-48a8-9f16-ac10b6cff76b None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:45.095171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd1e2e-a15c-48a8-9f16-ac10b6cff76b None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:45.095171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd1e2e-a15c-48a8-9f16-ac10b6cff76b None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:45.097032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 610/1220] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:20:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:20:45.104007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb7bfb-3657-41f2-a642-88b50bf21d22 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:45.104448 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb7bfb-3657-41f2-a642-88b50bf21d22 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:45.104563 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb7bfb-3657-41f2-a642-88b50bf21d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:45.168877 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-52fb7bfb-3657-41f2-a642-88b50bf21d22 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:20:45.170014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-52fb7bfb-3657-41f2-a642-88b50bf21d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:45.265136 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 611/1221] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:20:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:20:45.301629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd1e2e-a15c-48a8-9f16-ac10b6cff76b None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:20:45.303245 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-cedd1e2e-a15c-48a8-9f16-ac10b6cff76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:45.430627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd1e2e-a15c-48a8-9f16-ac10b6cff76b None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:20:45.521181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5a05e-4e12-4d90-83fc-c07062525309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:20:45.522032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5a05e-4e12-4d90-83fc-c07062525309 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:45.522311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5a05e-4e12-4d90-83fc-c07062525309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:45.522587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5a05e-4e12-4d90-83fc-c07062525309 admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:45.533039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5a05e-4e12-4d90-83fc-c07062525309 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:20:45.535151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5a05e-4e12-4d90-83fc-c07062525309 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:20:45.537015 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 611/1222] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:20:45 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:20:45.549940 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb7bfb-3657-41f2-a642-88b50bf21d22 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:20:45.551194 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-52fb7bfb-3657-41f2-a642-88b50bf21d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:45.638984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb7bfb-3657-41f2-a642-88b50bf21d22 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:20:45.709424 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1cb99-408f-4ac2-9649-c2d87e1d6b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:20:45.709986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1cb99-408f-4ac2-9649-c2d87e1d6b70 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:45.710262 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1cb99-408f-4ac2-9649-c2d87e1d6b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:45.710553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1cb99-408f-4ac2-9649-c2d87e1d6b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:45.712396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c6b1cb99-408f-4ac2-9649-c2d87e1d6b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:45.817091 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1cb99-408f-4ac2-9649-c2d87e1d6b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:20:45.818510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1cb99-408f-4ac2-9649-c2d87e1d6b70 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:20:45.838367 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 612/1223] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:20:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:20:49.124773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4c018-fa46-4d4f-9d78-9727d31c4cc4 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:49.125286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4c018-fa46-4d4f-9d78-9727d31c4cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:49.125286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4c018-fa46-4d4f-9d78-9727d31c4cc4 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:49.127234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 612/1224] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:20:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:20:49.134762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767878-28e5-46fe-8769-f1eeb80420c0 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:49.135347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767878-28e5-46fe-8769-f1eeb80420c0 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:49.135347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767878-28e5-46fe-8769-f1eeb80420c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:49.211293 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-77767878-28e5-46fe-8769-f1eeb80420c0 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:20:49.212566 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-77767878-28e5-46fe-8769-f1eeb80420c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:49.319341 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 613/1225] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:20:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:20:49.358110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4c018-fa46-4d4f-9d78-9727d31c4cc4 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:20:49.359690 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-fbf4c018-fa46-4d4f-9d78-9727d31c4cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:49.473839 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4c018-fa46-4d4f-9d78-9727d31c4cc4 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:20:49.553539 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3259ef5-b602-47f9-aec0-9de2c96e6003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:20:49.554119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3259ef5-b602-47f9-aec0-9de2c96e6003 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:49.554555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3259ef5-b602-47f9-aec0-9de2c96e6003 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:49.555046 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3259ef5-b602-47f9-aec0-9de2c96e6003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:49.556865 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d3259ef5-b602-47f9-aec0-9de2c96e6003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:49.671855 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3259ef5-b602-47f9-aec0-9de2c96e6003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:20:49.673295 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3259ef5-b602-47f9-aec0-9de2c96e6003 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:20:49.694326 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 613/1226] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:20:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:20:52.115603 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86779b2a-6131-4dea-b06e-ddf243e9a281 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:52.116179 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86779b2a-6131-4dea-b06e-ddf243e9a281 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:52.116179 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86779b2a-6131-4dea-b06e-ddf243e9a281 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:52.117938 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 614/1227] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:20:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:20:52.124229 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed390b-c3b7-4b1f-8ead-eebd43594361 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:52.124691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed390b-c3b7-4b1f-8ead-eebd43594361 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:52.124916 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed390b-c3b7-4b1f-8ead-eebd43594361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:52.196118 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d1ed390b-c3b7-4b1f-8ead-eebd43594361 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:20:52.197409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d1ed390b-c3b7-4b1f-8ead-eebd43594361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:52.294089 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 614/1228] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:20:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:20:52.333596 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86779b2a-6131-4dea-b06e-ddf243e9a281 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:20:52.337105 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-86779b2a-6131-4dea-b06e-ddf243e9a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:52.437325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86779b2a-6131-4dea-b06e-ddf243e9a281 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:20:52.509512 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6ee5f-1527-4cfb-bfdf-b23e9d571961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:20:52.510170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6ee5f-1527-4cfb-bfdf-b23e9d571961 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:52.510444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6ee5f-1527-4cfb-bfdf-b23e9d571961 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:52.510793 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6ee5f-1527-4cfb-bfdf-b23e9d571961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:52.512644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-f5d6ee5f-1527-4cfb-bfdf-b23e9d571961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:52.626464 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6ee5f-1527-4cfb-bfdf-b23e9d571961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:20:52.627919 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6ee5f-1527-4cfb-bfdf-b23e9d571961 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:20:52.645450 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 615/1229] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:20:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:20:55.038080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91937202-77ec-4ecd-937f-e6306b87ccb4 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:55.038732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91937202-77ec-4ecd-937f-e6306b87ccb4 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:55.038732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91937202-77ec-4ecd-937f-e6306b87ccb4 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:55.040568 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 615/1230] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:20:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:20:55.046725 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b55518-dcec-4059-95ca-5d006d773467 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:55.047197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b55518-dcec-4059-95ca-5d006d773467 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:55.047297 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b55518-dcec-4059-95ca-5d006d773467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:55.118407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-e4b55518-dcec-4059-95ca-5d006d773467 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:20:55.119620 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e4b55518-dcec-4059-95ca-5d006d773467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:55.214303 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 616/1231] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:20:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:20:55.248233 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91937202-77ec-4ecd-937f-e6306b87ccb4 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:20:55.249846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-91937202-77ec-4ecd-937f-e6306b87ccb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:55.375193 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91937202-77ec-4ecd-937f-e6306b87ccb4 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:20:55.471588 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b97db-7c6c-45fd-b367-2510659c1341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:20:55.472420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b97db-7c6c-45fd-b367-2510659c1341 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:55.472699 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b97db-7c6c-45fd-b367-2510659c1341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:55.472970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b97db-7c6c-45fd-b367-2510659c1341 admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:55.483902 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b97db-7c6c-45fd-b367-2510659c1341 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:20:55.485982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b97db-7c6c-45fd-b367-2510659c1341 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:20:55.487811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 616/1232] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:20:55 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:20:55.501682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b55518-dcec-4059-95ca-5d006d773467 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:20:55.502901 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e4b55518-dcec-4059-95ca-5d006d773467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:55.597764 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b55518-dcec-4059-95ca-5d006d773467 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:20:55.669923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7367ae0-e18e-41cf-b762-d6c6a2e1eaa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:20:55.670563 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7367ae0-e18e-41cf-b762-d6c6a2e1eaa8 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:55.670837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7367ae0-e18e-41cf-b762-d6c6a2e1eaa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:55.671107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7367ae0-e18e-41cf-b762-d6c6a2e1eaa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:55.672737 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b7367ae0-e18e-41cf-b762-d6c6a2e1eaa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:55.780077 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7367ae0-e18e-41cf-b762-d6c6a2e1eaa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:20:55.781733 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7367ae0-e18e-41cf-b762-d6c6a2e1eaa8 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:20:55.799583 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 617/1233] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:20:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:20:58.609643 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd783187-5645-4e4b-803e-15b60fc19ed7 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:58.610157 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd783187-5645-4e4b-803e-15b60fc19ed7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:58.610157 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd783187-5645-4e4b-803e-15b60fc19ed7 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:58.612039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 617/1234] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:20:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:20:58.618975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e376fa-3048-4c7b-9c3b-da9036882ce6 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:58.619489 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e376fa-3048-4c7b-9c3b-da9036882ce6 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:58.619585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e376fa-3048-4c7b-9c3b-da9036882ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:58.692643 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-64e376fa-3048-4c7b-9c3b-da9036882ce6 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:20:58.693855 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-64e376fa-3048-4c7b-9c3b-da9036882ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:58.798885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 618/1235] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:20:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:20:58.836732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd783187-5645-4e4b-803e-15b60fc19ed7 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:20:58.838254 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-bd783187-5645-4e4b-803e-15b60fc19ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:58.948328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd783187-5645-4e4b-803e-15b60fc19ed7 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:20:59.031937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66657c8-5605-416f-8553-01d1576cff4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:20:59.032982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66657c8-5605-416f-8553-01d1576cff4b service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:20:59.033450 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66657c8-5605-416f-8553-01d1576cff4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:20:59.033914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66657c8-5605-416f-8553-01d1576cff4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:20:59.036866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e66657c8-5605-416f-8553-01d1576cff4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:20:59.155664 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66657c8-5605-416f-8553-01d1576cff4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:20:59.157134 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66657c8-5605-416f-8553-01d1576cff4b service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:20:59.180760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 618/1236] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:20:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:01.529867 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629bd7-16db-497d-9d43-297b55c065a2 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:01.530378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629bd7-16db-497d-9d43-297b55c065a2 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:01.530378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629bd7-16db-497d-9d43-297b55c065a2 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:01.532180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 619/1237] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:01.538313 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a813d-0c1e-47c8-80a2-9143e45d78eb None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:01.538790 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a813d-0c1e-47c8-80a2-9143e45d78eb None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:01.539073 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a813d-0c1e-47c8-80a2-9143e45d78eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:01.609544 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-056a813d-0c1e-47c8-80a2-9143e45d78eb None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:01.610744 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-056a813d-0c1e-47c8-80a2-9143e45d78eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:01.714276 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 619/1238] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:01.755966 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629bd7-16db-497d-9d43-297b55c065a2 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:01.758356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-11629bd7-16db-497d-9d43-297b55c065a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:01.854320 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629bd7-16db-497d-9d43-297b55c065a2 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:01.858207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c010b9b-9c23-4bef-b12e-09a1bb7f096b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:01.858853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c010b9b-9c23-4bef-b12e-09a1bb7f096b service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:01.859144 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c010b9b-9c23-4bef-b12e-09a1bb7f096b service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:01.859418 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c010b9b-9c23-4bef-b12e-09a1bb7f096b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:01.869428 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c010b9b-9c23-4bef-b12e-09a1bb7f096b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:01.870854 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c010b9b-9c23-4bef-b12e-09a1bb7f096b service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:01.880340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 620/1239] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:04.738926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19551f1d-6502-4a55-be06-093277107f3e None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:04.739504 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19551f1d-6502-4a55-be06-093277107f3e None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:04.739504 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19551f1d-6502-4a55-be06-093277107f3e None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:04.742014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 620/1240] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:04.748079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9132c8-9697-44bb-9852-5da55f5e123a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:04.748497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9132c8-9697-44bb-9852-5da55f5e123a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:04.748626 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9132c8-9697-44bb-9852-5da55f5e123a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:04.765592 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-1f9132c8-9697-44bb-9852-5da55f5e123a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:04.766777 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-1f9132c8-9697-44bb-9852-5da55f5e123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:04.774567 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 621/1241] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:04.812300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19551f1d-6502-4a55-be06-093277107f3e None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:04.822635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19551f1d-6502-4a55-be06-093277107f3e None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:04.826384 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111f271-b066-4961-9f03-7fde45fbc285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:04.827008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f271-b066-4961-9f03-7fde45fbc285 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:04.827282 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f271-b066-4961-9f03-7fde45fbc285 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:04.827550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f271-b066-4961-9f03-7fde45fbc285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:04.836418 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111f271-b066-4961-9f03-7fde45fbc285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:04.837827 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111f271-b066-4961-9f03-7fde45fbc285 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:04.846992 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 621/1242] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:09.420705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ff38-5f79-4ac5-a3cf-cdc908326a20 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:09.421281 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ff38-5f79-4ac5-a3cf-cdc908326a20 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:09.421506 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ff38-5f79-4ac5-a3cf-cdc908326a20 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:09.424848 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 622/1243] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:09 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:09.430912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436cfa7-9ba4-4665-b8f6-5fb96e6fb313 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:09.431445 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436cfa7-9ba4-4665-b8f6-5fb96e6fb313 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:09.431541 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436cfa7-9ba4-4665-b8f6-5fb96e6fb313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:09.450129 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-7436cfa7-9ba4-4665-b8f6-5fb96e6fb313 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:09.451349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7436cfa7-9ba4-4665-b8f6-5fb96e6fb313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:09.459455 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 622/1244] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:09.501263 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81ff38-5f79-4ac5-a3cf-cdc908326a20 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:09.512576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81ff38-5f79-4ac5-a3cf-cdc908326a20 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:09.516108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94635f7e-e757-4e56-990a-00a312240323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:09.516738 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94635f7e-e757-4e56-990a-00a312240323 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:09.517014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94635f7e-e757-4e56-990a-00a312240323 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:09.517283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94635f7e-e757-4e56-990a-00a312240323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:09.526560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94635f7e-e757-4e56-990a-00a312240323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:09.527987 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94635f7e-e757-4e56-990a-00a312240323 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:09.537318 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 623/1245] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:12.835525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078d6a1-bb4b-4b4a-984e-41491baff4bf None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:12.836116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078d6a1-bb4b-4b4a-984e-41491baff4bf None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:12.836116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078d6a1-bb4b-4b4a-984e-41491baff4bf None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:12.837963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 623/1246] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:12.844009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb285e-f89c-4bf7-a0c0-604c9e66d08a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:12.844491 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb285e-f89c-4bf7-a0c0-604c9e66d08a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:12.844592 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb285e-f89c-4bf7-a0c0-604c9e66d08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:12.864258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-57eb285e-f89c-4bf7-a0c0-604c9e66d08a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:12.865515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-57eb285e-f89c-4bf7-a0c0-604c9e66d08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:12.876278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 624/1247] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:12.916199 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078d6a1-bb4b-4b4a-984e-41491baff4bf None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:12.927228 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078d6a1-bb4b-4b4a-984e-41491baff4bf None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:12.931605 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb412626-ee4f-4062-8c32-2c05cb34c27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:12.932292 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb412626-ee4f-4062-8c32-2c05cb34c27e service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:12.932569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb412626-ee4f-4062-8c32-2c05cb34c27e service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:12.932835 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb412626-ee4f-4062-8c32-2c05cb34c27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:12.942415 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb412626-ee4f-4062-8c32-2c05cb34c27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:12.943913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb412626-ee4f-4062-8c32-2c05cb34c27e service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:12.954289 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 624/1248] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:17.556592 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190855e2-cbe7-4563-a52d-9521020f4f1e None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:17.557481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190855e2-cbe7-4563-a52d-9521020f4f1e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:17.557758 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190855e2-cbe7-4563-a52d-9521020f4f1e None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:17.560086 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 625/1249] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:17.566330 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebec5f-f2db-4ce2-a897-446fec736b2b None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:17.566779 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebec5f-f2db-4ce2-a897-446fec736b2b None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:17.566902 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebec5f-f2db-4ce2-a897-446fec736b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:17.586672 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-71ebec5f-f2db-4ce2-a897-446fec736b2b None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:17.587910 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-71ebec5f-f2db-4ce2-a897-446fec736b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:17.595655 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 625/1250] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:17.635748 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190855e2-cbe7-4563-a52d-9521020f4f1e None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:17.637572 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-190855e2-cbe7-4563-a52d-9521020f4f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:17.650536 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190855e2-cbe7-4563-a52d-9521020f4f1e None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:17.654035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28f2ae-14b9-432b-9c13-b09fbac02389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:17.654664 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28f2ae-14b9-432b-9c13-b09fbac02389 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:17.654936 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28f2ae-14b9-432b-9c13-b09fbac02389 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:17.655206 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28f2ae-14b9-432b-9c13-b09fbac02389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:17.664607 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28f2ae-14b9-432b-9c13-b09fbac02389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:17.666012 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28f2ae-14b9-432b-9c13-b09fbac02389 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:17.675148 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 626/1251] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:22.931527 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f84d6-203a-4e7c-9517-cc15f9d24ff2 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:22.933224 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f84d6-203a-4e7c-9517-cc15f9d24ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:22.933714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f84d6-203a-4e7c-9517-cc15f9d24ff2 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:22.936085 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 626/1252] 10.222.0.87 () {54 vars in 921 bytes} [Fri Oct 29 01:21:22 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:22.945432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23aaf2-09af-41c3-b175-c7db0617a259 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:22.945947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23aaf2-09af-41c3-b175-c7db0617a259 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:22.945947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23aaf2-09af-41c3-b175-c7db0617a259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:23.020697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-7f23aaf2-09af-41c3-b175-c7db0617a259 None None] MFA Rules not processed for user `9aa303a60fec4ac5aaeb96c6618b387e`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:23.022576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-7f23aaf2-09af-41c3-b175-c7db0617a259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:23.105066 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 627/1253] 10.222.0.87 () {58 vars in 1018 bytes} [Fri Oct 29 01:21:22 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:27.477316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbae91-eb82-4b83-a31f-2bbb5e79f601 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:27.477316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbae91-eb82-4b83-a31f-2bbb5e79f601 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:27.477899 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbae91-eb82-4b83-a31f-2bbb5e79f601 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:27.479812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 627/1254] 10.222.0.87 () {54 vars in 921 bytes} [Fri Oct 29 01:21:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:27.485242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb4de3-c39d-420c-a541-f82d9589061a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:27.486229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb4de3-c39d-420c-a541-f82d9589061a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:27.486742 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb4de3-c39d-420c-a541-f82d9589061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:27.508583 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-f4bb4de3-c39d-420c-a541-f82d9589061a None None] MFA Rules not processed for user `9aa303a60fec4ac5aaeb96c6618b387e`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:27.509783 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-f4bb4de3-c39d-420c-a541-f82d9589061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:27.518704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 628/1255] 10.222.0.87 () {58 vars in 1018 bytes} [Fri Oct 29 01:21:27 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:29.123029 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fdff7-b7f2-46cd-a9da-ae9204ceadd3 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:29.126983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fdff7-b7f2-46cd-a9da-ae9204ceadd3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:29.126983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fdff7-b7f2-46cd-a9da-ae9204ceadd3 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:29.126983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 628/1256] 10.222.0.87 () {54 vars in 921 bytes} [Fri Oct 29 01:21:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:29.134114 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ff55e-dc5a-4fea-a1f4-a2cd616ab7d1 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:29.134636 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ff55e-dc5a-4fea-a1f4-a2cd616ab7d1 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:29.134636 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ff55e-dc5a-4fea-a1f4-a2cd616ab7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:29.153323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ba8ff55e-dc5a-4fea-a1f4-a2cd616ab7d1 None None] MFA Rules not processed for user `9aa303a60fec4ac5aaeb96c6618b387e`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:29.154530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ba8ff55e-dc5a-4fea-a1f4-a2cd616ab7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:29.163208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 629/1257] 10.222.0.87 () {58 vars in 1018 bytes} [Fri Oct 29 01:21:29 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:33.225571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e389765-ffd4-4c15-8b8e-8aed1818795d None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:33.226175 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e389765-ffd4-4c15-8b8e-8aed1818795d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:33.226175 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e389765-ffd4-4c15-8b8e-8aed1818795d None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:33.229417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 629/1258] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:33.234233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c65048-5b19-4d13-aabd-df192644510c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:33.235093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c65048-5b19-4d13-aabd-df192644510c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:33.235557 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c65048-5b19-4d13-aabd-df192644510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:33.256844 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-06c65048-5b19-4d13-aabd-df192644510c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:33.258175 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-06c65048-5b19-4d13-aabd-df192644510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:33.266885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 630/1259] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:21:33.317438 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bceada-1b36-42cc-b81d-eae224da69d4 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:33.317715 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bceada-1b36-42cc-b81d-eae224da69d4 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:33.318523 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bceada-1b36-42cc-b81d-eae224da69d4 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:33.320576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 630/1260] 10.222.0.87 () {54 vars in 960 bytes} [Fri Oct 29 01:21:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:33.330850 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fc950-be10-414a-9b8d-77af29b598ba None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:33.331163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fc950-be10-414a-9b8d-77af29b598ba None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:33.331474 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fc950-be10-414a-9b8d-77af29b598ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:33.386019 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-898fc950-be10-414a-9b8d-77af29b598ba None None] MFA Rules not processed for user `28d331f2997547968c51fec87598420f`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:33.387137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-898fc950-be10-414a-9b8d-77af29b598ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:33.484026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 631/1261] 10.222.0.87 () {58 vars in 1057 bytes} [Fri Oct 29 01:21:33 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:33.493418 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bceada-1b36-42cc-b81d-eae224da69d4 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:33.509769 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bceada-1b36-42cc-b81d-eae224da69d4 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:33.515877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc5381-32f7-4ef7-9aa0-0e6a517f15cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:33.516922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc5381-32f7-4ef7-9aa0-0e6a517f15cf service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:33.517600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc5381-32f7-4ef7-9aa0-0e6a517f15cf service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:33.518096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc5381-32f7-4ef7-9aa0-0e6a517f15cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:33.527864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc5381-32f7-4ef7-9aa0-0e6a517f15cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:33.529757 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc5381-32f7-4ef7-9aa0-0e6a517f15cf service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:33.542184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 631/1262] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:36.087274 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3494375-1ada-416f-a5b2-03a61ede9206 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:36.087854 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3494375-1ada-416f-a5b2-03a61ede9206 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:36.087967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3494375-1ada-416f-a5b2-03a61ede9206 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:36.089884 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 632/1263] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:36.095756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524ad91-456f-41b1-9e7a-a6ff2c617674 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:36.096176 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524ad91-456f-41b1-9e7a-a6ff2c617674 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:36.096328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524ad91-456f-41b1-9e7a-a6ff2c617674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:36.115550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-0524ad91-456f-41b1-9e7a-a6ff2c617674 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:36.121361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0524ad91-456f-41b1-9e7a-a6ff2c617674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:36.125574 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 632/1264] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:36.173162 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3494375-1ada-416f-a5b2-03a61ede9206 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:36.189540 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3494375-1ada-416f-a5b2-03a61ede9206 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:36.195523 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72533cad-f271-43df-88a8-f39b786c838b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:36.196278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72533cad-f271-43df-88a8-f39b786c838b service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:36.196669 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72533cad-f271-43df-88a8-f39b786c838b service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:36.196980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72533cad-f271-43df-88a8-f39b786c838b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:36.205949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72533cad-f271-43df-88a8-f39b786c838b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:36.207608 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72533cad-f271-43df-88a8-f39b786c838b service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:36.218274 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 633/1265] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:39.024158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11870bba-a98a-444f-b8e2-d15c6b2e08f7 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:39.024758 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11870bba-a98a-444f-b8e2-d15c6b2e08f7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:39.024758 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11870bba-a98a-444f-b8e2-d15c6b2e08f7 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:39.026486 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 633/1266] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:39.033234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd711336-4070-4882-841d-32deeb5aa2db None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:39.033801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd711336-4070-4882-841d-32deeb5aa2db None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:39.033910 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd711336-4070-4882-841d-32deeb5aa2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:39.056911 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-bd711336-4070-4882-841d-32deeb5aa2db None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:39.058672 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-bd711336-4070-4882-841d-32deeb5aa2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:39.069369 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 634/1267] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:39.119830 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573b773-3c98-4d41-ac9f-053af1f53bf7 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:39.120037 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573b773-3c98-4d41-ac9f-053af1f53bf7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:39.120515 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573b773-3c98-4d41-ac9f-053af1f53bf7 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:39.122804 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 634/1268] 10.222.0.87 () {54 vars in 960 bytes} [Fri Oct 29 01:21:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:39.131169 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5aeb6-54f1-4cd8-b544-32da8236dbec None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:39.131605 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5aeb6-54f1-4cd8-b544-32da8236dbec None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:39.131916 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5aeb6-54f1-4cd8-b544-32da8236dbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:39.154316 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-a2b5aeb6-54f1-4cd8-b544-32da8236dbec None None] MFA Rules not processed for user `28d331f2997547968c51fec87598420f`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:39.155826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a2b5aeb6-54f1-4cd8-b544-32da8236dbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:39.166417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 635/1269] 10.222.0.87 () {58 vars in 1057 bytes} [Fri Oct 29 01:21:39 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:39.176060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573b773-3c98-4d41-ac9f-053af1f53bf7 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:39.197405 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573b773-3c98-4d41-ac9f-053af1f53bf7 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:39.203607 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23761e-c5b9-4b16-a657-41ef516ce93a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:39.204459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23761e-c5b9-4b16-a657-41ef516ce93a service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:39.204901 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23761e-c5b9-4b16-a657-41ef516ce93a service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:39.205327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23761e-c5b9-4b16-a657-41ef516ce93a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:39.215042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23761e-c5b9-4b16-a657-41ef516ce93a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:39.216934 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23761e-c5b9-4b16-a657-41ef516ce93a service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:39.227367 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 635/1270] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:41.352184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f467b8a-d601-4ba3-977f-5136e708390e None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:41.352774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f467b8a-d601-4ba3-977f-5136e708390e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:41.352774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f467b8a-d601-4ba3-977f-5136e708390e None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:41.354482 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 636/1271] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:41.360618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083a749-4459-415f-a327-2da9fad3df33 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:41.361417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083a749-4459-415f-a327-2da9fad3df33 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:41.361837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083a749-4459-415f-a327-2da9fad3df33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:41.382255 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-e083a749-4459-415f-a327-2da9fad3df33 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:41.383759 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e083a749-4459-415f-a327-2da9fad3df33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:41.391970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 636/1272] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:41.448605 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6ce1b-aebd-4a8c-8fea-971d83b9f0ad None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:41.448881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6ce1b-aebd-4a8c-8fea-971d83b9f0ad None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:41.449570 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6ce1b-aebd-4a8c-8fea-971d83b9f0ad None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:41.451561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 637/1273] 10.222.0.87 () {54 vars in 962 bytes} [Fri Oct 29 01:21:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:41.457406 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aaf70-5147-4041-85aa-5d595c68a77c None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:41.457963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aaf70-5147-4041-85aa-5d595c68a77c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:41.459003 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aaf70-5147-4041-85aa-5d595c68a77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:41.513540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-3b4aaf70-5147-4041-85aa-5d595c68a77c None None] MFA Rules not processed for user `c6be4b7bef21492bad49e6b5a284f4f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:41.514746 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3b4aaf70-5147-4041-85aa-5d595c68a77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:41.583316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 637/1274] 10.222.0.87 () {58 vars in 1059 bytes} [Fri Oct 29 01:21:41 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:41.591982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6ce1b-aebd-4a8c-8fea-971d83b9f0ad None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:41.603442 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6ce1b-aebd-4a8c-8fea-971d83b9f0ad None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:41.607164 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f597ec-4c80-4320-84cf-84e1704c042f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:41.607872 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f597ec-4c80-4320-84cf-84e1704c042f service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:41.608149 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f597ec-4c80-4320-84cf-84e1704c042f service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:41.608419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f597ec-4c80-4320-84cf-84e1704c042f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:41.619345 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f597ec-4c80-4320-84cf-84e1704c042f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:41.620857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f597ec-4c80-4320-84cf-84e1704c042f service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:41.632931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 638/1275] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:41.782366 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea45558-83f4-49aa-ad7f-b6e08dbf57b3 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:41.783015 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea45558-83f4-49aa-ad7f-b6e08dbf57b3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:41.783396 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea45558-83f4-49aa-ad7f-b6e08dbf57b3 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:41.785343 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 638/1276] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:41.791598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e8355-5c50-4c28-98a0-33c58866fa8b None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:41.792202 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e8355-5c50-4c28-98a0-33c58866fa8b None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:41.792505 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e8355-5c50-4c28-98a0-33c58866fa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:41.810861 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-fa4e8355-5c50-4c28-98a0-33c58866fa8b None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:41.812092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-fa4e8355-5c50-4c28-98a0-33c58866fa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:41.820759 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 639/1277] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:41.875597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea45558-83f4-49aa-ad7f-b6e08dbf57b3 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:41.891500 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea45558-83f4-49aa-ad7f-b6e08dbf57b3 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:41.897576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba210fbf-0042-49da-b101-69d22afc085f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:41.898420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba210fbf-0042-49da-b101-69d22afc085f service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:41.898804 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba210fbf-0042-49da-b101-69d22afc085f service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:41.899176 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba210fbf-0042-49da-b101-69d22afc085f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:41.908433 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba210fbf-0042-49da-b101-69d22afc085f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:41.910242 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba210fbf-0042-49da-b101-69d22afc085f service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:41.921369 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 639/1278] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:44.414374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810baeaf-68df-466a-8f82-226d69565141 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:44.415100 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810baeaf-68df-466a-8f82-226d69565141 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:44.415100 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810baeaf-68df-466a-8f82-226d69565141 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:44.416738 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 640/1279] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:44.422985 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefa63d-c150-4e14-b311-c4100de0a0c3 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:44.423447 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefa63d-c150-4e14-b311-c4100de0a0c3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:44.423552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefa63d-c150-4e14-b311-c4100de0a0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:44.443211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-cfefa63d-c150-4e14-b311-c4100de0a0c3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:44.444485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-cfefa63d-c150-4e14-b311-c4100de0a0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:44.453421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 640/1280] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:44.503915 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810baeaf-68df-466a-8f82-226d69565141 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:44.521079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810baeaf-68df-466a-8f82-226d69565141 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:44.528337 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2aae8-b3f6-4c1b-b223-4532a653fd15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:44.529187 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2aae8-b3f6-4c1b-b223-4532a653fd15 service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:44.529470 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2aae8-b3f6-4c1b-b223-4532a653fd15 service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:44.529746 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2aae8-b3f6-4c1b-b223-4532a653fd15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:44.539557 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2aae8-b3f6-4c1b-b223-4532a653fd15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:44.541236 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2aae8-b3f6-4c1b-b223-4532a653fd15 service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:44.550898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 641/1281] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:47.022329 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963007-8a96-4214-b926-2b7a7ce515ba None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:47.022865 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963007-8a96-4214-b926-2b7a7ce515ba None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:47.022865 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963007-8a96-4214-b926-2b7a7ce515ba None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:47.024691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 641/1282] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:47.031052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be719035-3c7d-4b93-bb6b-56cc8ac3a512 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:47.031518 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be719035-3c7d-4b93-bb6b-56cc8ac3a512 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:47.031598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be719035-3c7d-4b93-bb6b-56cc8ac3a512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:47.050421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-be719035-3c7d-4b93-bb6b-56cc8ac3a512 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:47.051638 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-be719035-3c7d-4b93-bb6b-56cc8ac3a512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:47.060210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 642/1283] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:47.108028 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b963007-8a96-4214-b926-2b7a7ce515ba None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:47.124008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b963007-8a96-4214-b926-2b7a7ce515ba None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:47.131438 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426b4f6-34e5-4270-9ae2-23d0bf0421d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:47.132336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426b4f6-34e5-4270-9ae2-23d0bf0421d9 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:47.132733 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426b4f6-34e5-4270-9ae2-23d0bf0421d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:47.133117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426b4f6-34e5-4270-9ae2-23d0bf0421d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:47.144030 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426b4f6-34e5-4270-9ae2-23d0bf0421d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:47.147345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426b4f6-34e5-4270-9ae2-23d0bf0421d9 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:47.159234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 642/1284] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:49.718958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b3d33-4c08-4361-ab4e-72e4dcd8aa45 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:49.719661 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b3d33-4c08-4361-ab4e-72e4dcd8aa45 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:49.719661 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b3d33-4c08-4361-ab4e-72e4dcd8aa45 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:49.721310 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 643/1285] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:49.728130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28458a-0138-444f-a000-bf610ea603ad None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:49.728627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28458a-0138-444f-a000-bf610ea603ad None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:49.728627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28458a-0138-444f-a000-bf610ea603ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:49.746382 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-5c28458a-0138-444f-a000-bf610ea603ad None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:49.747598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-5c28458a-0138-444f-a000-bf610ea603ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:49.756049 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 643/1286] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:49.802459 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b3d33-4c08-4361-ab4e-72e4dcd8aa45 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:49.821306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b3d33-4c08-4361-ab4e-72e4dcd8aa45 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:49.828712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695add4-402b-4a65-8e34-53e35c222be1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:49.829812 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695add4-402b-4a65-8e34-53e35c222be1 service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:49.830467 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695add4-402b-4a65-8e34-53e35c222be1 service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:49.831055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695add4-402b-4a65-8e34-53e35c222be1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:49.843029 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695add4-402b-4a65-8e34-53e35c222be1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:49.845007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695add4-402b-4a65-8e34-53e35c222be1 service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:49.856584 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 644/1287] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:52.378700 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b3f6c-8daf-4be3-8b69-5f8279f32db1 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:52.379265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b3f6c-8daf-4be3-8b69-5f8279f32db1 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:52.379265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b3f6c-8daf-4be3-8b69-5f8279f32db1 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:52.381285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 644/1288] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:52.387943 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef280dd-4bc8-43a8-9b89-e1bf2b4d2bbc None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:52.388419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef280dd-4bc8-43a8-9b89-e1bf2b4d2bbc None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:52.388664 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef280dd-4bc8-43a8-9b89-e1bf2b4d2bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:52.413858 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-fef280dd-4bc8-43a8-9b89-e1bf2b4d2bbc None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:52.416530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-fef280dd-4bc8-43a8-9b89-e1bf2b4d2bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:52.431762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 645/1289] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:52.480510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b3f6c-8daf-4be3-8b69-5f8279f32db1 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:52.495330 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b3f6c-8daf-4be3-8b69-5f8279f32db1 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:52.502525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437a625-b809-4b71-a6f8-dcbe51107b59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:52.503325 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437a625-b809-4b71-a6f8-dcbe51107b59 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:52.503699 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437a625-b809-4b71-a6f8-dcbe51107b59 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:52.504175 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437a625-b809-4b71-a6f8-dcbe51107b59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:52.516249 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437a625-b809-4b71-a6f8-dcbe51107b59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:52.518397 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437a625-b809-4b71-a6f8-dcbe51107b59 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:52.531491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 645/1290] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:54.978029 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b0971-3188-4ebb-9218-e2bbc6d4d088 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:54.978732 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b0971-3188-4ebb-9218-e2bbc6d4d088 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:54.978732 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b0971-3188-4ebb-9218-e2bbc6d4d088 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:54.980794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 646/1291] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:54.986691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966be2a0-c5ef-4ebe-adcc-643be38e1dac None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:54.987277 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966be2a0-c5ef-4ebe-adcc-643be38e1dac None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:54.987277 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966be2a0-c5ef-4ebe-adcc-643be38e1dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:55.006239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-966be2a0-c5ef-4ebe-adcc-643be38e1dac None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:55.007430 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-966be2a0-c5ef-4ebe-adcc-643be38e1dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:55.015611 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 646/1292] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:21:55.063773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b0971-3188-4ebb-9218-e2bbc6d4d088 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:55.078378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b0971-3188-4ebb-9218-e2bbc6d4d088 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:55.084062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a77b17-356e-4a0d-8579-9b0a7846d253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:55.084690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77b17-356e-4a0d-8579-9b0a7846d253 service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:55.084965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77b17-356e-4a0d-8579-9b0a7846d253 service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:55.085237 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77b17-356e-4a0d-8579-9b0a7846d253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:55.093796 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a77b17-356e-4a0d-8579-9b0a7846d253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:55.095341 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a77b17-356e-4a0d-8579-9b0a7846d253 service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:55.105415 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 647/1293] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:57.343362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f25bf-4931-422c-9435-de7e973b560f None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:57.343988 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f25bf-4931-422c-9435-de7e973b560f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:57.344091 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f25bf-4931-422c-9435-de7e973b560f None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:57.345868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 647/1294] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:57.352683 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7398-026e-4d91-9f56-bd89e9a1ed4f None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:57.353199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7398-026e-4d91-9f56-bd89e9a1ed4f None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:57.353296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7398-026e-4d91-9f56-bd89e9a1ed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:57.371560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-297e7398-026e-4d91-9f56-bd89e9a1ed4f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:57.372827 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-297e7398-026e-4d91-9f56-bd89e9a1ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:57.381223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 648/1295] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:57.440063 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe61cb3-c222-48eb-bc72-f10e9dc123c4 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:57.440373 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe61cb3-c222-48eb-bc72-f10e9dc123c4 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:57.440648 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe61cb3-c222-48eb-bc72-f10e9dc123c4 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:57.442485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 648/1296] 10.222.0.87 () {54 vars in 962 bytes} [Fri Oct 29 01:21:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:57.448535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9da25e-8538-481a-ac92-05f64131ab27 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:57.448830 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9da25e-8538-481a-ac92-05f64131ab27 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:57.449364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9da25e-8538-481a-ac92-05f64131ab27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:57.504203 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-cf9da25e-8538-481a-ac92-05f64131ab27 None None] MFA Rules not processed for user `0998dd32ba8648cfb7f43797a9266d81`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:57.505965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-cf9da25e-8538-481a-ac92-05f64131ab27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:57.564898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 649/1297] 10.222.0.87 () {58 vars in 1059 bytes} [Fri Oct 29 01:21:57 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:57.573171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe61cb3-c222-48eb-bc72-f10e9dc123c4 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:57.584905 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe61cb3-c222-48eb-bc72-f10e9dc123c4 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:57.588402 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09bfe1-35a4-46e5-aa14-9cc6da3a86c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0998dd32ba8648cfb7f43797a9266d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:57.589034 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09bfe1-35a4-46e5-aa14-9cc6da3a86c8 service glance] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:57.589313 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09bfe1-35a4-46e5-aa14-9cc6da3a86c8 service glance] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:57.589585 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09bfe1-35a4-46e5-aa14-9cc6da3a86c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:57.599342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09bfe1-35a4-46e5-aa14-9cc6da3a86c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:57.600882 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09bfe1-35a4-46e5-aa14-9cc6da3a86c8 service glance] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:57.610378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 649/1298] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:57.619976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4fe6a-50b5-4da6-b628-7a8b99632a45 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:57.620261 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4fe6a-50b5-4da6-b628-7a8b99632a45 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:57.620530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4fe6a-50b5-4da6-b628-7a8b99632a45 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:57.622303 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 650/1299] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:21:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:57.628227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b350e3-54ec-4182-8d5b-430c702830dd None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:57.628532 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b350e3-54ec-4182-8d5b-430c702830dd None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:57.628806 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b350e3-54ec-4182-8d5b-430c702830dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:57.647139 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-35b350e3-54ec-4182-8d5b-430c702830dd None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:57.648363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-35b350e3-54ec-4182-8d5b-430c702830dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:57.656590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 650/1300] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:21:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:21:57.704185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4fe6a-50b5-4da6-b628-7a8b99632a45 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:57.718716 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4fe6a-50b5-4da6-b628-7a8b99632a45 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:57.724189 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39b0c6-f43b-43bd-873a-7585543f465e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:57.724819 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39b0c6-f43b-43bd-873a-7585543f465e service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:57.725099 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39b0c6-f43b-43bd-873a-7585543f465e service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:57.725372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39b0c6-f43b-43bd-873a-7585543f465e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:57.733685 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39b0c6-f43b-43bd-873a-7585543f465e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:57.735254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39b0c6-f43b-43bd-873a-7585543f465e service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:57.745693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 651/1301] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:21:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:21:58.272754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0bc17-c5ae-4e48-98ed-6226a37ed3c9 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:58.273038 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0bc17-c5ae-4e48-98ed-6226a37ed3c9 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:58.273334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0bc17-c5ae-4e48-98ed-6226a37ed3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:58.325018 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-50a0bc17-c5ae-4e48-98ed-6226a37ed3c9 None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:58.326227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-50a0bc17-c5ae-4e48-98ed-6226a37ed3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:58.389080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 651/1302] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:21:58 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:58.433609 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e334ac-286a-4d58-8f26-fa09b1cf72a0 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:58.434190 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e334ac-286a-4d58-8f26-fa09b1cf72a0 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:58.434190 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e334ac-286a-4d58-8f26-fa09b1cf72a0 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:58.436065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 652/1303] 10.222.0.87 () {54 vars in 942 bytes} [Fri Oct 29 01:21:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:21:58.444013 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e06142-1046-4942-81e7-73ca035e2de4 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:58.444298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e06142-1046-4942-81e7-73ca035e2de4 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:58.444574 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e06142-1046-4942-81e7-73ca035e2de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:58.498641 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-91e06142-1046-4942-81e7-73ca035e2de4 None None] MFA Rules not processed for user `7e9153b864b44f5dbbfd6f33ddb253c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:21:58.499894 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-91e06142-1046-4942-81e7-73ca035e2de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:21:58.580731 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 652/1304] 10.222.0.87 () {58 vars in 1039 bytes} [Fri Oct 29 01:21:58 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:21:58.590611 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e334ac-286a-4d58-8f26-fa09b1cf72a0 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:21:58.604537 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e334ac-286a-4d58-8f26-fa09b1cf72a0 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:21:58.609470 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2106f-489f-4d05-b341-c9264c7c8127 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:21:58.610205 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2106f-489f-4d05-b341-c9264c7c8127 service swift] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:21:58.610568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2106f-489f-4d05-b341-c9264c7c8127 service swift] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:21:58.610932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2106f-489f-4d05-b341-c9264c7c8127 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:21:58.619843 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2106f-489f-4d05-b341-c9264c7c8127 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:21:58.621524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2106f-489f-4d05-b341-c9264c7c8127 service swift] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:21:58.629606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 653/1305] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:21:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 01:22:00.369404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebc2fc-424a-40d0-82fc-e00dc0ef9d87 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:00.369949 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebc2fc-424a-40d0-82fc-e00dc0ef9d87 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:00.369949 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebc2fc-424a-40d0-82fc-e00dc0ef9d87 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:00.371745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 653/1306] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:22:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:00.378499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4316407-4530-4047-9c08-8531fe668fca None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:00.379017 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4316407-4530-4047-9c08-8531fe668fca None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:00.379111 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4316407-4530-4047-9c08-8531fe668fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:00.400294 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-b4316407-4530-4047-9c08-8531fe668fca None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:00.401718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b4316407-4530-4047-9c08-8531fe668fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:00.410119 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 654/1307] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:22:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:22:00.462151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebc2fc-424a-40d0-82fc-e00dc0ef9d87 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:00.478433 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebc2fc-424a-40d0-82fc-e00dc0ef9d87 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:00.484305 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dd8db-c17c-4641-8361-59f2b33cc1ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:00.484950 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dd8db-c17c-4641-8361-59f2b33cc1ae service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:00.485233 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dd8db-c17c-4641-8361-59f2b33cc1ae service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:00.485506 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dd8db-c17c-4641-8361-59f2b33cc1ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:00.494844 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dd8db-c17c-4641-8361-59f2b33cc1ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:00.497581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dd8db-c17c-4641-8361-59f2b33cc1ae service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:00.508258 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 654/1308] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:22:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:03.005881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a77f3-941c-4f57-877c-a5f530d0639d None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:03.006516 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a77f3-941c-4f57-877c-a5f530d0639d None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:03.006516 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a77f3-941c-4f57-877c-a5f530d0639d None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:03.009138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 655/1309] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:22:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:03.015265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eb226-6ad3-450e-b235-865c5c5e7c4f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:03.016199 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eb226-6ad3-450e-b235-865c5c5e7c4f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:03.016483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eb226-6ad3-450e-b235-865c5c5e7c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:03.040490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-0e9eb226-6ad3-450e-b235-865c5c5e7c4f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:03.041698 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0e9eb226-6ad3-450e-b235-865c5c5e7c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:03.050087 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 655/1310] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:22:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:03.100468 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a77f3-941c-4f57-877c-a5f530d0639d None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:03.114157 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a77f3-941c-4f57-877c-a5f530d0639d None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:03.120357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8e26-fa11-4109-b52a-5d9ecebc7694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:03.121342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8e26-fa11-4109-b52a-5d9ecebc7694 service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:03.121629 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8e26-fa11-4109-b52a-5d9ecebc7694 service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:03.121955 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8e26-fa11-4109-b52a-5d9ecebc7694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:03.132408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae8e26-fa11-4109-b52a-5d9ecebc7694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:03.134260 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae8e26-fa11-4109-b52a-5d9ecebc7694 service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:03.145079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 656/1311] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:22:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:17.950578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a844d4e-8134-4b54-b2f5-c176d64f143c None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:17.951135 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a844d4e-8134-4b54-b2f5-c176d64f143c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:17.951135 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a844d4e-8134-4b54-b2f5-c176d64f143c None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:17.952917 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 656/1312] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:22:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:17.959453 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f0652-2d19-4266-87c6-eb7000d2c494 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:17.959914 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f0652-2d19-4266-87c6-eb7000d2c494 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:17.960043 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f0652-2d19-4266-87c6-eb7000d2c494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:17.978235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-942f0652-2d19-4266-87c6-eb7000d2c494 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:17.979434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-942f0652-2d19-4266-87c6-eb7000d2c494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:17.987109 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 657/1313] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:22:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:18.012086 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a844d4e-8134-4b54-b2f5-c176d64f143c None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:18.026514 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a844d4e-8134-4b54-b2f5-c176d64f143c None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:18.030901 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe3fb7-cfe5-4144-b780-734f80f72fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:18.031547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe3fb7-cfe5-4144-b780-734f80f72fcb admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:18.031856 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe3fb7-cfe5-4144-b780-734f80f72fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:18.032130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe3fb7-cfe5-4144-b780-734f80f72fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:18.032864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe3fb7-cfe5-4144-b780-734f80f72fcb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:18.034722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe3fb7-cfe5-4144-b780-734f80f72fcb admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:18.055337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 657/1314] 10.222.0.87 () {56 vars in 1108 bytes} [Fri Oct 29 01:22:18 2021] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:22:20.308449 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a51a-d077-4404-8a10-780843ccf7d4 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:20.308987 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a51a-d077-4404-8a10-780843ccf7d4 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:20.308987 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a51a-d077-4404-8a10-780843ccf7d4 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:20.310785 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 658/1315] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:22:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:20.317133 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd4e2d-989c-4c52-a258-848a25335d16 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:20.317572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd4e2d-989c-4c52-a258-848a25335d16 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:20.317680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd4e2d-989c-4c52-a258-848a25335d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:20.335248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-60dd4e2d-989c-4c52-a258-848a25335d16 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:20.336511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-60dd4e2d-989c-4c52-a258-848a25335d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:20.344182 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 658/1316] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:22:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:20.368870 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985a51a-d077-4404-8a10-780843ccf7d4 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:20.381483 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985a51a-d077-4404-8a10-780843ccf7d4 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:20.385941 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad99947-ce6e-4793-86dd-0c5f74752a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:20.386767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad99947-ce6e-4793-86dd-0c5f74752a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:20.387049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad99947-ce6e-4793-86dd-0c5f74752a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:20.387323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad99947-ce6e-4793-86dd-0c5f74752a97 admin admin] PATH_INFO: `/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:20.397697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad99947-ce6e-4793-86dd-0c5f74752a97 admin admin] RBAC: Authorizing `identity:get_project(project_id=1fa68fcfb24b49e6bdff78724f48ed64)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:20.399791 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad99947-ce6e-4793-86dd-0c5f74752a97 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:20.401502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 659/1317] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:22:20 2021] GET /identity/v3/projects/1fa68fcfb24b49e6bdff78724f48ed64 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:22:20.408224 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd4e2d-989c-4c52-a258-848a25335d16 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:20.417848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd4e2d-989c-4c52-a258-848a25335d16 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:20.422367 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38a42e-ea9b-4488-b310-ff2c6af6bd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:20.423001 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38a42e-ea9b-4488-b310-ff2c6af6bd70 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:20.423301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38a42e-ea9b-4488-b310-ff2c6af6bd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:20.423559 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38a42e-ea9b-4488-b310-ff2c6af6bd70 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:20.424371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38a42e-ea9b-4488-b310-ff2c6af6bd70 admin admin] RBAC: Adding query filter params (scope.project.id=1fa68fcfb24b49e6bdff78724f48ed64) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:22:20.424677 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38a42e-ea9b-4488-b310-ff2c6af6bd70 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:20.427215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38a42e-ea9b-4488-b310-ff2c6af6bd70 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:20.433856 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 659/1318] 10.222.0.87 () {56 vars in 1231 bytes} [Fri Oct 29 01:22:20 2021] GET /identity/v3/role_assignments?scope.project.id=1fa68fcfb24b49e6bdff78724f48ed64 => generated 877 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:20.440147 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad99947-ce6e-4793-86dd-0c5f74752a97 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:20.450528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad99947-ce6e-4793-86dd-0c5f74752a97 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:20.455089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86ff09-6ce4-4fa5-962a-bf74d288212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:20.455957 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86ff09-6ce4-4fa5-962a-bf74d288212b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:20.456239 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86ff09-6ce4-4fa5-962a-bf74d288212b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:20.456547 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86ff09-6ce4-4fa5-962a-bf74d288212b admin admin] PATH_INFO: `/v3/users/0515364c83794b0a85c949b2616c0ae0` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:20.469696 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86ff09-6ce4-4fa5-962a-bf74d288212b admin admin] RBAC: Authorizing `identity:get_user(user_id=0515364c83794b0a85c949b2616c0ae0)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:20.471830 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86ff09-6ce4-4fa5-962a-bf74d288212b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:20.474027 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 660/1319] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:22:20 2021] GET /identity/v3/users/0515364c83794b0a85c949b2616c0ae0 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:22:20.480620 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38a42e-ea9b-4488-b310-ff2c6af6bd70 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:20.492732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38a42e-ea9b-4488-b310-ff2c6af6bd70 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:20.498731 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff103d-d152-4cbb-a2ac-02f95d589c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:20.499592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff103d-d152-4cbb-a2ac-02f95d589c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:20.499907 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff103d-d152-4cbb-a2ac-02f95d589c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:20.500181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff103d-d152-4cbb-a2ac-02f95d589c4a admin admin] PATH_INFO: `/v3/users/3726bba2a49648118639a905c87fb052` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:20.516596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff103d-d152-4cbb-a2ac-02f95d589c4a admin admin] RBAC: Authorizing `identity:get_user(user_id=3726bba2a49648118639a905c87fb052)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:20.518961 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff103d-d152-4cbb-a2ac-02f95d589c4a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:20.520656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 660/1320] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:22:20 2021] GET /identity/v3/users/3726bba2a49648118639a905c87fb052 => generated 285 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:22.876409 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a2a09-9d1d-40dd-a410-5c4f462a136b None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:22.876861 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a2a09-9d1d-40dd-a410-5c4f462a136b None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:22.876975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a2a09-9d1d-40dd-a410-5c4f462a136b None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:22.879339 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 661/1321] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:22:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:22.886413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8ddc3-68a7-41d4-9377-d768213a76a2 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:22.886950 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8ddc3-68a7-41d4-9377-d768213a76a2 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:22.886950 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8ddc3-68a7-41d4-9377-d768213a76a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:22.905006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-1ae8ddc3-68a7-41d4-9377-d768213a76a2 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:22.906209 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1ae8ddc3-68a7-41d4-9377-d768213a76a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:22.914283 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 661/1322] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:22:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:22.938136 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a2a09-9d1d-40dd-a410-5c4f462a136b None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:22.951009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a2a09-9d1d-40dd-a410-5c4f462a136b None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:22.955334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11456c47-c86c-4846-a123-ce9160065226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:22.956198 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11456c47-c86c-4846-a123-ce9160065226 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:22.957070 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11456c47-c86c-4846-a123-ce9160065226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:22.957340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11456c47-c86c-4846-a123-ce9160065226 admin admin] PATH_INFO: `/v3/projects/2ac3fe6c70e94b5294a05c397d1a0fce` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:22.958513 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11456c47-c86c-4846-a123-ce9160065226 admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac3fe6c70e94b5294a05c397d1a0fce)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:22.960298 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11456c47-c86c-4846-a123-ce9160065226 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:22.961938 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 662/1323] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:22:22 2021] GET /identity/v3/projects/2ac3fe6c70e94b5294a05c397d1a0fce => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:22.968694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8ddc3-68a7-41d4-9377-d768213a76a2 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:22.977822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8ddc3-68a7-41d4-9377-d768213a76a2 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:22.982474 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45f2c2-2c15-43d1-8843-fb68b361ad0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:22.983118 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45f2c2-2c15-43d1-8843-fb68b361ad0f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:22.983399 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45f2c2-2c15-43d1-8843-fb68b361ad0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:22.983674 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45f2c2-2c15-43d1-8843-fb68b361ad0f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:22.984478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45f2c2-2c15-43d1-8843-fb68b361ad0f admin admin] RBAC: Adding query filter params (scope.project.id=2ac3fe6c70e94b5294a05c397d1a0fce) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:22:22.984786 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45f2c2-2c15-43d1-8843-fb68b361ad0f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:22.986613 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45f2c2-2c15-43d1-8843-fb68b361ad0f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:22.993417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 662/1324] 10.222.0.87 () {56 vars in 1231 bytes} [Fri Oct 29 01:22:22 2021] GET /identity/v3/role_assignments?scope.project.id=2ac3fe6c70e94b5294a05c397d1a0fce => generated 879 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:22.999744 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11456c47-c86c-4846-a123-ce9160065226 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:23.010447 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11456c47-c86c-4846-a123-ce9160065226 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:23.015220 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206c70c-84b3-4693-867c-11bd069a74a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:23.016107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206c70c-84b3-4693-867c-11bd069a74a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:23.016387 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206c70c-84b3-4693-867c-11bd069a74a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:23.016660 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206c70c-84b3-4693-867c-11bd069a74a3 admin admin] PATH_INFO: `/v3/users/5644d459227e4d61a1311eb719e23975` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:23.017853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206c70c-84b3-4693-867c-11bd069a74a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=5644d459227e4d61a1311eb719e23975)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:23.019806 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206c70c-84b3-4693-867c-11bd069a74a3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:23.021454 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 663/1325] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:22:22 2021] GET /identity/v3/users/5644d459227e4d61a1311eb719e23975 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:25.319408 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f6641-7b98-441e-964e-d3e9ebe2a483 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:25.320018 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f6641-7b98-441e-964e-d3e9ebe2a483 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:25.320018 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f6641-7b98-441e-964e-d3e9ebe2a483 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:25.321810 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 663/1326] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:22:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:25.328349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780442a0-e0a1-4ddf-b151-b09e68123cc1 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:25.328855 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780442a0-e0a1-4ddf-b151-b09e68123cc1 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:25.328950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780442a0-e0a1-4ddf-b151-b09e68123cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:25.348119 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-780442a0-e0a1-4ddf-b151-b09e68123cc1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:25.349353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-780442a0-e0a1-4ddf-b151-b09e68123cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:25.357209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 664/1327] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:22:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:25.381394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f6641-7b98-441e-964e-d3e9ebe2a483 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:25.393499 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f6641-7b98-441e-964e-d3e9ebe2a483 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:25.398595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a865b0-c768-43f0-8820-a8fa3c6e14d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:25.399674 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a865b0-c768-43f0-8820-a8fa3c6e14d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:25.399950 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a865b0-c768-43f0-8820-a8fa3c6e14d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:25.400224 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a865b0-c768-43f0-8820-a8fa3c6e14d2 admin admin] PATH_INFO: `/v3/projects/3f445e69c8094e37889545aefb002e28` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:25.413298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a865b0-c768-43f0-8820-a8fa3c6e14d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f445e69c8094e37889545aefb002e28)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:25.415342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a865b0-c768-43f0-8820-a8fa3c6e14d2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:25.417467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 664/1328] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:22:25 2021] GET /identity/v3/projects/3f445e69c8094e37889545aefb002e28 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:25.424068 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780442a0-e0a1-4ddf-b151-b09e68123cc1 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:25.433567 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780442a0-e0a1-4ddf-b151-b09e68123cc1 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:25.438216 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e9e07-13b9-419c-a01c-d8668be0c30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:25.438859 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e9e07-13b9-419c-a01c-d8668be0c30d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:25.439137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e9e07-13b9-419c-a01c-d8668be0c30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:25.439408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e9e07-13b9-419c-a01c-d8668be0c30d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:25.440219 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e9e07-13b9-419c-a01c-d8668be0c30d admin admin] RBAC: Adding query filter params (scope.project.id=3f445e69c8094e37889545aefb002e28) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:22:25.440520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e9e07-13b9-419c-a01c-d8668be0c30d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:25.442703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e9e07-13b9-419c-a01c-d8668be0c30d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:25.451003 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 665/1329] 10.222.0.87 () {56 vars in 1231 bytes} [Fri Oct 29 01:22:25 2021] GET /identity/v3/role_assignments?scope.project.id=3f445e69c8094e37889545aefb002e28 => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:22:25.458486 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a865b0-c768-43f0-8820-a8fa3c6e14d2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:25.468235 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a865b0-c768-43f0-8820-a8fa3c6e14d2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:25.474039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ade54f-6295-41cd-a6ae-0b28f7b729a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:25.474897 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ade54f-6295-41cd-a6ae-0b28f7b729a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:25.475183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ade54f-6295-41cd-a6ae-0b28f7b729a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:25.475460 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ade54f-6295-41cd-a6ae-0b28f7b729a6 admin admin] PATH_INFO: `/v3/users/5644d459227e4d61a1311eb719e23975` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:25.476700 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ade54f-6295-41cd-a6ae-0b28f7b729a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=5644d459227e4d61a1311eb719e23975)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:25.478493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ade54f-6295-41cd-a6ae-0b28f7b729a6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:25.480121 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 665/1330] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:22:25 2021] GET /identity/v3/users/5644d459227e4d61a1311eb719e23975 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:25.486639 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e9e07-13b9-419c-a01c-d8668be0c30d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:25.496829 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e9e07-13b9-419c-a01c-d8668be0c30d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:25.501341 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4188df3-e7c5-4608-9eb0-5590d45f3be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:25.502182 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188df3-e7c5-4608-9eb0-5590d45f3be6 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:25.502457 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188df3-e7c5-4608-9eb0-5590d45f3be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:25.502723 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188df3-e7c5-4608-9eb0-5590d45f3be6 admin admin] PATH_INFO: `/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:25.516522 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4188df3-e7c5-4608-9eb0-5590d45f3be6 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ed740fcfd474bcb94f1482aedaeb9bd)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:25.518619 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4188df3-e7c5-4608-9eb0-5590d45f3be6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:25.521235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 666/1331] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:22:25 2021] GET /identity/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:27.882687 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9b782-0e24-4832-840d-4207eb89ff30 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:27.883188 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9b782-0e24-4832-840d-4207eb89ff30 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:27.883290 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9b782-0e24-4832-840d-4207eb89ff30 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:27.885037 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 666/1332] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:22:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:27.890916 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec25bff-44b4-4944-98a1-5c9146fa4e0a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:27.891334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec25bff-44b4-4944-98a1-5c9146fa4e0a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:27.891490 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec25bff-44b4-4944-98a1-5c9146fa4e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:27.909099 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-8ec25bff-44b4-4944-98a1-5c9146fa4e0a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:27.910460 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8ec25bff-44b4-4944-98a1-5c9146fa4e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:27.918200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 667/1333] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:22:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:27.942910 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9b782-0e24-4832-840d-4207eb89ff30 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:27.955192 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9b782-0e24-4832-840d-4207eb89ff30 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:27.960772 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc7f4d-1a0b-4f93-bd9b-a212ef15affd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:27.961604 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc7f4d-1a0b-4f93-bd9b-a212ef15affd admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:27.961883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc7f4d-1a0b-4f93-bd9b-a212ef15affd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:27.962156 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc7f4d-1a0b-4f93-bd9b-a212ef15affd admin admin] PATH_INFO: `/v3/projects/6cc18f9818ad4f228efabe4414127a40` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:27.973177 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc7f4d-1a0b-4f93-bd9b-a212ef15affd admin admin] RBAC: Authorizing `identity:get_project(project_id=6cc18f9818ad4f228efabe4414127a40)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:27.975293 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc7f4d-1a0b-4f93-bd9b-a212ef15affd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:27.977130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 667/1334] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:22:27 2021] GET /identity/v3/projects/6cc18f9818ad4f228efabe4414127a40 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:27.983861 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec25bff-44b4-4944-98a1-5c9146fa4e0a None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:27.993224 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec25bff-44b4-4944-98a1-5c9146fa4e0a None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:27.997706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924e50e-d4a5-4d8d-bf2b-f97639379ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:27.998341 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924e50e-d4a5-4d8d-bf2b-f97639379ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:27.998615 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924e50e-d4a5-4d8d-bf2b-f97639379ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:27.998882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924e50e-d4a5-4d8d-bf2b-f97639379ac2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:27.999643 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924e50e-d4a5-4d8d-bf2b-f97639379ac2 admin admin] RBAC: Adding query filter params (scope.project.id=6cc18f9818ad4f228efabe4414127a40) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:22:27.999971 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924e50e-d4a5-4d8d-bf2b-f97639379ac2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:28.001786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924e50e-d4a5-4d8d-bf2b-f97639379ac2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:28.007786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 668/1335] 10.222.0.87 () {56 vars in 1231 bytes} [Fri Oct 29 01:22:27 2021] GET /identity/v3/role_assignments?scope.project.id=6cc18f9818ad4f228efabe4414127a40 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:28.014118 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc7f4d-1a0b-4f93-bd9b-a212ef15affd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:28.024843 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc7f4d-1a0b-4f93-bd9b-a212ef15affd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:28.029344 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a4159-0b8d-41e8-9830-0cfaa98ebcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:28.030264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a4159-0b8d-41e8-9830-0cfaa98ebcce admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:28.030538 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a4159-0b8d-41e8-9830-0cfaa98ebcce admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:28.030807 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a4159-0b8d-41e8-9830-0cfaa98ebcce admin admin] PATH_INFO: `/v3/users/ed0d91f383d94e5f9ef0c62a21fcd7d4` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:28.044243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a4159-0b8d-41e8-9830-0cfaa98ebcce admin admin] RBAC: Authorizing `identity:get_user(user_id=ed0d91f383d94e5f9ef0c62a21fcd7d4)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:28.046353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a4159-0b8d-41e8-9830-0cfaa98ebcce admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:28.048023 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 668/1336] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:22:28 2021] GET /identity/v3/users/ed0d91f383d94e5f9ef0c62a21fcd7d4 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:30.351596 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de995e3d-2140-47d3-8c4d-7da45e5c5343 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:30.352191 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de995e3d-2140-47d3-8c4d-7da45e5c5343 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:30.352191 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de995e3d-2140-47d3-8c4d-7da45e5c5343 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:30.353998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 669/1337] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:22:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:30.359965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05b76-b30b-478e-8922-09e7bd64c4e1 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:30.360359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05b76-b30b-478e-8922-09e7bd64c4e1 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:30.360529 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05b76-b30b-478e-8922-09e7bd64c4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:30.379648 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-10f05b76-b30b-478e-8922-09e7bd64c4e1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:30.380897 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-10f05b76-b30b-478e-8922-09e7bd64c4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:30.388821 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 669/1338] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:22:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:30.414544 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de995e3d-2140-47d3-8c4d-7da45e5c5343 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:30.427745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de995e3d-2140-47d3-8c4d-7da45e5c5343 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:30.432137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde06e40-7f86-49c5-b362-00166c9dc008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:30.432966 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde06e40-7f86-49c5-b362-00166c9dc008 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:30.433241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde06e40-7f86-49c5-b362-00166c9dc008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:30.433510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde06e40-7f86-49c5-b362-00166c9dc008 admin admin] PATH_INFO: `/v3/projects/7c7e49aee6344a67a4231a44e2583090` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:30.445762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde06e40-7f86-49c5-b362-00166c9dc008 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c7e49aee6344a67a4231a44e2583090)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:30.447820 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde06e40-7f86-49c5-b362-00166c9dc008 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:30.449877 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 670/1339] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:22:30 2021] GET /identity/v3/projects/7c7e49aee6344a67a4231a44e2583090 => generated 312 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:30.457519 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05b76-b30b-478e-8922-09e7bd64c4e1 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:30.466592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05b76-b30b-478e-8922-09e7bd64c4e1 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:30.472466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243649d-f752-4f97-87f1-716e1501cad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:30.473262 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243649d-f752-4f97-87f1-716e1501cad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:30.473545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243649d-f752-4f97-87f1-716e1501cad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:30.473819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243649d-f752-4f97-87f1-716e1501cad3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:30.474594 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243649d-f752-4f97-87f1-716e1501cad3 admin admin] RBAC: Adding query filter params (scope.project.id=7c7e49aee6344a67a4231a44e2583090) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:22:30.474897 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243649d-f752-4f97-87f1-716e1501cad3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:30.476770 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243649d-f752-4f97-87f1-716e1501cad3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:30.482606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 670/1340] 10.222.0.87 () {56 vars in 1231 bytes} [Fri Oct 29 01:22:30 2021] GET /identity/v3/role_assignments?scope.project.id=7c7e49aee6344a67a4231a44e2583090 => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:30.489210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde06e40-7f86-49c5-b362-00166c9dc008 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:30.498894 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde06e40-7f86-49c5-b362-00166c9dc008 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:30.503518 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7acfb-312d-4ad8-b483-98a334d617c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:30.504398 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7acfb-312d-4ad8-b483-98a334d617c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:30.504674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7acfb-312d-4ad8-b483-98a334d617c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:30.504943 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7acfb-312d-4ad8-b483-98a334d617c0 admin admin] PATH_INFO: `/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:30.506746 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7acfb-312d-4ad8-b483-98a334d617c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ed740fcfd474bcb94f1482aedaeb9bd)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:30.508881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7acfb-312d-4ad8-b483-98a334d617c0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:30.510469 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 671/1341] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:22:30 2021] GET /identity/v3/users/3ed740fcfd474bcb94f1482aedaeb9bd => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:32.800247 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fa957-8a9c-4c04-8cd3-e541bded060d None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:32.801086 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fa957-8a9c-4c04-8cd3-e541bded060d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:32.801086 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fa957-8a9c-4c04-8cd3-e541bded060d None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:32.802600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 671/1342] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:22:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:32.809123 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e391ecd-38f8-4dc9-94d6-889f0153c00a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:32.809578 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e391ecd-38f8-4dc9-94d6-889f0153c00a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:32.809678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e391ecd-38f8-4dc9-94d6-889f0153c00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:32.828867 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-5e391ecd-38f8-4dc9-94d6-889f0153c00a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:32.830065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-5e391ecd-38f8-4dc9-94d6-889f0153c00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:32.840231 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 672/1343] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:22:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:32.864252 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fa957-8a9c-4c04-8cd3-e541bded060d None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:32.877147 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fa957-8a9c-4c04-8cd3-e541bded060d None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:32.881906 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38494a-10f2-4349-ba13-6dad1115e225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:32.882753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38494a-10f2-4349-ba13-6dad1115e225 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:32.883026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38494a-10f2-4349-ba13-6dad1115e225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:32.883295 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38494a-10f2-4349-ba13-6dad1115e225 admin admin] PATH_INFO: `/v3/projects/e704e7fbc18741659b80dd56204851de` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:32.895657 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38494a-10f2-4349-ba13-6dad1115e225 admin admin] RBAC: Authorizing `identity:get_project(project_id=e704e7fbc18741659b80dd56204851de)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:32.897796 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38494a-10f2-4349-ba13-6dad1115e225 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:32.899600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 672/1344] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:22:32 2021] GET /identity/v3/projects/e704e7fbc18741659b80dd56204851de => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:32.906438 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e391ecd-38f8-4dc9-94d6-889f0153c00a None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:32.916241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e391ecd-38f8-4dc9-94d6-889f0153c00a None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:32.920725 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18f182-fb34-4829-8e88-9b847b796b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:32.927108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18f182-fb34-4829-8e88-9b847b796b87 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:32.927108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18f182-fb34-4829-8e88-9b847b796b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:32.927108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18f182-fb34-4829-8e88-9b847b796b87 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:32.927108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18f182-fb34-4829-8e88-9b847b796b87 admin admin] RBAC: Adding query filter params (scope.project.id=e704e7fbc18741659b80dd56204851de) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:22:32.927108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18f182-fb34-4829-8e88-9b847b796b87 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:32.927108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18f182-fb34-4829-8e88-9b847b796b87 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:32.931706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 673/1345] 10.222.0.87 () {56 vars in 1231 bytes} [Fri Oct 29 01:22:32 2021] GET /identity/v3/role_assignments?scope.project.id=e704e7fbc18741659b80dd56204851de => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:22:32.938546 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38494a-10f2-4349-ba13-6dad1115e225 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:32.950597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38494a-10f2-4349-ba13-6dad1115e225 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:32.956623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620b2ee-0fea-4eae-9a22-f2dc5b8c98e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:32.957880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620b2ee-0fea-4eae-9a22-f2dc5b8c98e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:32.958260 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620b2ee-0fea-4eae-9a22-f2dc5b8c98e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:32.958626 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620b2ee-0fea-4eae-9a22-f2dc5b8c98e5 admin admin] PATH_INFO: `/v3/users/5644d459227e4d61a1311eb719e23975` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:32.960343 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620b2ee-0fea-4eae-9a22-f2dc5b8c98e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=5644d459227e4d61a1311eb719e23975)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:32.962139 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620b2ee-0fea-4eae-9a22-f2dc5b8c98e5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:32.963786 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 673/1346] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:22:32 2021] GET /identity/v3/users/5644d459227e4d61a1311eb719e23975 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:32.970448 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18f182-fb34-4829-8e88-9b847b796b87 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:32.981211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18f182-fb34-4829-8e88-9b847b796b87 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:32.985741 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d96b19-f583-41cc-b4c5-ccffab15fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:32.986580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d96b19-f583-41cc-b4c5-ccffab15fc9f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:32.986856 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d96b19-f583-41cc-b4c5-ccffab15fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:32.987117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d96b19-f583-41cc-b4c5-ccffab15fc9f admin admin] PATH_INFO: `/v3/users/e2664a2d309142219cd20e74e8066baa` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:33.000723 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d96b19-f583-41cc-b4c5-ccffab15fc9f admin admin] RBAC: Authorizing `identity:get_user(user_id=e2664a2d309142219cd20e74e8066baa)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:33.002864 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d96b19-f583-41cc-b4c5-ccffab15fc9f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:33.004538 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 674/1347] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:22:32 2021] GET /identity/v3/users/e2664a2d309142219cd20e74e8066baa => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:35.361432 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9783-b6f2-4871-b15f-e6b7cc26f879 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:35.362026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9783-b6f2-4871-b15f-e6b7cc26f879 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:35.362026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9783-b6f2-4871-b15f-e6b7cc26f879 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:35.364383 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 674/1348] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:22:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:35.370646 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdb2ad-e1dd-4e49-b35f-92a55f656b63 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:35.371127 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdb2ad-e1dd-4e49-b35f-92a55f656b63 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:35.371242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdb2ad-e1dd-4e49-b35f-92a55f656b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:35.388314 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-cecdb2ad-e1dd-4e49-b35f-92a55f656b63 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:35.389524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-cecdb2ad-e1dd-4e49-b35f-92a55f656b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:35.397364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 675/1349] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:22:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:35.421580 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a9783-b6f2-4871-b15f-e6b7cc26f879 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:35.434750 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a9783-b6f2-4871-b15f-e6b7cc26f879 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:35.439596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60baf135-a46d-44a2-bc49-64df0b96bd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:35.440076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baf135-a46d-44a2-bc49-64df0b96bd21 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:35.440363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baf135-a46d-44a2-bc49-64df0b96bd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:35.440639 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baf135-a46d-44a2-bc49-64df0b96bd21 admin admin] PATH_INFO: `/v3/projects/ffde9ad838444a8e935af4447dbb2e2e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:35.451671 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60baf135-a46d-44a2-bc49-64df0b96bd21 admin admin] RBAC: Authorizing `identity:get_project(project_id=ffde9ad838444a8e935af4447dbb2e2e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:35.453754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60baf135-a46d-44a2-bc49-64df0b96bd21 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:35.455514 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 675/1350] 10.222.0.87 () {56 vars in 1207 bytes} [Fri Oct 29 01:22:35 2021] GET /identity/v3/projects/ffde9ad838444a8e935af4447dbb2e2e => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:35.462724 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdb2ad-e1dd-4e49-b35f-92a55f656b63 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:35.472504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdb2ad-e1dd-4e49-b35f-92a55f656b63 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:35.477048 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c231346-b995-4e4e-83b0-e996335dd20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:35.477693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c231346-b995-4e4e-83b0-e996335dd20a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:35.477972 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c231346-b995-4e4e-83b0-e996335dd20a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:35.478243 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c231346-b995-4e4e-83b0-e996335dd20a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:35.479047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c231346-b995-4e4e-83b0-e996335dd20a admin admin] RBAC: Adding query filter params (scope.project.id=ffde9ad838444a8e935af4447dbb2e2e) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:22:35.479354 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c231346-b995-4e4e-83b0-e996335dd20a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:35.481214 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c231346-b995-4e4e-83b0-e996335dd20a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:35.486955 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 676/1351] 10.222.0.87 () {56 vars in 1231 bytes} [Fri Oct 29 01:22:35 2021] GET /identity/v3/role_assignments?scope.project.id=ffde9ad838444a8e935af4447dbb2e2e => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:35.494185 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60baf135-a46d-44a2-bc49-64df0b96bd21 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:35.503903 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60baf135-a46d-44a2-bc49-64df0b96bd21 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:35.508356 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14f161-15e4-480f-8da5-11a428d7115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:35.509205 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14f161-15e4-480f-8da5-11a428d7115b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:35.509540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14f161-15e4-480f-8da5-11a428d7115b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:35.509759 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14f161-15e4-480f-8da5-11a428d7115b admin admin] PATH_INFO: `/v3/users/67780d4a28e64630a7641273d43b85e2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:35.523433 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14f161-15e4-480f-8da5-11a428d7115b admin admin] RBAC: Authorizing `identity:get_user(user_id=67780d4a28e64630a7641273d43b85e2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:35.525590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14f161-15e4-480f-8da5-11a428d7115b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:35.527233 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 676/1352] 10.222.0.87 () {56 vars in 1198 bytes} [Fri Oct 29 01:22:35 2021] GET /identity/v3/users/67780d4a28e64630a7641273d43b85e2 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:22:40.855216 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef9c0f-abd7-4603-ac6c-9d141427089f None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:40.855823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef9c0f-abd7-4603-ac6c-9d141427089f None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:40.855823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef9c0f-abd7-4603-ac6c-9d141427089f None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:40.857547 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 677/1353] 10.222.0.87 () {54 vars in 918 bytes} [Fri Oct 29 01:22:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:40.864167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c70c4c-05a5-446e-899d-817beff1d483 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:40.864639 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c70c4c-05a5-446e-899d-817beff1d483 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:40.864752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c70c4c-05a5-446e-899d-817beff1d483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:40.886050 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-f7c70c4c-05a5-446e-899d-817beff1d483 None None] MFA Rules not processed for user `9aa303a60fec4ac5aaeb96c6618b387e`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:40.887256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-f7c70c4c-05a5-446e-899d-817beff1d483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:40.897013 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 677/1354] 10.222.0.87 () {58 vars in 1015 bytes} [Fri Oct 29 01:22:40 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:40.912822 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0517401-06ef-401b-824c-4580126ca38a None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:40.913106 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0517401-06ef-401b-824c-4580126ca38a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:40.913381 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0517401-06ef-401b-824c-4580126ca38a None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:40.915147 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 678/1355] 10.222.0.87 () {54 vars in 918 bytes} [Fri Oct 29 01:22:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:40.920374 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8a0d7-c107-465e-9eea-32e670c56477 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:40.920662 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8a0d7-c107-465e-9eea-32e670c56477 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:40.920941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8a0d7-c107-465e-9eea-32e670c56477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:40.939188 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-f8a8a0d7-c107-465e-9eea-32e670c56477 None None] MFA Rules not processed for user `28d331f2997547968c51fec87598420f`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:40.940921 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-f8a8a0d7-c107-465e-9eea-32e670c56477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:40.950483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 678/1356] 10.222.0.87 () {58 vars in 1015 bytes} [Fri Oct 29 01:22:40 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:43.896497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79d84b-11f5-4958-af27-9f4339534e22 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:43.897019 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79d84b-11f5-4958-af27-9f4339534e22 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:43.897019 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79d84b-11f5-4958-af27-9f4339534e22 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:43.898823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 679/1357] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:22:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:43.904827 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f858f88-29bc-49cf-baf9-b4f9280c04ce None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:43.905243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f858f88-29bc-49cf-baf9-b4f9280c04ce None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:43.905354 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f858f88-29bc-49cf-baf9-b4f9280c04ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:43.923040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-0f858f88-29bc-49cf-baf9-b4f9280c04ce None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:43.924888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0f858f88-29bc-49cf-baf9-b4f9280c04ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:43.932683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 679/1358] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:22:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:43.977598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79d84b-11f5-4958-af27-9f4339534e22 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:43.991875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79d84b-11f5-4958-af27-9f4339534e22 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:43.997186 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4fe1f-212f-407c-aab7-7d4148a44310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:43.997816 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4fe1f-212f-407c-aab7-7d4148a44310 service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:43.998094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4fe1f-212f-407c-aab7-7d4148a44310 service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:43.998363 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4fe1f-212f-407c-aab7-7d4148a44310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:44.006574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4fe1f-212f-407c-aab7-7d4148a44310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:44.008170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4fe1f-212f-407c-aab7-7d4148a44310 service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:44.017335 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 680/1359] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:22:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:45.539101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8de64-a985-4fba-9259-7b3f3a8ff546 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:45.539688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8de64-a985-4fba-9259-7b3f3a8ff546 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:45.539688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8de64-a985-4fba-9259-7b3f3a8ff546 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:45.541524 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 680/1360] 10.222.0.87 () {54 vars in 911 bytes} [Fri Oct 29 01:22:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:45.547022 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078fbd4-28a1-4c35-8814-c8edb7d742c3 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:45.547450 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078fbd4-28a1-4c35-8814-c8edb7d742c3 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:45.547627 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078fbd4-28a1-4c35-8814-c8edb7d742c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:45.564927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-2078fbd4-28a1-4c35-8814-c8edb7d742c3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:45.566112 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2078fbd4-28a1-4c35-8814-c8edb7d742c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:45.573661 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 681/1361] 10.222.0.87 () {58 vars in 1008 bytes} [Fri Oct 29 01:22:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:45.728349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8de64-a985-4fba-9259-7b3f3a8ff546 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:45.742538 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8de64-a985-4fba-9259-7b3f3a8ff546 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:45.747914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f083999-f59b-4cd9-a1eb-db09402d77d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:45.748551 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083999-f59b-4cd9-a1eb-db09402d77d0 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:45.748831 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083999-f59b-4cd9-a1eb-db09402d77d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:45.749098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083999-f59b-4cd9-a1eb-db09402d77d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:45.757141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f083999-f59b-4cd9-a1eb-db09402d77d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:45.758711 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f083999-f59b-4cd9-a1eb-db09402d77d0 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:45.767776 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 681/1362] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:22:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:47.241528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf581ed0-58be-46ea-b9a8-c61d325bcc97 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:47.242130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf581ed0-58be-46ea-b9a8-c61d325bcc97 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:47.242130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf581ed0-58be-46ea-b9a8-c61d325bcc97 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:47.243932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 682/1363] 10.222.0.87 () {54 vars in 911 bytes} [Fri Oct 29 01:22:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:47.249755 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb53d-acf1-4609-9c07-d731756a8c1c None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:47.250171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb53d-acf1-4609-9c07-d731756a8c1c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:47.250288 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb53d-acf1-4609-9c07-d731756a8c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:47.269048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-0a2fb53d-acf1-4609-9c07-d731756a8c1c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:47.270249 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0a2fb53d-acf1-4609-9c07-d731756a8c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:47.277972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 682/1364] 10.222.0.87 () {58 vars in 1008 bytes} [Fri Oct 29 01:22:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:22:47.432526 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf581ed0-58be-46ea-b9a8-c61d325bcc97 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:47.446421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf581ed0-58be-46ea-b9a8-c61d325bcc97 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:47.451986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169cb70-0d24-4fbb-a048-63efb219b53b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:47.452613 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169cb70-0d24-4fbb-a048-63efb219b53b service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:47.453180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169cb70-0d24-4fbb-a048-63efb219b53b service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:47.453459 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169cb70-0d24-4fbb-a048-63efb219b53b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:47.461960 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169cb70-0d24-4fbb-a048-63efb219b53b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:47.463516 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169cb70-0d24-4fbb-a048-63efb219b53b service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:47.473366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 683/1365] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:22:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:48.932459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b48be-5e13-4fcf-be09-db19ce035ad6 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:48.933047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b48be-5e13-4fcf-be09-db19ce035ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:48.933047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b48be-5e13-4fcf-be09-db19ce035ad6 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:48.934818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 683/1366] 10.222.0.87 () {54 vars in 911 bytes} [Fri Oct 29 01:22:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:48.940703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042966-8d10-443b-9300-5e1307d97c11 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:48.941107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042966-8d10-443b-9300-5e1307d97c11 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:48.941353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042966-8d10-443b-9300-5e1307d97c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:48.959310 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-44042966-8d10-443b-9300-5e1307d97c11 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:48.960511 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-44042966-8d10-443b-9300-5e1307d97c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:48.968047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 684/1367] 10.222.0.87 () {58 vars in 1008 bytes} [Fri Oct 29 01:22:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:49.122861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b48be-5e13-4fcf-be09-db19ce035ad6 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:49.143691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b48be-5e13-4fcf-be09-db19ce035ad6 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:49.143933 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb043b-0947-42c2-8f86-75fab992f356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:49.144544 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb043b-0947-42c2-8f86-75fab992f356 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:49.144827 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb043b-0947-42c2-8f86-75fab992f356 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:49.145099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb043b-0947-42c2-8f86-75fab992f356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:49.153689 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb043b-0947-42c2-8f86-75fab992f356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:49.155316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb043b-0947-42c2-8f86-75fab992f356 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:49.165007 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 684/1368] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:22:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:50.633423 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67514dd6-b581-4edd-a393-6b13cf8ca283 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:50.634006 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67514dd6-b581-4edd-a393-6b13cf8ca283 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:50.634006 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67514dd6-b581-4edd-a393-6b13cf8ca283 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:50.635825 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 685/1369] 10.222.0.87 () {54 vars in 911 bytes} [Fri Oct 29 01:22:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:50.641383 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312664cc-c553-483b-b426-f52b3a4e5022 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:50.641821 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312664cc-c553-483b-b426-f52b3a4e5022 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:50.641919 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312664cc-c553-483b-b426-f52b3a4e5022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:50.659654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-312664cc-c553-483b-b426-f52b3a4e5022 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:50.660862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-312664cc-c553-483b-b426-f52b3a4e5022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:50.668553 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 685/1370] 10.222.0.87 () {58 vars in 1008 bytes} [Fri Oct 29 01:22:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:50.822507 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67514dd6-b581-4edd-a393-6b13cf8ca283 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:50.836834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67514dd6-b581-4edd-a393-6b13cf8ca283 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:50.842057 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d755612-e12b-42f0-80eb-a6440def0017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:50.842683 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d755612-e12b-42f0-80eb-a6440def0017 service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:50.842963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d755612-e12b-42f0-80eb-a6440def0017 service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:50.843231 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d755612-e12b-42f0-80eb-a6440def0017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:50.851319 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d755612-e12b-42f0-80eb-a6440def0017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:50.852909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d755612-e12b-42f0-80eb-a6440def0017 service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:50.863013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 686/1371] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:22:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:52.330979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef585c-6853-403e-8682-c1224ed3ed66 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:52.331565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef585c-6853-403e-8682-c1224ed3ed66 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:52.331565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef585c-6853-403e-8682-c1224ed3ed66 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:52.333476 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 686/1372] 10.222.0.87 () {54 vars in 911 bytes} [Fri Oct 29 01:22:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:52.339221 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca5a1a-b5cc-4adf-9d76-eb0b50422a24 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:52.339787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca5a1a-b5cc-4adf-9d76-eb0b50422a24 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:52.339787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca5a1a-b5cc-4adf-9d76-eb0b50422a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:52.358075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-82ca5a1a-b5cc-4adf-9d76-eb0b50422a24 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:52.359263 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-82ca5a1a-b5cc-4adf-9d76-eb0b50422a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:52.367722 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 687/1373] 10.222.0.87 () {58 vars in 1008 bytes} [Fri Oct 29 01:22:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:22:52.522880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef585c-6853-403e-8682-c1224ed3ed66 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:52.537377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef585c-6853-403e-8682-c1224ed3ed66 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:52.542791 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4acd65-62ea-4582-948b-c6844d29e4b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:52.543449 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4acd65-62ea-4582-948b-c6844d29e4b9 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:52.543754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4acd65-62ea-4582-948b-c6844d29e4b9 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:52.544040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4acd65-62ea-4582-948b-c6844d29e4b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:52.553766 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4acd65-62ea-4582-948b-c6844d29e4b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:52.555372 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4acd65-62ea-4582-948b-c6844d29e4b9 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:52.566171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 687/1374] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:22:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:54.046650 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c2b4-f674-4294-a1e0-d98282afc428 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:54.047233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c2b4-f674-4294-a1e0-d98282afc428 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:54.047233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c2b4-f674-4294-a1e0-d98282afc428 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:54.049648 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 688/1375] 10.222.0.87 () {54 vars in 911 bytes} [Fri Oct 29 01:22:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:54.055385 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485afde4-60e8-4f50-9658-de08b7f4bdd7 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:54.055871 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485afde4-60e8-4f50-9658-de08b7f4bdd7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:54.055964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485afde4-60e8-4f50-9658-de08b7f4bdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:54.074531 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-485afde4-60e8-4f50-9658-de08b7f4bdd7 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:54.075755 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-485afde4-60e8-4f50-9658-de08b7f4bdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:54.083537 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 688/1376] 10.222.0.87 () {58 vars in 1008 bytes} [Fri Oct 29 01:22:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:54.238518 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188c2b4-f674-4294-a1e0-d98282afc428 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:54.253230 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188c2b4-f674-4294-a1e0-d98282afc428 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:54.258502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6ca44-5da5-4b59-be96-33b910f7ced0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:54.259127 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6ca44-5da5-4b59-be96-33b910f7ced0 service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:54.259402 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6ca44-5da5-4b59-be96-33b910f7ced0 service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:54.259674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6ca44-5da5-4b59-be96-33b910f7ced0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:54.268165 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6ca44-5da5-4b59-be96-33b910f7ced0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:54.269637 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6ca44-5da5-4b59-be96-33b910f7ced0 service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:54.278797 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 689/1377] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:22:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:55.768330 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbaa56f-b2b6-41d6-80b9-0613467fc1b7 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:55.768943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbaa56f-b2b6-41d6-80b9-0613467fc1b7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:55.768943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbaa56f-b2b6-41d6-80b9-0613467fc1b7 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:55.770686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 689/1378] 10.222.0.87 () {54 vars in 911 bytes} [Fri Oct 29 01:22:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:55.776422 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f453749-e162-4ed2-84c4-dab2dce9e15d None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:55.776848 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f453749-e162-4ed2-84c4-dab2dce9e15d None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:55.776960 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f453749-e162-4ed2-84c4-dab2dce9e15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:55.794896 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-8f453749-e162-4ed2-84c4-dab2dce9e15d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:55.796119 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8f453749-e162-4ed2-84c4-dab2dce9e15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:55.804582 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 690/1379] 10.222.0.87 () {58 vars in 1008 bytes} [Fri Oct 29 01:22:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:55.963895 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbaa56f-b2b6-41d6-80b9-0613467fc1b7 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:55.978001 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbaa56f-b2b6-41d6-80b9-0613467fc1b7 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:55.983376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7e660-7900-46fe-a7a7-dd8000bf6bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:55.984039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7e660-7900-46fe-a7a7-dd8000bf6bc1 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:55.984319 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7e660-7900-46fe-a7a7-dd8000bf6bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:55.984589 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7e660-7900-46fe-a7a7-dd8000bf6bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:55.993141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7e660-7900-46fe-a7a7-dd8000bf6bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:55.994712 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7e660-7900-46fe-a7a7-dd8000bf6bc1 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:56.005717 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 690/1380] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:22:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:57.508173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497c2a4-1f13-42aa-9d77-9ddb3fdd165e None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:57.508700 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497c2a4-1f13-42aa-9d77-9ddb3fdd165e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:57.508700 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497c2a4-1f13-42aa-9d77-9ddb3fdd165e None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:57.510409 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 691/1381] 10.222.0.87 () {54 vars in 911 bytes} [Fri Oct 29 01:22:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:57.515943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2831b-39b9-4eb2-9183-1c67820fad1f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:57.516336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2831b-39b9-4eb2-9183-1c67820fad1f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:57.516499 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2831b-39b9-4eb2-9183-1c67820fad1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:57.533935 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-0ab2831b-39b9-4eb2-9183-1c67820fad1f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:57.535404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0ab2831b-39b9-4eb2-9183-1c67820fad1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:57.543820 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 691/1382] 10.222.0.87 () {58 vars in 1008 bytes} [Fri Oct 29 01:22:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:57.696256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497c2a4-1f13-42aa-9d77-9ddb3fdd165e None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:57.711490 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497c2a4-1f13-42aa-9d77-9ddb3fdd165e None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:57.716839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409eeb6a-8fe9-4cf4-add9-8b4476784bb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:57.717469 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eeb6a-8fe9-4cf4-add9-8b4476784bb6 service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:57.717750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eeb6a-8fe9-4cf4-add9-8b4476784bb6 service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:57.718021 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eeb6a-8fe9-4cf4-add9-8b4476784bb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:57.727270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409eeb6a-8fe9-4cf4-add9-8b4476784bb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:57.728887 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409eeb6a-8fe9-4cf4-add9-8b4476784bb6 service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:57.738036 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 692/1383] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:22:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:59.884655 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67b07e-fa86-4871-864b-bb6109a47ccb None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:59.885101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67b07e-fa86-4871-864b-bb6109a47ccb None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:59.885224 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67b07e-fa86-4871-864b-bb6109a47ccb None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:59.887008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 692/1384] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:22:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:22:59.893093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30b85b-35e7-43af-84bf-15e0f4540617 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:59.893574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30b85b-35e7-43af-84bf-15e0f4540617 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:59.893674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30b85b-35e7-43af-84bf-15e0f4540617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:59.911032 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-4b30b85b-35e7-43af-84bf-15e0f4540617 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:22:59.912243 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4b30b85b-35e7-43af-84bf-15e0f4540617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:22:59.919852 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 693/1385] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:22:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:22:59.960730 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67b07e-fa86-4871-864b-bb6109a47ccb None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:22:59.971265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67b07e-fa86-4871-864b-bb6109a47ccb None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:22:59.974848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538f0b8-4b25-4a56-8970-dac35a9b77b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:22:59.975487 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538f0b8-4b25-4a56-8970-dac35a9b77b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:22:59.975797 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538f0b8-4b25-4a56-8970-dac35a9b77b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:22:59.976071 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538f0b8-4b25-4a56-8970-dac35a9b77b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:22:59.985189 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538f0b8-4b25-4a56-8970-dac35a9b77b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:22:59.987165 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538f0b8-4b25-4a56-8970-dac35a9b77b1 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:22:59.996660 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 693/1386] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:22:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:23:02.497669 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e51496-a5e7-4a47-8797-fa97f42154df None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:02.498256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e51496-a5e7-4a47-8797-fa97f42154df None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:02.498256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e51496-a5e7-4a47-8797-fa97f42154df None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:02.500009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 694/1387] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:02.506810 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474cec-4918-4948-b398-562fe8552ee7 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:02.507436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474cec-4918-4948-b398-562fe8552ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:02.507436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474cec-4918-4948-b398-562fe8552ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:02.526516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-89474cec-4918-4948-b398-562fe8552ee7 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:02.527704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-89474cec-4918-4948-b398-562fe8552ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:02.538619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 694/1388] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:23:02.579131 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e51496-a5e7-4a47-8797-fa97f42154df None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:02.590977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e51496-a5e7-4a47-8797-fa97f42154df None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:02.595291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5a3ae-9dbb-439c-a8cd-e596345dbf03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:02.596113 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5a3ae-9dbb-439c-a8cd-e596345dbf03 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:02.596390 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5a3ae-9dbb-439c-a8cd-e596345dbf03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:02.596659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5a3ae-9dbb-439c-a8cd-e596345dbf03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:02.606046 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5a3ae-9dbb-439c-a8cd-e596345dbf03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:02.607444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5a3ae-9dbb-439c-a8cd-e596345dbf03 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:02.617161 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 695/1389] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:23:05.293014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f847d-1eaf-4575-82fa-70025169f406 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:05.293630 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f847d-1eaf-4575-82fa-70025169f406 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:05.293630 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f847d-1eaf-4575-82fa-70025169f406 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:05.295367 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 695/1390] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:05.302464 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fcbe3-4649-426e-b37d-b6cee71072ed None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:05.303028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fcbe3-4649-426e-b37d-b6cee71072ed None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:05.303028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fcbe3-4649-426e-b37d-b6cee71072ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:05.321348 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-3f2fcbe3-4649-426e-b37d-b6cee71072ed None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:05.322559 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3f2fcbe3-4649-426e-b37d-b6cee71072ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:05.330758 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 696/1391] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:23:05.373019 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f847d-1eaf-4575-82fa-70025169f406 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:05.383816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f847d-1eaf-4575-82fa-70025169f406 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:05.387261 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71377650-5a25-49aa-a84a-e29adc1d0c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:05.387925 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71377650-5a25-49aa-a84a-e29adc1d0c0b service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:05.388203 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71377650-5a25-49aa-a84a-e29adc1d0c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:05.388470 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71377650-5a25-49aa-a84a-e29adc1d0c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:05.397575 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71377650-5a25-49aa-a84a-e29adc1d0c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:05.398945 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71377650-5a25-49aa-a84a-e29adc1d0c0b service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:05.408703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 696/1392] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:23:07.876769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7263a7-2958-436f-9cf2-3d9fe0ec38a2 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:07.877517 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7263a7-2958-436f-9cf2-3d9fe0ec38a2 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:07.877517 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7263a7-2958-436f-9cf2-3d9fe0ec38a2 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:07.879173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 697/1393] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:07.885490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef803f2-1c0b-4838-8c2a-3fd55a870fef None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:07.885914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef803f2-1c0b-4838-8c2a-3fd55a870fef None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:07.886027 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef803f2-1c0b-4838-8c2a-3fd55a870fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:07.904298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-2ef803f2-1c0b-4838-8c2a-3fd55a870fef None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:07.905491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-2ef803f2-1c0b-4838-8c2a-3fd55a870fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:07.913459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 697/1394] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:23:07.954080 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7263a7-2958-436f-9cf2-3d9fe0ec38a2 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:07.965368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7263a7-2958-436f-9cf2-3d9fe0ec38a2 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:07.969124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506c9a6-621e-4cfa-afc1-6c4920849460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:07.969840 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506c9a6-621e-4cfa-afc1-6c4920849460 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:07.970121 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506c9a6-621e-4cfa-afc1-6c4920849460 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:07.970394 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506c9a6-621e-4cfa-afc1-6c4920849460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:07.980815 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506c9a6-621e-4cfa-afc1-6c4920849460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:07.982222 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506c9a6-621e-4cfa-afc1-6c4920849460 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:07.991998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 698/1395] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:23:10.357956 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0f595-a805-47a5-b86b-97d66d824190 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:10.358521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0f595-a805-47a5-b86b-97d66d824190 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:10.358521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0f595-a805-47a5-b86b-97d66d824190 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:10.360404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 698/1396] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:10.367031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4c781-767a-4f93-be1c-a20366b20a07 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:10.367476 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4c781-767a-4f93-be1c-a20366b20a07 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:10.367590 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4c781-767a-4f93-be1c-a20366b20a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:10.385755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-f1d4c781-767a-4f93-be1c-a20366b20a07 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:10.386943 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-f1d4c781-767a-4f93-be1c-a20366b20a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:10.394753 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 699/1397] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:23:10.436815 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0f595-a805-47a5-b86b-97d66d824190 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:10.447293 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0f595-a805-47a5-b86b-97d66d824190 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:10.451068 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9af42-4e0f-4cf0-a77f-2d8331629074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:10.451700 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9af42-4e0f-4cf0-a77f-2d8331629074 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:10.452014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9af42-4e0f-4cf0-a77f-2d8331629074 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:10.452292 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9af42-4e0f-4cf0-a77f-2d8331629074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:10.462023 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9af42-4e0f-4cf0-a77f-2d8331629074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:10.463435 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9af42-4e0f-4cf0-a77f-2d8331629074 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:10.473555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 699/1398] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:23:12.811158 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ed3c3-c320-4ff4-891f-0ea6254535df None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:12.811775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ed3c3-c320-4ff4-891f-0ea6254535df None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:12.811775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ed3c3-c320-4ff4-891f-0ea6254535df None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:12.815968 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 700/1399] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:12 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:12.822254 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c724ece-29d8-4052-b76b-d477de7fb62d None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:12.822745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c724ece-29d8-4052-b76b-d477de7fb62d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:12.822846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c724ece-29d8-4052-b76b-d477de7fb62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:12.841712 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-0c724ece-29d8-4052-b76b-d477de7fb62d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:12.842919 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0c724ece-29d8-4052-b76b-d477de7fb62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:12.850787 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 700/1400] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:23:12.891084 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ed3c3-c320-4ff4-891f-0ea6254535df None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:12.907576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ed3c3-c320-4ff4-891f-0ea6254535df None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:12.907576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad4c0b-55ce-4498-97e8-42b2f693f876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:12.907576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad4c0b-55ce-4498-97e8-42b2f693f876 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:12.908038 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad4c0b-55ce-4498-97e8-42b2f693f876 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:12.908328 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad4c0b-55ce-4498-97e8-42b2f693f876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:12.918335 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad4c0b-55ce-4498-97e8-42b2f693f876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:12.919779 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad4c0b-55ce-4498-97e8-42b2f693f876 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:12.930041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 701/1401] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:23:15.269775 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dc32c-dd13-4c7c-923d-6c8859f34000 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:15.270362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dc32c-dd13-4c7c-923d-6c8859f34000 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:15.270362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dc32c-dd13-4c7c-923d-6c8859f34000 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:15.272132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 701/1402] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:15.278417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178f63f-812d-46e7-bd36-637103626532 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:15.278976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178f63f-812d-46e7-bd36-637103626532 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:15.278976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178f63f-812d-46e7-bd36-637103626532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:15.298682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-c178f63f-812d-46e7-bd36-637103626532 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:15.300172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c178f63f-812d-46e7-bd36-637103626532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:15.308198 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 702/1403] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:23:15.348339 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03dc32c-dd13-4c7c-923d-6c8859f34000 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:15.359122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03dc32c-dd13-4c7c-923d-6c8859f34000 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:15.363229 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb90d1-ae57-4d5b-9c4e-c21800e4927b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:15.363909 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb90d1-ae57-4d5b-9c4e-c21800e4927b service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:15.364186 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb90d1-ae57-4d5b-9c4e-c21800e4927b service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:15.364457 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb90d1-ae57-4d5b-9c4e-c21800e4927b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:15.373901 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb90d1-ae57-4d5b-9c4e-c21800e4927b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:15.375318 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb90d1-ae57-4d5b-9c4e-c21800e4927b service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:15.384521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 702/1404] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:23:17.720794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146273b-e51d-46de-8879-c5e71804d1fe None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:17.721399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146273b-e51d-46de-8879-c5e71804d1fe None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:17.721498 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146273b-e51d-46de-8879-c5e71804d1fe None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:17.723238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 703/1405] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:17.729458 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1de6d2-d465-4a93-9228-8de7953863ea None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:17.729919 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1de6d2-d465-4a93-9228-8de7953863ea None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:17.730019 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1de6d2-d465-4a93-9228-8de7953863ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:17.747168 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-4f1de6d2-d465-4a93-9228-8de7953863ea None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:17.748420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4f1de6d2-d465-4a93-9228-8de7953863ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:17.756224 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 703/1406] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:23:17.795870 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146273b-e51d-46de-8879-c5e71804d1fe None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:17.806417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146273b-e51d-46de-8879-c5e71804d1fe None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:17.809937 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def01f05-e383-4232-b850-3714b12d3ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:17.810563 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def01f05-e383-4232-b850-3714b12d3ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:17.810842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def01f05-e383-4232-b850-3714b12d3ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:17.811113 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def01f05-e383-4232-b850-3714b12d3ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:17.820201 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def01f05-e383-4232-b850-3714b12d3ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:17.821617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def01f05-e383-4232-b850-3714b12d3ce1 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:17.832053 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 704/1407] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:23:20.146485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fea94-e427-407e-ad1e-4d0f9deeb405 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:20.147046 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fea94-e427-407e-ad1e-4d0f9deeb405 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:20.147046 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fea94-e427-407e-ad1e-4d0f9deeb405 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:20.148743 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 704/1408] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:20.154914 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fca3e4-cf58-44d1-937a-0da0bc168157 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:20.155402 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fca3e4-cf58-44d1-937a-0da0bc168157 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:20.155507 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fca3e4-cf58-44d1-937a-0da0bc168157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:20.173905 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-15fca3e4-cf58-44d1-937a-0da0bc168157 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:20.175124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-15fca3e4-cf58-44d1-937a-0da0bc168157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:20.183218 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 705/1409] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:23:20.222170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fea94-e427-407e-ad1e-4d0f9deeb405 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:20.236110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fea94-e427-407e-ad1e-4d0f9deeb405 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:20.239940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01cc03-3b60-491d-ab25-0a82c8bdcc1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:20.241031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01cc03-3b60-491d-ab25-0a82c8bdcc1d service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:20.241031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01cc03-3b60-491d-ab25-0a82c8bdcc1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:20.241243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01cc03-3b60-491d-ab25-0a82c8bdcc1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:20.250972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01cc03-3b60-491d-ab25-0a82c8bdcc1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:20.252259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01cc03-3b60-491d-ab25-0a82c8bdcc1d service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:20.262125 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 705/1410] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:23:22.616967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5dca-c586-4065-ab4b-099e33fc1e2d None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:22.617518 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5dca-c586-4065-ab4b-099e33fc1e2d None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:22.617518 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5dca-c586-4065-ab4b-099e33fc1e2d None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:22.619296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 706/1411] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:22.625117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402be0fe-35c9-4464-979c-53b82e58e468 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:22.625501 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402be0fe-35c9-4464-979c-53b82e58e468 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:22.625794 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402be0fe-35c9-4464-979c-53b82e58e468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:22.643310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-402be0fe-35c9-4464-979c-53b82e58e468 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:22.644541 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-402be0fe-35c9-4464-979c-53b82e58e468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:22.652298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 706/1412] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:23:22.691247 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5dca-c586-4065-ab4b-099e33fc1e2d None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:22.701986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5dca-c586-4065-ab4b-099e33fc1e2d None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:22.705529 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8801e5-f7ef-4d03-9e93-df4d79895297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:22.706156 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8801e5-f7ef-4d03-9e93-df4d79895297 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:22.706431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8801e5-f7ef-4d03-9e93-df4d79895297 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:22.706698 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8801e5-f7ef-4d03-9e93-df4d79895297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:22.715853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8801e5-f7ef-4d03-9e93-df4d79895297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:22.717271 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8801e5-f7ef-4d03-9e93-df4d79895297 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:22.727031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 707/1413] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:23:40.059484 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489bdcc-c31c-49ab-80e6-127fe52cbb87 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:40.060146 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489bdcc-c31c-49ab-80e6-127fe52cbb87 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:40.060146 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489bdcc-c31c-49ab-80e6-127fe52cbb87 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:40.061830 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 707/1414] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:40.068088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d4cb6-041f-4592-8cae-e4a660c35985 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:40.068577 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d4cb6-041f-4592-8cae-e4a660c35985 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:40.068682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d4cb6-041f-4592-8cae-e4a660c35985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:40.087230 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-4d1d4cb6-041f-4592-8cae-e4a660c35985 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:40.088466 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4d1d4cb6-041f-4592-8cae-e4a660c35985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:40.097491 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 708/1415] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:23:40.149026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd95ed5-c102-4167-b006-d7abc51eb8b5 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:40.149313 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd95ed5-c102-4167-b006-d7abc51eb8b5 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:40.149590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd95ed5-c102-4167-b006-d7abc51eb8b5 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:40.151367 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 708/1416] 10.222.0.87 () {54 vars in 962 bytes} [Fri Oct 29 01:23:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:40.157010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42877-d049-4d0f-bab7-131c024918c6 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:40.157293 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42877-d049-4d0f-bab7-131c024918c6 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:40.157570 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42877-d049-4d0f-bab7-131c024918c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:40.176432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-fae42877-d049-4d0f-bab7-131c024918c6 None None] MFA Rules not processed for user `0998dd32ba8648cfb7f43797a9266d81`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:40.177634 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-fae42877-d049-4d0f-bab7-131c024918c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:40.184089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 709/1417] 10.222.0.87 () {58 vars in 1059 bytes} [Fri Oct 29 01:23:40 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:23:40.192693 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd95ed5-c102-4167-b006-d7abc51eb8b5 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:40.204661 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd95ed5-c102-4167-b006-d7abc51eb8b5 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:40.208200 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd145f42-7519-4123-80ba-b14c69156d6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0998dd32ba8648cfb7f43797a9266d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:40.208832 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd145f42-7519-4123-80ba-b14c69156d6d service glance] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:40.209110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd145f42-7519-4123-80ba-b14c69156d6d service glance] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:40.209381 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd145f42-7519-4123-80ba-b14c69156d6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:40.218544 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd145f42-7519-4123-80ba-b14c69156d6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:40.220572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd145f42-7519-4123-80ba-b14c69156d6d service glance] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:40.229696 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 709/1418] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:23:42.687944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f04a3c-5177-4e7c-bf4b-19246af8ca87 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:42.688519 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f04a3c-5177-4e7c-bf4b-19246af8ca87 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:42.688846 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f04a3c-5177-4e7c-bf4b-19246af8ca87 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:42.691702 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 710/1419] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:42.697768 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194fe20-51a4-43ae-9479-15d8cce970e1 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:42.698214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194fe20-51a4-43ae-9479-15d8cce970e1 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:42.698321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194fe20-51a4-43ae-9479-15d8cce970e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:42.716361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-f194fe20-51a4-43ae-9479-15d8cce970e1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:42.717583 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-f194fe20-51a4-43ae-9479-15d8cce970e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:42.726177 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 710/1420] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:23:42.749977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f04a3c-5177-4e7c-bf4b-19246af8ca87 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:42.762016 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f04a3c-5177-4e7c-bf4b-19246af8ca87 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:42.766909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a2682-dae6-4b5a-82b6-8fca23bb013f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:42.767532 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a2682-dae6-4b5a-82b6-8fca23bb013f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:42.767837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a2682-dae6-4b5a-82b6-8fca23bb013f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:42.768130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a2682-dae6-4b5a-82b6-8fca23bb013f admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:42.768883 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a2682-dae6-4b5a-82b6-8fca23bb013f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:42.770655 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a2682-dae6-4b5a-82b6-8fca23bb013f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:42.784398 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 711/1421] 10.222.0.87 () {56 vars in 1108 bytes} [Fri Oct 29 01:23:42 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:23:45.112002 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f80256-695b-46db-990d-4ebe894bb8a7 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:45.112649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f80256-695b-46db-990d-4ebe894bb8a7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:45.112649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f80256-695b-46db-990d-4ebe894bb8a7 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:45.114395 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 711/1422] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:45.120422 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3173f4c-d703-4ca3-8c4e-0821e2c3bb81 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:45.120933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3173f4c-d703-4ca3-8c4e-0821e2c3bb81 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:45.121052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3173f4c-d703-4ca3-8c4e-0821e2c3bb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:45.140859 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-c3173f4c-d703-4ca3-8c4e-0821e2c3bb81 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:45.140859 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c3173f4c-d703-4ca3-8c4e-0821e2c3bb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:45.147749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 712/1423] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:23:45.192485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f80256-695b-46db-990d-4ebe894bb8a7 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:45.207539 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f80256-695b-46db-990d-4ebe894bb8a7 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:45.212784 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fb588-cf69-4f9a-82f5-1be732aba325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:45.213424 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fb588-cf69-4f9a-82f5-1be732aba325 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:45.213701 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fb588-cf69-4f9a-82f5-1be732aba325 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:45.213970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fb588-cf69-4f9a-82f5-1be732aba325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:45.223739 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fb588-cf69-4f9a-82f5-1be732aba325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:45.225333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fb588-cf69-4f9a-82f5-1be732aba325 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:45.241083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 712/1424] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:23:47.688784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e2cb3-2024-4df0-a3a4-9c8b18b19364 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:47.689419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e2cb3-2024-4df0-a3a4-9c8b18b19364 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:47.689419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e2cb3-2024-4df0-a3a4-9c8b18b19364 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:47.691073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 713/1425] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:47.697041 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0170f-19ab-4778-afcb-7889847619d1 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:47.697532 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0170f-19ab-4778-afcb-7889847619d1 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:47.697645 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0170f-19ab-4778-afcb-7889847619d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:47.715830 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-6be0170f-19ab-4778-afcb-7889847619d1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:47.717036 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6be0170f-19ab-4778-afcb-7889847619d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:47.725464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 713/1426] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:23:47.764530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e2cb3-2024-4df0-a3a4-9c8b18b19364 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:47.775499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e2cb3-2024-4df0-a3a4-9c8b18b19364 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:47.778984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35818d4e-eafa-410c-aa14-cb37f785483c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:47.779612 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818d4e-eafa-410c-aa14-cb37f785483c service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:47.779928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818d4e-eafa-410c-aa14-cb37f785483c service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:47.780200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818d4e-eafa-410c-aa14-cb37f785483c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:47.789735 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35818d4e-eafa-410c-aa14-cb37f785483c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:47.791139 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35818d4e-eafa-410c-aa14-cb37f785483c service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:47.800774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 714/1427] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:23:50.136141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f1e14-32df-40cd-8332-41ce0609d19f None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:50.136652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f1e14-32df-40cd-8332-41ce0609d19f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:50.136652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f1e14-32df-40cd-8332-41ce0609d19f None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:50.138440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 714/1428] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:50.145284 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bb9b9-e34f-4850-9f4d-2a0e28963d2d None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:50.145764 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bb9b9-e34f-4850-9f4d-2a0e28963d2d None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:50.145862 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bb9b9-e34f-4850-9f4d-2a0e28963d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:50.163964 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-412bb9b9-e34f-4850-9f4d-2a0e28963d2d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:50.165153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-412bb9b9-e34f-4850-9f4d-2a0e28963d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:50.172965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 715/1429] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:23:50.212858 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f1e14-32df-40cd-8332-41ce0609d19f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:50.224229 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f1e14-32df-40cd-8332-41ce0609d19f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:50.227602 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b0574-0c88-4aa0-a8d1-22689311d531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:50.228303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b0574-0c88-4aa0-a8d1-22689311d531 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:50.228579 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b0574-0c88-4aa0-a8d1-22689311d531 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:50.228847 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b0574-0c88-4aa0-a8d1-22689311d531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:50.237838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b0574-0c88-4aa0-a8d1-22689311d531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:50.239259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b0574-0c88-4aa0-a8d1-22689311d531 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:50.248702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 715/1430] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:23:52.685831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804513c2-8777-4d95-a6ba-c031c7dc83e6 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:52.686419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804513c2-8777-4d95-a6ba-c031c7dc83e6 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:52.686419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804513c2-8777-4d95-a6ba-c031c7dc83e6 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:52.688386 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 716/1431] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:52.694456 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7b094-2672-4b49-868e-ab728886aa19 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:52.694907 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7b094-2672-4b49-868e-ab728886aa19 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:52.695036 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7b094-2672-4b49-868e-ab728886aa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:52.712751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-23b7b094-2672-4b49-868e-ab728886aa19 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:52.713941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-23b7b094-2672-4b49-868e-ab728886aa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:52.722587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 716/1432] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:23:52.764205 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804513c2-8777-4d95-a6ba-c031c7dc83e6 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:52.776009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804513c2-8777-4d95-a6ba-c031c7dc83e6 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:52.779502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c30acf-f29e-4f8f-960e-21fd01a4d80f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:52.780167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c30acf-f29e-4f8f-960e-21fd01a4d80f service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:52.780971 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c30acf-f29e-4f8f-960e-21fd01a4d80f service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:52.781309 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c30acf-f29e-4f8f-960e-21fd01a4d80f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:52.790056 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c30acf-f29e-4f8f-960e-21fd01a4d80f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:52.791461 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c30acf-f29e-4f8f-960e-21fd01a4d80f service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:52.800792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 717/1433] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:23:55.600992 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa3fce-9ce3-419c-a29b-072f814f246b None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:55.601562 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa3fce-9ce3-419c-a29b-072f814f246b None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:55.601562 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa3fce-9ce3-419c-a29b-072f814f246b None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:55.603293 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 717/1434] 10.222.0.87 () {54 vars in 926 bytes} [Fri Oct 29 01:23:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:23:55.609634 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0187051-0b45-4889-b704-7d0e4d5ef0eb None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:55.610050 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0187051-0b45-4889-b704-7d0e4d5ef0eb None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:55.610182 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0187051-0b45-4889-b704-7d0e4d5ef0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:55.628234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d0187051-0b45-4889-b704-7d0e4d5ef0eb None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:23:55.629433 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d0187051-0b45-4889-b704-7d0e4d5ef0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:23:55.637204 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 718/1435] 10.222.0.87 () {58 vars in 1023 bytes} [Fri Oct 29 01:23:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:23:55.678503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa3fce-9ce3-419c-a29b-072f814f246b None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:23:55.689830 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa3fce-9ce3-419c-a29b-072f814f246b None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:23:55.693324 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb37768-ec60-40c2-ba8c-ae2c9a45dbd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:23:55.693957 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb37768-ec60-40c2-ba8c-ae2c9a45dbd7 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:23:55.694234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb37768-ec60-40c2-ba8c-ae2c9a45dbd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:23:55.694503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb37768-ec60-40c2-ba8c-ae2c9a45dbd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:23:55.704427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb37768-ec60-40c2-ba8c-ae2c9a45dbd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:23:55.705842 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb37768-ec60-40c2-ba8c-ae2c9a45dbd7 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:23:55.714928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 718/1436] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:23:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:25:30.647567 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8c9fa-fff4-4395-aa9a-8083824385d6 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:30.648222 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8c9fa-fff4-4395-aa9a-8083824385d6 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:30.648222 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8c9fa-fff4-4395-aa9a-8083824385d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:30.666768 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-64e8c9fa-fff4-4395-aa9a-8083824385d6 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:25:30.668129 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-64e8c9fa-fff4-4395-aa9a-8083824385d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:25:30.677388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 719/1437] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:25:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:25:30.687234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556849c6-4f59-4c0b-9460-791d942cce7b None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:30.687951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556849c6-4f59-4c0b-9460-791d942cce7b None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:30.687951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556849c6-4f59-4c0b-9460-791d942cce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:30.706283 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-556849c6-4f59-4c0b-9460-791d942cce7b None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:25:30.707477 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-556849c6-4f59-4c0b-9460-791d942cce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:25:30.715260 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 719/1438] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:25:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:25:30.719924 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8c9fa-fff4-4395-aa9a-8083824385d6 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:25:30.730077 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8c9fa-fff4-4395-aa9a-8083824385d6 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:25:30.734600 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8463cec-491a-4011-a6a5-e7ed94e77d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:25:30.735250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463cec-491a-4011-a6a5-e7ed94e77d5f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:30.735537 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463cec-491a-4011-a6a5-e7ed94e77d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:30.735847 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463cec-491a-4011-a6a5-e7ed94e77d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:30.736586 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8463cec-491a-4011-a6a5-e7ed94e77d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:25:30.736891 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8463cec-491a-4011-a6a5-e7ed94e77d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:25:30.738464 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8463cec-491a-4011-a6a5-e7ed94e77d5f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:25:30.752166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 720/1439] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:25:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:25:30.760104 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556849c6-4f59-4c0b-9460-791d942cce7b None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:25:30.769954 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556849c6-4f59-4c0b-9460-791d942cce7b None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:25:30.774484 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144bd73-18fd-41c8-8f70-70e07f74bd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:25:30.775133 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144bd73-18fd-41c8-8f70-70e07f74bd15 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:30.775417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144bd73-18fd-41c8-8f70-70e07f74bd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:30.775692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144bd73-18fd-41c8-8f70-70e07f74bd15 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:30.776548 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144bd73-18fd-41c8-8f70-70e07f74bd15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:25:30.778427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144bd73-18fd-41c8-8f70-70e07f74bd15 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:25:30.880586 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 720/1440] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:25:30 2021] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:25:30.884896 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8463cec-491a-4011-a6a5-e7ed94e77d5f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:25:30.895932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8463cec-491a-4011-a6a5-e7ed94e77d5f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:25:30.952997 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ab6af-5f32-4077-9bf3-3d98dda950f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:25:30.953575 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ab6af-5f32-4077-9bf3-3d98dda950f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:30.953855 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ab6af-5f32-4077-9bf3-3d98dda950f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:30.954127 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ab6af-5f32-4077-9bf3-3d98dda950f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:30.954830 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ab6af-5f32-4077-9bf3-3d98dda950f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:25:30.956760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ab6af-5f32-4077-9bf3-3d98dda950f8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:25:31.050279 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 721/1441] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:25:30 2021] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:25:31.054454 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144bd73-18fd-41c8-8f70-70e07f74bd15 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:25:31.066443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144bd73-18fd-41c8-8f70-70e07f74bd15 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:25:31.071291 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88606e81-b5ea-4700-be5a-0d07e6812468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:25:31.079800 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88606e81-b5ea-4700-be5a-0d07e6812468 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:31.079800 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88606e81-b5ea-4700-be5a-0d07e6812468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:31.079800 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88606e81-b5ea-4700-be5a-0d07e6812468 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:31.079800 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88606e81-b5ea-4700-be5a-0d07e6812468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:25:31.079800 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88606e81-b5ea-4700-be5a-0d07e6812468 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:25:31.090160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 721/1442] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:25:31 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:25:31.094228 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ab6af-5f32-4077-9bf3-3d98dda950f8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:25:31.104775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ab6af-5f32-4077-9bf3-3d98dda950f8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:25:31.109280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a7e5b-0703-45e8-a4ae-f852f5ff1bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:25:31.109935 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a7e5b-0703-45e8-a4ae-f852f5ff1bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:31.110219 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a7e5b-0703-45e8-a4ae-f852f5ff1bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:31.110488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a7e5b-0703-45e8-a4ae-f852f5ff1bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:31.111225 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a7e5b-0703-45e8-a4ae-f852f5ff1bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:25:31.112836 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a7e5b-0703-45e8-a4ae-f852f5ff1bf3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:25:31.127549 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 722/1443] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:25:31 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:25:31.131720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88606e81-b5ea-4700-be5a-0d07e6812468 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:25:31.141831 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88606e81-b5ea-4700-be5a-0d07e6812468 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:25:31.146435 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f20a0-d5f4-41d6-9aef-a3a9cd886e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:25:31.147449 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f20a0-d5f4-41d6-9aef-a3a9cd886e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:31.147753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f20a0-d5f4-41d6-9aef-a3a9cd886e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:31.148044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f20a0-d5f4-41d6-9aef-a3a9cd886e2f admin admin] PATH_INFO: `/v3/projects/48e629b768bb441b9d6d4ec58bb98591/users/2255100a24bb4353b34ceb090bd0c1a4/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:31.162892 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f20a0-d5f4-41d6-9aef-a3a9cd886e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e629b768bb441b9d6d4ec58bb98591, user_id=2255100a24bb4353b34ceb090bd0c1a4, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:25:31.171907 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f20a0-d5f4-41d6-9aef-a3a9cd886e2f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:25:31.273042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 722/1444] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:25:31 2021] PUT /identity/v3/projects/48e629b768bb441b9d6d4ec58bb98591/users/2255100a24bb4353b34ceb090bd0c1a4/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:25:31.286388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94115b6-0f75-405c-a365-0c00b58bbf33 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:31.286704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94115b6-0f75-405c-a365-0c00b58bbf33 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:31.286993 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94115b6-0f75-405c-a365-0c00b58bbf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:31.314195 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d94115b6-0f75-405c-a365-0c00b58bbf33 None None] MFA Rules not processed for user `2255100a24bb4353b34ceb090bd0c1a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:25:31.315411 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d94115b6-0f75-405c-a365-0c00b58bbf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:25:31.384865 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 723/1445] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:25:31 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:25:31.396773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f20a0-d5f4-41d6-9aef-a3a9cd886e2f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:25:31.466350 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f20a0-d5f4-41d6-9aef-a3a9cd886e2f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:25:31.471799 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c3307-62c4-423e-a86f-9ec0425a463b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:25:31.472450 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c3307-62c4-423e-a86f-9ec0425a463b service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:31.472736 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c3307-62c4-423e-a86f-9ec0425a463b service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:31.473011 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c3307-62c4-423e-a86f-9ec0425a463b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:31.481550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c3307-62c4-423e-a86f-9ec0425a463b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:25:31.483227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c3307-62c4-423e-a86f-9ec0425a463b service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:25:31.492043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 723/1446] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:25:31 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:25:31.565840 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecd7da-ff0d-441c-a422-1dad4eb89f71 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:31.566127 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecd7da-ff0d-441c-a422-1dad4eb89f71 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:31.566402 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecd7da-ff0d-441c-a422-1dad4eb89f71 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:31.568291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 724/1447] 10.222.0.87 () {52 vars in 829 bytes} [Fri Oct 29 01:25:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:25:31.571766 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c3307-62c4-423e-a86f-9ec0425a463b service nova] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:25:31.712832 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c3307-62c4-423e-a86f-9ec0425a463b service nova] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:25:31.722436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:25:31.722436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:31.722436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:31.722436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] PATH_INFO: `/v3/users/2255100a24bb4353b34ceb090bd0c1a4` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:31.722907 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2255100a24bb4353b34ceb090bd0c1a4)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:25:31.723756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:25:31.723756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:25:31.723756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:25:31.725812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:25:31.894131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2255100a24bb4353b34ceb090bd0c1a4'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:25:31.894784 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2255100a24bb4353b34ceb090bd0c1a4'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:25:31.915006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2255100a24bb4353b34ceb090bd0c1a4'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:25:31.926878 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2255100a24bb4353b34ceb090bd0c1a4'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:25:31.969899 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2255100a24bb4353b34ceb090bd0c1a4'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:25:31.977082 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 724/1448] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:25:31 2021] DELETE /identity/v3/users/2255100a24bb4353b34ceb090bd0c1a4 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:25:31.981682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666828e-7f7a-48da-8c44-7237c57efa38 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:31.982190 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666828e-7f7a-48da-8c44-7237c57efa38 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:31.982298 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666828e-7f7a-48da-8c44-7237c57efa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:32.000323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-2666828e-7f7a-48da-8c44-7237c57efa38 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:25:32.001528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2666828e-7f7a-48da-8c44-7237c57efa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:25:32.058895 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 725/1449] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:25:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:25:32.068824 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:25:32.070218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:25:32.126221 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cea49-1b91-4705-89c7-b95bf97e7923 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:25:32.129604 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aafa2f-8ea7-4efd-94c9-c38e58b5a42c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:25:32.130258 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafa2f-8ea7-4efd-94c9-c38e58b5a42c service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:32.130542 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafa2f-8ea7-4efd-94c9-c38e58b5a42c service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:32.130811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafa2f-8ea7-4efd-94c9-c38e58b5a42c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:32.140695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aafa2f-8ea7-4efd-94c9-c38e58b5a42c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:25:32.142126 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aafa2f-8ea7-4efd-94c9-c38e58b5a42c service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:25:32.151754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 725/1450] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:25:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:25:32.726267 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666828e-7f7a-48da-8c44-7237c57efa38 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:25:32.727719 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2666828e-7f7a-48da-8c44-7237c57efa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:25:32.742069 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666828e-7f7a-48da-8c44-7237c57efa38 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:25:32.745591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac348b-1493-4663-8dea-34234c858e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:25:32.746187 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac348b-1493-4663-8dea-34234c858e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:25:32.746475 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac348b-1493-4663-8dea-34234c858e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:25:32.746752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac348b-1493-4663-8dea-34234c858e77 admin admin] PATH_INFO: `/v3/projects/48e629b768bb441b9d6d4ec58bb98591` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:25:32.748035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac348b-1493-4663-8dea-34234c858e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e629b768bb441b9d6d4ec58bb98591)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:25:32.749053 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-abac348b-1493-4663-8dea-34234c858e77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:25:32.749053 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:25:32.749053 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:25:32.750263 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac348b-1493-4663-8dea-34234c858e77 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:25:32.898260 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-abac348b-1493-4663-8dea-34234c858e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e629b768bb441b9d6d4ec58bb98591', 'request_id': 'req-abac348b-1493-4663-8dea-34234c858e77'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:25:32.974002 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-abac348b-1493-4663-8dea-34234c858e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e629b768bb441b9d6d4ec58bb98591', 'request_id': 'req-abac348b-1493-4663-8dea-34234c858e77'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:25:32.981226 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-abac348b-1493-4663-8dea-34234c858e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e629b768bb441b9d6d4ec58bb98591', 'request_id': 'req-abac348b-1493-4663-8dea-34234c858e77'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:25:32.999839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-abac348b-1493-4663-8dea-34234c858e77 admin admin] The token cache is being invalidate because project 48e629b768bb441b9d6d4ec58bb98591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:25:33.000456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-abac348b-1493-4663-8dea-34234c858e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:25:33.005598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-abac348b-1493-4663-8dea-34234c858e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:25:33.005598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 726/1451] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:25:32 2021] DELETE /identity/v3/projects/48e629b768bb441b9d6d4ec58bb98591 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:27:05.939353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6abcc-e72a-4126-9ba3-fe4942908555 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:05.940010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6abcc-e72a-4126-9ba3-fe4942908555 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:05.940010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6abcc-e72a-4126-9ba3-fe4942908555 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:05.941806 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 726/1452] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 29 01:27:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:27:05.949185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e4fdd-39a2-4ea3-a3af-d3181db240ab None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:05.949953 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e4fdd-39a2-4ea3-a3af-d3181db240ab None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:05.950055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e4fdd-39a2-4ea3-a3af-d3181db240ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:05.970817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-1c5e4fdd-39a2-4ea3-a3af-d3181db240ab None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:27:05.972203 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-1c5e4fdd-39a2-4ea3-a3af-d3181db240ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:06.041445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 727/1453] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 29 01:27:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:27:06.219544 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6abcc-e72a-4126-9ba3-fe4942908555 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:27:06.221181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-ece6abcc-e72a-4126-9ba3-fe4942908555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:06.310573 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70b8e4-e9d9-4685-97d7-f2cc7298296e None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:06.311039 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70b8e4-e9d9-4685-97d7-f2cc7298296e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:06.311373 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70b8e4-e9d9-4685-97d7-f2cc7298296e None None] PATH_INFO: `/v3` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:06.313265 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 728/1454] 10.222.0.83 () {54 vars in 925 bytes} [Fri Oct 29 01:27:06 2021] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:27:06.321711 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd349e-621b-4473-8d60-d5af63e1be32 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:06.322078 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd349e-621b-4473-8d60-d5af63e1be32 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:06.322261 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd349e-621b-4473-8d60-d5af63e1be32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:06.326629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6abcc-e72a-4126-9ba3-fe4942908555 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:27:06.333015 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b0e6c-7792-473d-bd7b-3e6985acd924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:27:06.333694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b0e6c-7792-473d-bd7b-3e6985acd924 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:06.333977 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b0e6c-7792-473d-bd7b-3e6985acd924 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:06.334258 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b0e6c-7792-473d-bd7b-3e6985acd924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:06.342436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-5afd349e-621b-4473-8d60-d5af63e1be32 None None] MFA Rules not processed for user `9aa303a60fec4ac5aaeb96c6618b387e`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:27:06.343690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-5afd349e-621b-4473-8d60-d5af63e1be32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:06.344221 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b0e6c-7792-473d-bd7b-3e6985acd924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:27:06.345898 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b0e6c-7792-473d-bd7b-3e6985acd924 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:27:06.356780 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 727/1455] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:27:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:27:06.412492 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 729/1456] 10.222.0.83 () {58 vars in 1015 bytes} [Fri Oct 29 01:27:06 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:27:07.805752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826838d-de42-4cbf-9539-19421439f38d None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:07.806373 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826838d-de42-4cbf-9539-19421439f38d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:07.806373 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826838d-de42-4cbf-9539-19421439f38d None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:07.808217 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 728/1457] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 29 01:27:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:27:07.813560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878941a-fa66-4311-ab5c-c9631a0a8dad None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:07.814025 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878941a-fa66-4311-ab5c-c9631a0a8dad None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:07.814136 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878941a-fa66-4311-ab5c-c9631a0a8dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:07.832920 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-4878941a-fa66-4311-ab5c-c9631a0a8dad None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:27:07.834135 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4878941a-fa66-4311-ab5c-c9631a0a8dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:07.842762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 730/1458] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 29 01:27:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:27:07.997992 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826838d-de42-4cbf-9539-19421439f38d None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:27:08.013786 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826838d-de42-4cbf-9539-19421439f38d None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:27:08.019143 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5396052-5cf3-4eaa-8e4b-e1536e2b3e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:27:08.019846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5396052-5cf3-4eaa-8e4b-e1536e2b3e5e service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:08.020132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5396052-5cf3-4eaa-8e4b-e1536e2b3e5e service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:08.020405 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5396052-5cf3-4eaa-8e4b-e1536e2b3e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:08.029308 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5396052-5cf3-4eaa-8e4b-e1536e2b3e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:27:08.030877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5396052-5cf3-4eaa-8e4b-e1536e2b3e5e service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:27:08.040553 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 729/1459] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:27:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:27:10.453896 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7541e92-9078-4d7a-8a6f-732c24f96b0a None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:10.454412 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7541e92-9078-4d7a-8a6f-732c24f96b0a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:10.454527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7541e92-9078-4d7a-8a6f-732c24f96b0a None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:10.456291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 731/1460] 10.222.0.87 () {54 vars in 960 bytes} [Fri Oct 29 01:27:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:27:10.462336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9ba3-7b7f-48e5-81e1-3b569a213c0d None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:10.462812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9ba3-7b7f-48e5-81e1-3b569a213c0d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:10.463030 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9ba3-7b7f-48e5-81e1-3b569a213c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:10.481843 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-298b9ba3-7b7f-48e5-81e1-3b569a213c0d None None] MFA Rules not processed for user `9aa303a60fec4ac5aaeb96c6618b387e`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:27:10.483050 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-298b9ba3-7b7f-48e5-81e1-3b569a213c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:10.491537 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 730/1461] 10.222.0.87 () {58 vars in 1057 bytes} [Fri Oct 29 01:27:10 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:27:10.499553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7541e92-9078-4d7a-8a6f-732c24f96b0a None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:27:10.512773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7541e92-9078-4d7a-8a6f-732c24f96b0a None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:27:10.517962 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ef25f-0d83-40e6-b819-e9d146d4bb17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa303a60fec4ac5aaeb96c6618b387e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:27:10.521536 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ef25f-0d83-40e6-b819-e9d146d4bb17 service placement] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:10.521536 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ef25f-0d83-40e6-b819-e9d146d4bb17 service placement] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:10.521536 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ef25f-0d83-40e6-b819-e9d146d4bb17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:10.527853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ef25f-0d83-40e6-b819-e9d146d4bb17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:27:10.529421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ef25f-0d83-40e6-b819-e9d146d4bb17 service placement] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:27:10.538903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 732/1462] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:27:10 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:27:19.967319 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4d88-b667-46c1-801c-622e9b99017a None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:19.967928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4d88-b667-46c1-801c-622e9b99017a None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:19.967928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4d88-b667-46c1-801c-622e9b99017a None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:19.969853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 731/1463] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 29 01:27:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:27:19.975239 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7834-8168-46d2-8fab-1f460a7edc6e None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:19.975651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7834-8168-46d2-8fab-1f460a7edc6e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:19.975817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7834-8168-46d2-8fab-1f460a7edc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:19.993261 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ddee7834-8168-46d2-8fab-1f460a7edc6e None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:27:19.994445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ddee7834-8168-46d2-8fab-1f460a7edc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:20.002730 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 733/1464] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 29 01:27:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:27:20.157464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b4d88-b667-46c1-801c-622e9b99017a None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:27:20.172597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b4d88-b667-46c1-801c-622e9b99017a None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:27:20.178010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c64d3-6f23-4b3e-b0fb-cb4f1f9b460b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:27:20.178645 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c64d3-6f23-4b3e-b0fb-cb4f1f9b460b service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:20.178932 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c64d3-6f23-4b3e-b0fb-cb4f1f9b460b service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:20.179279 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c64d3-6f23-4b3e-b0fb-cb4f1f9b460b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:20.187619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c64d3-6f23-4b3e-b0fb-cb4f1f9b460b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:27:20.189267 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c64d3-6f23-4b3e-b0fb-cb4f1f9b460b service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:27:20.198966 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 732/1465] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:27:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:27:21.630939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966c983-f144-40a0-9764-f6287fae8a16 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:21.631550 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966c983-f144-40a0-9764-f6287fae8a16 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:21.631550 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966c983-f144-40a0-9764-f6287fae8a16 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:21.633410 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 734/1466] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 29 01:27:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:27:21.639497 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a9197-51d6-430d-83f4-808bbbfb10b2 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:21.639976 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a9197-51d6-430d-83f4-808bbbfb10b2 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:21.640085 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a9197-51d6-430d-83f4-808bbbfb10b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:21.657715 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-e56a9197-51d6-430d-83f4-808bbbfb10b2 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:27:21.658897 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e56a9197-51d6-430d-83f4-808bbbfb10b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:21.666798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 733/1467] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 29 01:27:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:27:21.819996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966c983-f144-40a0-9764-f6287fae8a16 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:27:21.835012 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966c983-f144-40a0-9764-f6287fae8a16 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:27:21.841129 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a22bb1-876f-4a25-b697-cb3415b8e592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:27:21.841750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a22bb1-876f-4a25-b697-cb3415b8e592 service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:21.842030 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a22bb1-876f-4a25-b697-cb3415b8e592 service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:21.842304 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a22bb1-876f-4a25-b697-cb3415b8e592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:21.850163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a22bb1-876f-4a25-b697-cb3415b8e592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:27:21.851712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a22bb1-876f-4a25-b697-cb3415b8e592 service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:27:21.861340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 735/1468] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:27:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:27:26.336894 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff241502-7512-47ce-93fc-4a09bc625fb4 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:26.337511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff241502-7512-47ce-93fc-4a09bc625fb4 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:26.337511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff241502-7512-47ce-93fc-4a09bc625fb4 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:26.339480 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 734/1469] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 29 01:27:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:27:26.345524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c1d4e-c6d5-45e7-865e-da11329830e4 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:26.357826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c1d4e-c6d5-45e7-865e-da11329830e4 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:26.357826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c1d4e-c6d5-45e7-865e-da11329830e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:26.364365 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ae6c1d4e-c6d5-45e7-865e-da11329830e4 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:27:26.365560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ae6c1d4e-c6d5-45e7-865e-da11329830e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:26.374176 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 736/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 29 01:27:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:27:26.416535 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff241502-7512-47ce-93fc-4a09bc625fb4 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:27:26.418790 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-ff241502-7512-47ce-93fc-4a09bc625fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:26.473682 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff241502-7512-47ce-93fc-4a09bc625fb4 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:27:26.477271 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c5d43-dfd8-4c03-a2a7-602ec20cc239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:27:26.477909 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c5d43-dfd8-4c03-a2a7-602ec20cc239 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:26.478191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c5d43-dfd8-4c03-a2a7-602ec20cc239 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:26.478468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c5d43-dfd8-4c03-a2a7-602ec20cc239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:26.488135 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c5d43-dfd8-4c03-a2a7-602ec20cc239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:27:26.489579 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c5d43-dfd8-4c03-a2a7-602ec20cc239 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:27:26.499368 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 735/1471] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:27:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:27:28.753872 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c1537-1264-4269-945b-becec2ef885b None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:28.754529 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c1537-1264-4269-945b-becec2ef885b None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:28.754529 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c1537-1264-4269-945b-becec2ef885b None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:28.756194 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 737/1472] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 29 01:27:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:27:28.762555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a4dc8-a89b-4767-b891-979942dc318d None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:28.762990 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a4dc8-a89b-4767-b891-979942dc318d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:28.763093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a4dc8-a89b-4767-b891-979942dc318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:28.782961 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-9c1a4dc8-a89b-4767-b891-979942dc318d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:27:28.784183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-9c1a4dc8-a89b-4767-b891-979942dc318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:28.791858 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 736/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 29 01:27:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:27:28.832133 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c1537-1264-4269-945b-becec2ef885b None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:27:28.833925 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-059c1537-1264-4269-945b-becec2ef885b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:28.847223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c1537-1264-4269-945b-becec2ef885b None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:27:28.850759 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674e286-b879-48b9-8613-3ce7bde2b8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:27:28.851378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674e286-b879-48b9-8613-3ce7bde2b8fc service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:28.851655 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674e286-b879-48b9-8613-3ce7bde2b8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:28.851955 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674e286-b879-48b9-8613-3ce7bde2b8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:28.861493 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674e286-b879-48b9-8613-3ce7bde2b8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:27:28.862899 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674e286-b879-48b9-8613-3ce7bde2b8fc service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:27:28.872721 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 738/1474] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:27:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:27:32.957211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c249e-d2ac-4f0e-a8b8-07d274fedd13 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:32.957680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c249e-d2ac-4f0e-a8b8-07d274fedd13 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:32.957787 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c249e-d2ac-4f0e-a8b8-07d274fedd13 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:32.959591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 737/1475] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 29 01:27:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:27:32.965517 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdd932-f382-4e8f-8c5c-4e795370b92b None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:32.965991 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdd932-f382-4e8f-8c5c-4e795370b92b None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:32.966109 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdd932-f382-4e8f-8c5c-4e795370b92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:32.984407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-b3cdd932-f382-4e8f-8c5c-4e795370b92b None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:27:32.985598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b3cdd932-f382-4e8f-8c5c-4e795370b92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:32.993268 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 739/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 29 01:27:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:27:33.046021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c249e-d2ac-4f0e-a8b8-07d274fedd13 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:27:33.047836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a58c249e-d2ac-4f0e-a8b8-07d274fedd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:33.103011 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c249e-d2ac-4f0e-a8b8-07d274fedd13 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:27:33.107349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500ce28-8fc2-42a3-b4cd-51d842e0a186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:27:33.108022 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500ce28-8fc2-42a3-b4cd-51d842e0a186 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:33.108303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500ce28-8fc2-42a3-b4cd-51d842e0a186 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:33.108576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500ce28-8fc2-42a3-b4cd-51d842e0a186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:33.117294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500ce28-8fc2-42a3-b4cd-51d842e0a186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:27:33.118705 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500ce28-8fc2-42a3-b4cd-51d842e0a186 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:27:33.128503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 738/1477] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:27:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:27:35.401913 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2e097-7434-4eef-be03-c2e9f7948127 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:35.402480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2e097-7434-4eef-be03-c2e9f7948127 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:35.402480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2e097-7434-4eef-be03-c2e9f7948127 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:35.404308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 740/1478] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 29 01:27:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:27:35.410211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7816b-ffee-4d83-86c5-55738822a9cd None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:35.410633 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7816b-ffee-4d83-86c5-55738822a9cd None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:35.410796 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7816b-ffee-4d83-86c5-55738822a9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:35.428514 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-37f7816b-ffee-4d83-86c5-55738822a9cd None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:27:35.429727 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-37f7816b-ffee-4d83-86c5-55738822a9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:35.438039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 739/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 29 01:27:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:27:35.489575 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7b4a5-7ba8-42b6-9833-323e13f66517 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:35.489863 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7b4a5-7ba8-42b6-9833-323e13f66517 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:35.490136 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7b4a5-7ba8-42b6-9833-323e13f66517 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:35.491982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 741/1480] 10.222.0.87 () {54 vars in 962 bytes} [Fri Oct 29 01:27:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:27:35.498217 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33667313-7526-43f6-ba86-bf7d3166d283 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:35.498498 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33667313-7526-43f6-ba86-bf7d3166d283 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:35.498770 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33667313-7526-43f6-ba86-bf7d3166d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:35.516622 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-33667313-7526-43f6-ba86-bf7d3166d283 None None] MFA Rules not processed for user `c6be4b7bef21492bad49e6b5a284f4f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:27:35.517804 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-33667313-7526-43f6-ba86-bf7d3166d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:27:35.524244 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 740/1481] 10.222.0.87 () {58 vars in 1059 bytes} [Fri Oct 29 01:27:35 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:27:35.532894 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7b4a5-7ba8-42b6-9833-323e13f66517 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:27:35.543241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7b4a5-7ba8-42b6-9833-323e13f66517 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:27:35.547396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbb9e7-d0e2-46b3-9436-b646e6750d32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:27:35.548055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb9e7-d0e2-46b3-9436-b646e6750d32 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:27:35.548336 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb9e7-d0e2-46b3-9436-b646e6750d32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:27:35.548613 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb9e7-d0e2-46b3-9436-b646e6750d32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:27:35.557448 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbb9e7-d0e2-46b3-9436-b646e6750d32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:27:35.558869 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbb9e7-d0e2-46b3-9436-b646e6750d32 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:27:35.568215 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 742/1482] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:27:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:28:57.509920 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7610a08-1850-4964-ab94-f4301f03a8d3 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:57.510961 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7610a08-1850-4964-ab94-f4301f03a8d3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:57.511460 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7610a08-1850-4964-ab94-f4301f03a8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:57.536818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-e7610a08-1850-4964-ab94-f4301f03a8d3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:57.538410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e7610a08-1850-4964-ab94-f4301f03a8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:57.550713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 741/1483] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:57.559612 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c262fa-35d3-436e-b301-0b04f3b585d9 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:57.560183 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c262fa-35d3-436e-b301-0b04f3b585d9 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:57.560183 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c262fa-35d3-436e-b301-0b04f3b585d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:57.586872 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-b2c262fa-35d3-436e-b301-0b04f3b585d9 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:57.588115 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b2c262fa-35d3-436e-b301-0b04f3b585d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:57.601817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 743/1484] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:57.606752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7610a08-1850-4964-ab94-f4301f03a8d3 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:57.621122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7610a08-1850-4964-ab94-f4301f03a8d3 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:57.627938 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb658a-0d04-45f1-ad54-cd6d8d8e4277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:57.628937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb658a-0d04-45f1-ad54-cd6d8d8e4277 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:57.629622 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb658a-0d04-45f1-ad54-cd6d8d8e4277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:57.630398 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb658a-0d04-45f1-ad54-cd6d8d8e4277 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:57.631365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb658a-0d04-45f1-ad54-cd6d8d8e4277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:28:57.635953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb658a-0d04-45f1-ad54-cd6d8d8e4277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:57.637839 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb658a-0d04-45f1-ad54-cd6d8d8e4277 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:57.651703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 742/1485] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:28:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:28:57.660429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c262fa-35d3-436e-b301-0b04f3b585d9 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:57.670422 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c262fa-35d3-436e-b301-0b04f3b585d9 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:57.679308 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14980fe6-b552-4578-9dc9-6a8588a2a1a2 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:57.679604 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14980fe6-b552-4578-9dc9-6a8588a2a1a2 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:57.679899 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14980fe6-b552-4578-9dc9-6a8588a2a1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:57.688203 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68efad-42e0-46e0-94a6-f2a49698e2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:57.688917 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68efad-42e0-46e0-94a6-f2a49698e2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:57.689192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68efad-42e0-46e0-94a6-f2a49698e2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:57.689460 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68efad-42e0-46e0-94a6-f2a49698e2d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:57.690167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68efad-42e0-46e0-94a6-f2a49698e2d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:57.692439 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68efad-42e0-46e0-94a6-f2a49698e2d6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:57.715771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-14980fe6-b552-4578-9dc9-6a8588a2a1a2 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:57.716970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-14980fe6-b552-4578-9dc9-6a8588a2a1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:57.735918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 743/1486] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:57.753219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62341d35-b583-4108-bdfe-382bafe23f5f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:57.755891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62341d35-b583-4108-bdfe-382bafe23f5f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:57.756179 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62341d35-b583-4108-bdfe-382bafe23f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:57.783908 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-62341d35-b583-4108-bdfe-382bafe23f5f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:57.786026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-62341d35-b583-4108-bdfe-382bafe23f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:57.799560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 744/1487] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:28:57.801469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40db62-7917-4540-8eba-c3456e6cf1a3 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:57.801983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40db62-7917-4540-8eba-c3456e6cf1a3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:57.802459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40db62-7917-4540-8eba-c3456e6cf1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:57.834656 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 744/1488] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:28:57 2021] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:57.836136 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06afa2-9cda-4074-9612-e49e872d3c67 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:57.836266 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-1f40db62-7917-4540-8eba-c3456e6cf1a3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:57.836435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06afa2-9cda-4074-9612-e49e872d3c67 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:57.836679 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06afa2-9cda-4074-9612-e49e872d3c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:57.838179 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1f40db62-7917-4540-8eba-c3456e6cf1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:57.873480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-8b06afa2-9cda-4074-9612-e49e872d3c67 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:57.876638 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8b06afa2-9cda-4074-9612-e49e872d3c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:57.934226 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 745/1489] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:57.935959 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2ff8-7b55-40ca-8b14-087f085ba4fa None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:57.936484 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2ff8-7b55-40ca-8b14-087f085ba4fa None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:57.937155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2ff8-7b55-40ca-8b14-087f085ba4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:57.959819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-1b7a2ff8-7b55-40ca-8b14-087f085ba4fa None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:57.959819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1b7a2ff8-7b55-40ca-8b14-087f085ba4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:57.964621 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 745/1490] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:57.967928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 746/1491] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:57.969322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac1ed3-6ca6-4eb3-bcbd-bfa629b484cb None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:57.969609 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac1ed3-6ca6-4eb3-bcbd-bfa629b484cb None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:57.969880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac1ed3-6ca6-4eb3-bcbd-bfa629b484cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:57.972208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06afa2-9cda-4074-9612-e49e872d3c67 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:57.982233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06afa2-9cda-4074-9612-e49e872d3c67 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:57.986895 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71c982-1668-4030-bf05-de4c0414f611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:57.987555 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71c982-1668-4030-bf05-de4c0414f611 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:57.987903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71c982-1668-4030-bf05-de4c0414f611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:57.988172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71c982-1668-4030-bf05-de4c0414f611 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:57.988868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71c982-1668-4030-bf05-de4c0414f611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:57.989029 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-31ac1ed3-6ca6-4eb3-bcbd-bfa629b484cb None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:57.990194 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-31ac1ed3-6ca6-4eb3-bcbd-bfa629b484cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:57.990755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71c982-1668-4030-bf05-de4c0414f611 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:57.997932 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 747/1492] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:57.999154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad7520-107f-4eac-a9a6-9ef5f78f8bc3 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:57.999439 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad7520-107f-4eac-a9a6-9ef5f78f8bc3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.000013 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad7520-107f-4eac-a9a6-9ef5f78f8bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.017503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-3cad7520-107f-4eac-a9a6-9ef5f78f8bc3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:58.018682 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3cad7520-107f-4eac-a9a6-9ef5f78f8bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:58.027073 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 748/1493] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:58.028325 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cedb9-e8b5-4a81-ad79-50280feb9834 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.028607 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cedb9-e8b5-4a81-ad79-50280feb9834 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.028910 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cedb9-e8b5-4a81-ad79-50280feb9834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.046337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-0c5cedb9-e8b5-4a81-ad79-50280feb9834 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:58.047440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0c5cedb9-e8b5-4a81-ad79-50280feb9834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:58.055414 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 749/1494] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:58.056208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cedb9-e8b5-4a81-ad79-50280feb9834 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.067065 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cedb9-e8b5-4a81-ad79-50280feb9834 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.068106 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 746/1495] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:28:57 2021] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:58.068802 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71c982-1668-4030-bf05-de4c0414f611 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.072081 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2b15c-086b-49bc-a616-fbd66a7a2381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.074914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2b15c-086b-49bc-a616-fbd66a7a2381 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.074914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2b15c-086b-49bc-a616-fbd66a7a2381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.074914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2b15c-086b-49bc-a616-fbd66a7a2381 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.074914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2b15c-086b-49bc-a616-fbd66a7a2381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:28:58.074914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2b15c-086b-49bc-a616-fbd66a7a2381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.076205 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2b15c-086b-49bc-a616-fbd66a7a2381 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.078862 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71c982-1668-4030-bf05-de4c0414f611 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.084444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959736f1-dfb9-4509-8bf5-65ad55933cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.085078 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959736f1-dfb9-4509-8bf5-65ad55933cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.085358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959736f1-dfb9-4509-8bf5-65ad55933cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.085627 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959736f1-dfb9-4509-8bf5-65ad55933cc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.086351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959736f1-dfb9-4509-8bf5-65ad55933cc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:28:58.086653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959736f1-dfb9-4509-8bf5-65ad55933cc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.088286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959736f1-dfb9-4509-8bf5-65ad55933cc2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.089316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 750/1496] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:28:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:28:58.093332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006755f-8276-4833-993f-37a3e2df35b6 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.096493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006755f-8276-4833-993f-37a3e2df35b6 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.096493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006755f-8276-4833-993f-37a3e2df35b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.107527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 747/1497] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:28:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:28:58.107527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f071e89-9591-4b26-8fcf-b5d7dcfad90e None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.107527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f071e89-9591-4b26-8fcf-b5d7dcfad90e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.107527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f071e89-9591-4b26-8fcf-b5d7dcfad90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.116596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-6006755f-8276-4833-993f-37a3e2df35b6 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:58.117856 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6006755f-8276-4833-993f-37a3e2df35b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:58.119076 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-4f071e89-9591-4b26-8fcf-b5d7dcfad90e None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:58.120282 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4f071e89-9591-4b26-8fcf-b5d7dcfad90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:58.128233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 748/1498] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:58.135820 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 751/1499] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:58.135973 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9b4d9-aa87-49b5-a8d6-50949ce86acd None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.136077 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e827f-6862-458a-871c-a415826cc6f3 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.136165 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9b4d9-aa87-49b5-a8d6-50949ce86acd None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.136257 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e827f-6862-458a-871c-a415826cc6f3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.136340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9b4d9-aa87-49b5-a8d6-50949ce86acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.136426 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e827f-6862-458a-871c-a415826cc6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.152300 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-88b9b4d9-aa87-49b5-a8d6-50949ce86acd None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:58.153582 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-060e827f-6862-458a-871c-a415826cc6f3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:58.153712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-88b9b4d9-aa87-49b5-a8d6-50949ce86acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:58.154887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-060e827f-6862-458a-871c-a415826cc6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:58.165387 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 749/1500] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:58.165387 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525d342-1b2a-4dcc-aa3e-6af8e61aea27 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.165626 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 752/1501] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:58.165724 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525d342-1b2a-4dcc-aa3e-6af8e61aea27 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.165724 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525d342-1b2a-4dcc-aa3e-6af8e61aea27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.165876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e827f-6862-458a-871c-a415826cc6f3 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.174258 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e827f-6862-458a-871c-a415826cc6f3 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.179420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166da55-fd55-452a-af2f-97460076d5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.180106 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166da55-fd55-452a-af2f-97460076d5fc admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.180390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166da55-fd55-452a-af2f-97460076d5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.180661 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166da55-fd55-452a-af2f-97460076d5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.181407 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166da55-fd55-452a-af2f-97460076d5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.183001 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166da55-fd55-452a-af2f-97460076d5fc admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.183201 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-8525d342-1b2a-4dcc-aa3e-6af8e61aea27 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:58.184377 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8525d342-1b2a-4dcc-aa3e-6af8e61aea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:58.192975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 750/1502] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:58.193544 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525d342-1b2a-4dcc-aa3e-6af8e61aea27 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.196720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 753/1503] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:28:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:28:58.196720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166da55-fd55-452a-af2f-97460076d5fc admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.204439 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166da55-fd55-452a-af2f-97460076d5fc admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.205720 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525d342-1b2a-4dcc-aa3e-6af8e61aea27 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.209296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8700ba8-f5c0-4b2b-8eaf-69d0b718665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.209997 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8700ba8-f5c0-4b2b-8eaf-69d0b718665e admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.210227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8700ba8-f5c0-4b2b-8eaf-69d0b718665e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.210506 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8700ba8-f5c0-4b2b-8eaf-69d0b718665e admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.210697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ae064-ebf6-4885-9bbb-8864dd9235f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.211155 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ae064-ebf6-4885-9bbb-8864dd9235f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.211340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8700ba8-f5c0-4b2b-8eaf-69d0b718665e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.211446 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ae064-ebf6-4885-9bbb-8864dd9235f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.211697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ae064-ebf6-4885-9bbb-8864dd9235f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.212418 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ae064-ebf6-4885-9bbb-8864dd9235f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.213117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8700ba8-f5c0-4b2b-8eaf-69d0b718665e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.214270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ae064-ebf6-4885-9bbb-8864dd9235f6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.344540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 754/1504] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:28:58 2021] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:58.345300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8700ba8-f5c0-4b2b-8eaf-69d0b718665e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.403462 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 751/1505] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:28:58 2021] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:58.403462 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c58ef-8677-4402-9041-1af88d4904e9 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.403462 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c58ef-8677-4402-9041-1af88d4904e9 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.403462 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c58ef-8677-4402-9041-1af88d4904e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.405595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8700ba8-f5c0-4b2b-8eaf-69d0b718665e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.421133 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-5e0c58ef-8677-4402-9041-1af88d4904e9 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:58.422429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-5e0c58ef-8677-4402-9041-1af88d4904e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:58.462379 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdac772-1b4a-4e00-9d17-b430309cc3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.463046 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdac772-1b4a-4e00-9d17-b430309cc3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.463327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdac772-1b4a-4e00-9d17-b430309cc3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.463624 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdac772-1b4a-4e00-9d17-b430309cc3bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.464409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdac772-1b4a-4e00-9d17-b430309cc3bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:28:58.464738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdac772-1b4a-4e00-9d17-b430309cc3bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.466327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdac772-1b4a-4e00-9d17-b430309cc3bf admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.477949 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 755/1506] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:28:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:28:58.478751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdac772-1b4a-4e00-9d17-b430309cc3bf admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.480921 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 752/1507] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:58.481758 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c58ef-8677-4402-9041-1af88d4904e9 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.494470 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdac772-1b4a-4e00-9d17-b430309cc3bf admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.494677 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c58ef-8677-4402-9041-1af88d4904e9 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.499019 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a74ca4-e2e2-4056-9b0f-2c183e8fe7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.499664 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a74ca4-e2e2-4056-9b0f-2c183e8fe7ec admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.499968 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48431f95-2ee3-4a6c-a49d-d65aeaa557ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.500086 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a74ca4-e2e2-4056-9b0f-2c183e8fe7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.500241 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a74ca4-e2e2-4056-9b0f-2c183e8fe7ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.500710 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48431f95-2ee3-4a6c-a49d-d65aeaa557ca admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.500964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a74ca4-e2e2-4056-9b0f-2c183e8fe7ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:28:58.501075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48431f95-2ee3-4a6c-a49d-d65aeaa557ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.501256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48431f95-2ee3-4a6c-a49d-d65aeaa557ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.501363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a74ca4-e2e2-4056-9b0f-2c183e8fe7ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.501987 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48431f95-2ee3-4a6c-a49d-d65aeaa557ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:28:58.502313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48431f95-2ee3-4a6c-a49d-d65aeaa557ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.502819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a74ca4-e2e2-4056-9b0f-2c183e8fe7ec admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.505110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48431f95-2ee3-4a6c-a49d-d65aeaa557ca admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.515631 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 756/1508] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:28:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:28:58.516609 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 753/1509] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:28:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:28:58.517119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a74ca4-e2e2-4056-9b0f-2c183e8fe7ec admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.517229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48431f95-2ee3-4a6c-a49d-d65aeaa557ca admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.528079 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a74ca4-e2e2-4056-9b0f-2c183e8fe7ec admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.528295 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48431f95-2ee3-4a6c-a49d-d65aeaa557ca admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.533152 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897897f-9c5c-46bb-8f98-b9d3d987948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.533309 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a9ba0-cabc-482d-9660-3d35c7f6ecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.533816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897897f-9c5c-46bb-8f98-b9d3d987948b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.533957 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a9ba0-cabc-482d-9660-3d35c7f6ecc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.534170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897897f-9c5c-46bb-8f98-b9d3d987948b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.534281 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a9ba0-cabc-482d-9660-3d35c7f6ecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.534376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897897f-9c5c-46bb-8f98-b9d3d987948b admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.534668 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a9ba0-cabc-482d-9660-3d35c7f6ecc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.535138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897897f-9c5c-46bb-8f98-b9d3d987948b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.535809 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a9ba0-cabc-482d-9660-3d35c7f6ecc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:28:58.536118 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a9ba0-cabc-482d-9660-3d35c7f6ecc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.536744 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897897f-9c5c-46bb-8f98-b9d3d987948b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.537678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a9ba0-cabc-482d-9660-3d35c7f6ecc8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.546743 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 757/1510] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:28:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:28:58.547564 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897897f-9c5c-46bb-8f98-b9d3d987948b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.556390 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 754/1511] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:28:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:28:58.556390 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a9ba0-cabc-482d-9660-3d35c7f6ecc8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.557401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897897f-9c5c-46bb-8f98-b9d3d987948b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.560397 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a9ba0-cabc-482d-9660-3d35c7f6ecc8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.562383 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a260a-ee12-4fc6-9d15-1cc18155717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.563037 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a260a-ee12-4fc6-9d15-1cc18155717c admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.563312 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a260a-ee12-4fc6-9d15-1cc18155717c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.563582 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a260a-ee12-4fc6-9d15-1cc18155717c admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.564331 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a260a-ee12-4fc6-9d15-1cc18155717c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.565355 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee8056-46f7-4510-ade9-ec696d887e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.566618 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee8056-46f7-4510-ade9-ec696d887e76 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.566751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a260a-ee12-4fc6-9d15-1cc18155717c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.566893 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee8056-46f7-4510-ade9-ec696d887e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.567357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee8056-46f7-4510-ade9-ec696d887e76 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.568087 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee8056-46f7-4510-ade9-ec696d887e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.569982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee8056-46f7-4510-ade9-ec696d887e76 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.684388 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 758/1512] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:28:58 2021] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:58.685195 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a260a-ee12-4fc6-9d15-1cc18155717c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.694957 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a260a-ee12-4fc6-9d15-1cc18155717c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.700060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42909e7-f4e1-4c8c-908f-7590ac0e57bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.700699 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42909e7-f4e1-4c8c-908f-7590ac0e57bc admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.700978 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42909e7-f4e1-4c8c-908f-7590ac0e57bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.701248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42909e7-f4e1-4c8c-908f-7590ac0e57bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.701971 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42909e7-f4e1-4c8c-908f-7590ac0e57bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:28:58.702323 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42909e7-f4e1-4c8c-908f-7590ac0e57bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.703948 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42909e7-f4e1-4c8c-908f-7590ac0e57bc admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.714076 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 755/1513] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:28:58 2021] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:58.715192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee8056-46f7-4510-ade9-ec696d887e76 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.717003 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 759/1514] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:28:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:28:58.718053 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42909e7-f4e1-4c8c-908f-7590ac0e57bc admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.728055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee8056-46f7-4510-ade9-ec696d887e76 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.729176 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42909e7-f4e1-4c8c-908f-7590ac0e57bc admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.732882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8052f13-0c18-442d-92dc-11c629ca7bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.733531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8052f13-0c18-442d-92dc-11c629ca7bee admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.733705 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd786c7-536f-4167-ab41-9cd35ed64343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.733853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8052f13-0c18-442d-92dc-11c629ca7bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.734073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8052f13-0c18-442d-92dc-11c629ca7bee admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.734334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd786c7-536f-4167-ab41-9cd35ed64343 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.734612 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd786c7-536f-4167-ab41-9cd35ed64343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.734814 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8052f13-0c18-442d-92dc-11c629ca7bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.734916 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd786c7-536f-4167-ab41-9cd35ed64343 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.735561 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd786c7-536f-4167-ab41-9cd35ed64343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.736853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8052f13-0c18-442d-92dc-11c629ca7bee admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.740637 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd786c7-536f-4167-ab41-9cd35ed64343 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.841392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 756/1515] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:28:58 2021] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:58.842537 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8052f13-0c18-442d-92dc-11c629ca7bee admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.859983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 760/1516] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:28:58 2021] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:58.859983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd786c7-536f-4167-ab41-9cd35ed64343 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:58.906801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8052f13-0c18-442d-92dc-11c629ca7bee admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.925745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd786c7-536f-4167-ab41-9cd35ed64343 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:58.930537 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b9e7a-f371-4f1d-9442-c5a2aa2d6f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.931416 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b9e7a-f371-4f1d-9442-c5a2aa2d6f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.931693 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b9e7a-f371-4f1d-9442-c5a2aa2d6f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.931994 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b9e7a-f371-4f1d-9442-c5a2aa2d6f16 admin admin] PATH_INFO: `/v3/projects/5a5b0bd4a6574488a9735c09f46d000f/users/ea9114bcc3504d1788fba123a1d4b0a1/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.946799 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b9e7a-f371-4f1d-9442-c5a2aa2d6f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5b0bd4a6574488a9735c09f46d000f, user_id=ea9114bcc3504d1788fba123a1d4b0a1, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.949801 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b9e7a-f371-4f1d-9442-c5a2aa2d6f16 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:58.963567 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a43fea-40af-4a23-ba1a-e9b278c9dcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:58.968659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43fea-40af-4a23-ba1a-e9b278c9dcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:58.968659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43fea-40af-4a23-ba1a-e9b278c9dcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:58.968659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43fea-40af-4a23-ba1a-e9b278c9dcc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:58.968659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a43fea-40af-4a23-ba1a-e9b278c9dcc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:58.968659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a43fea-40af-4a23-ba1a-e9b278c9dcc7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.090467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 761/1517] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:28:58 2021] PUT /identity/v3/projects/5a5b0bd4a6574488a9735c09f46d000f/users/ea9114bcc3504d1788fba123a1d4b0a1/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:28:59.091295 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b9e7a-f371-4f1d-9442-c5a2aa2d6f16 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.150136 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b9e7a-f371-4f1d-9442-c5a2aa2d6f16 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.155085 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77463218-b707-4081-8128-9513c8ba23e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.155771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77463218-b707-4081-8128-9513c8ba23e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.169871 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77463218-b707-4081-8128-9513c8ba23e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.169871 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77463218-b707-4081-8128-9513c8ba23e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.169871 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77463218-b707-4081-8128-9513c8ba23e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.169871 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77463218-b707-4081-8128-9513c8ba23e1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.170292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 757/1518] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:28:58 2021] POST /identity/v3/projects => generated 377 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:59.170292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a43fea-40af-4a23-ba1a-e9b278c9dcc7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.225642 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a43fea-40af-4a23-ba1a-e9b278c9dcc7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.230253 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72961b-33a4-4a94-91c7-75fc90ef9091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.231823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72961b-33a4-4a94-91c7-75fc90ef9091 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.231823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72961b-33a4-4a94-91c7-75fc90ef9091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.231823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72961b-33a4-4a94-91c7-75fc90ef9091 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.232234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72961b-33a4-4a94-91c7-75fc90ef9091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.233848 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72961b-33a4-4a94-91c7-75fc90ef9091 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.244418 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 758/1519] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:28:59 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:28:59.245238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72961b-33a4-4a94-91c7-75fc90ef9091 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.255641 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72961b-33a4-4a94-91c7-75fc90ef9091 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.260816 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d16537-4e02-4489-a271-d7e9b7140ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.266614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d16537-4e02-4489-a271-d7e9b7140ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.266614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d16537-4e02-4489-a271-d7e9b7140ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.266614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d16537-4e02-4489-a271-d7e9b7140ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.266614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d16537-4e02-4489-a271-d7e9b7140ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.266614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d16537-4e02-4489-a271-d7e9b7140ae5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.275611 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 759/1520] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:28:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:28:59.276483 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d16537-4e02-4489-a271-d7e9b7140ae5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.286213 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d16537-4e02-4489-a271-d7e9b7140ae5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.290950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d72324-82d4-46e4-bf5f-ab97654295d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.291572 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d72324-82d4-46e4-bf5f-ab97654295d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.291883 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d72324-82d4-46e4-bf5f-ab97654295d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.292160 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d72324-82d4-46e4-bf5f-ab97654295d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.292845 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d72324-82d4-46e4-bf5f-ab97654295d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.294722 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d72324-82d4-46e4-bf5f-ab97654295d9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.325795 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 762/1521] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:28:59 2021] POST /identity/v3/projects => generated 391 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:59.326741 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77463218-b707-4081-8128-9513c8ba23e1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.383588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 760/1522] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:28:59 2021] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:59.388318 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d72324-82d4-46e4-bf5f-ab97654295d9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.392965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77463218-b707-4081-8128-9513c8ba23e1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.449442 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d72324-82d4-46e4-bf5f-ab97654295d9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.450451 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67a1af-f8df-4c72-b7f0-b5bd86e70bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.451137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a1af-f8df-4c72-b7f0-b5bd86e70bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.451453 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a1af-f8df-4c72-b7f0-b5bd86e70bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.451699 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a1af-f8df-4c72-b7f0-b5bd86e70bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.452574 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67a1af-f8df-4c72-b7f0-b5bd86e70bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.454406 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24204a6f-4ead-4b34-ad77-142da4978514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.454554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67a1af-f8df-4c72-b7f0-b5bd86e70bc4 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.455062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24204a6f-4ead-4b34-ad77-142da4978514 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.455342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24204a6f-4ead-4b34-ad77-142da4978514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.455614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24204a6f-4ead-4b34-ad77-142da4978514 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.456347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24204a6f-4ead-4b34-ad77-142da4978514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.458764 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24204a6f-4ead-4b34-ad77-142da4978514 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.541562 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 763/1523] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:28:59 2021] POST /identity/v3/users => generated 284 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:59.543067 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35fa80-8df0-4de8-b3f3-8646efb287fe None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.546459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35fa80-8df0-4de8-b3f3-8646efb287fe None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.546459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35fa80-8df0-4de8-b3f3-8646efb287fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.570243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-af35fa80-8df0-4de8-b3f3-8646efb287fe None None] MFA Rules not processed for user `ea9114bcc3504d1788fba123a1d4b0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:28:59.570964 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 761/1524] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:28:59 2021] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:59.571664 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-af35fa80-8df0-4de8-b3f3-8646efb287fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:28:59.571806 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24204a6f-4ead-4b34-ad77-142da4978514 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.584364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24204a6f-4ead-4b34-ad77-142da4978514 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.589111 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b553483-c97d-4eb4-8e5b-7edff5ed541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.589783 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b553483-c97d-4eb4-8e5b-7edff5ed541a admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.590066 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b553483-c97d-4eb4-8e5b-7edff5ed541a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.590339 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b553483-c97d-4eb4-8e5b-7edff5ed541a admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.591035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b553483-c97d-4eb4-8e5b-7edff5ed541a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.592984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b553483-c97d-4eb4-8e5b-7edff5ed541a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.634398 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 764/1525] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:28:59 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:28:59.635238 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35fa80-8df0-4de8-b3f3-8646efb287fe None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.646158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35fa80-8df0-4de8-b3f3-8646efb287fe None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.651053 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045d109-a6c6-48a9-8598-91f66790d47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.654565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045d109-a6c6-48a9-8598-91f66790d47c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.654565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045d109-a6c6-48a9-8598-91f66790d47c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.654565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045d109-a6c6-48a9-8598-91f66790d47c admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.654565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045d109-a6c6-48a9-8598-91f66790d47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.654913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045d109-a6c6-48a9-8598-91f66790d47c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.664886 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 765/1526] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:28:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:28:59.665986 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045d109-a6c6-48a9-8598-91f66790d47c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.676459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045d109-a6c6-48a9-8598-91f66790d47c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.679781 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 762/1527] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:28:59 2021] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:59.680289 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b553483-c97d-4eb4-8e5b-7edff5ed541a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.685689 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406d3b-991c-4085-972b-80d3061f5e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.686362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406d3b-991c-4085-972b-80d3061f5e72 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.686647 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406d3b-991c-4085-972b-80d3061f5e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.686921 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406d3b-991c-4085-972b-80d3061f5e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.687662 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa406d3b-991c-4085-972b-80d3061f5e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.689321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa406d3b-991c-4085-972b-80d3061f5e72 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.690130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b553483-c97d-4eb4-8e5b-7edff5ed541a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.695331 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f079c-a926-474c-8fb8-84673919bb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.696022 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f079c-a926-474c-8fb8-84673919bb04 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.696308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f079c-a926-474c-8fb8-84673919bb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.696582 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f079c-a926-474c-8fb8-84673919bb04 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.697283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f079c-a926-474c-8fb8-84673919bb04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.699163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f079c-a926-474c-8fb8-84673919bb04 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.700864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 766/1528] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:28:59 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:28:59.701875 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406d3b-991c-4085-972b-80d3061f5e72 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.712123 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406d3b-991c-4085-972b-80d3061f5e72 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.716768 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89cd50-b3c8-4de1-8668-c2e95b1a81b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.717454 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89cd50-b3c8-4de1-8668-c2e95b1a81b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.717736 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89cd50-b3c8-4de1-8668-c2e95b1a81b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.718012 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89cd50-b3c8-4de1-8668-c2e95b1a81b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.718707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89cd50-b3c8-4de1-8668-c2e95b1a81b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.720631 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89cd50-b3c8-4de1-8668-c2e95b1a81b9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.793234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 763/1529] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:28:59 2021] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:59.793985 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f079c-a926-474c-8fb8-84673919bb04 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.804373 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f079c-a926-474c-8fb8-84673919bb04 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.809151 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2492024-1ad9-4d4f-8ca7-a578e7fc5a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.809819 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2492024-1ad9-4d4f-8ca7-a578e7fc5a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.810102 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2492024-1ad9-4d4f-8ca7-a578e7fc5a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.810376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2492024-1ad9-4d4f-8ca7-a578e7fc5a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.811106 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2492024-1ad9-4d4f-8ca7-a578e7fc5a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.812752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2492024-1ad9-4d4f-8ca7-a578e7fc5a21 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.822348 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 767/1530] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:28:59 2021] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:28:59.823282 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89cd50-b3c8-4de1-8668-c2e95b1a81b9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.829774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 764/1531] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:28:59 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:28:59.829774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddd456-091a-44ea-a6f7-a5aecaaaee87 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.829774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddd456-091a-44ea-a6f7-a5aecaaaee87 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.829774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddd456-091a-44ea-a6f7-a5aecaaaee87 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.831415 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 765/1532] 10.222.0.87 () {54 vars in 960 bytes} [Fri Oct 29 01:28:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:28:59.832229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddd456-091a-44ea-a6f7-a5aecaaaee87 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.833359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89cd50-b3c8-4de1-8668-c2e95b1a81b9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.838090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2300ea-d9bb-4eb4-beeb-95aacaf514f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.838748 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2300ea-d9bb-4eb4-beeb-95aacaf514f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.839033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2300ea-d9bb-4eb4-beeb-95aacaf514f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.839303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2300ea-d9bb-4eb4-beeb-95aacaf514f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.840137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2300ea-d9bb-4eb4-beeb-95aacaf514f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.841725 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2300ea-d9bb-4eb4-beeb-95aacaf514f1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.844946 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddd456-091a-44ea-a6f7-a5aecaaaee87 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.849796 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2477b-c9d6-4d72-a280-b7e447249cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.850654 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2477b-c9d6-4d72-a280-b7e447249cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.850936 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2477b-c9d6-4d72-a280-b7e447249cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.851209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2477b-c9d6-4d72-a280-b7e447249cfc admin admin] PATH_INFO: `/v3/projects/78aef7315cec45edb329feeef343d983/users/eb7980403926443ba1c1c1f71f4f6ef3/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.856352 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 768/1533] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:28:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:28:59.856352 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2300ea-d9bb-4eb4-beeb-95aacaf514f1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.866446 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2300ea-d9bb-4eb4-beeb-95aacaf514f1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.870734 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2477b-c9d6-4d72-a280-b7e447249cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=78aef7315cec45edb329feeef343d983, user_id=eb7980403926443ba1c1c1f71f4f6ef3, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.873392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2477b-c9d6-4d72-a280-b7e447249cfc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.874620 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df09697-c747-48b9-871d-a41b1e4d0a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.876115 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df09697-c747-48b9-871d-a41b1e4d0a7b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.876399 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df09697-c747-48b9-871d-a41b1e4d0a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.876673 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df09697-c747-48b9-871d-a41b1e4d0a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.877503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df09697-c747-48b9-871d-a41b1e4d0a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.879668 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df09697-c747-48b9-871d-a41b1e4d0a7b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.889646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 769/1534] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:28:59 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:28:59.890403 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df09697-c747-48b9-871d-a41b1e4d0a7b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:28:59.899514 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df09697-c747-48b9-871d-a41b1e4d0a7b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:28:59.904047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253666f-1272-4a89-a31d-e1344a71bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:28:59.904880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253666f-1272-4a89-a31d-e1344a71bd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:28:59.905215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253666f-1272-4a89-a31d-e1344a71bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:28:59.905469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253666f-1272-4a89-a31d-e1344a71bd5c admin admin] PATH_INFO: `/v3/projects/512f23a55341411c9279737287084f1f/users/b6830e4efd0e43a489be164906ed9657/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:28:59.919520 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253666f-1272-4a89-a31d-e1344a71bd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=512f23a55341411c9279737287084f1f, user_id=b6830e4efd0e43a489be164906ed9657, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:28:59.922224 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253666f-1272-4a89-a31d-e1344a71bd5c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:28:59.970086 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 766/1535] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:28:59 2021] PUT /identity/v3/projects/78aef7315cec45edb329feeef343d983/users/eb7980403926443ba1c1c1f71f4f6ef3/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:28:59.971074 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2477b-c9d6-4d72-a280-b7e447249cfc admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.029638 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2477b-c9d6-4d72-a280-b7e447249cfc admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.033601 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 770/1536] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:28:59 2021] PUT /identity/v3/projects/512f23a55341411c9279737287084f1f/users/b6830e4efd0e43a489be164906ed9657/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:00.035249 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253666f-1272-4a89-a31d-e1344a71bd5c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.090168 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e30d7-4bbb-42c2-bcb1-bad548844db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.090739 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e30d7-4bbb-42c2-bcb1-bad548844db1 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.091016 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e30d7-4bbb-42c2-bcb1-bad548844db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.091286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e30d7-4bbb-42c2-bcb1-bad548844db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.092053 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e30d7-4bbb-42c2-bcb1-bad548844db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.093619 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e30d7-4bbb-42c2-bcb1-bad548844db1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.104035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 767/1537] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:28:59 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:00.104826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e30d7-4bbb-42c2-bcb1-bad548844db1 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.110262 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253666f-1272-4a89-a31d-e1344a71bd5c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.114903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e30d7-4bbb-42c2-bcb1-bad548844db1 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.118128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa30cd-8f34-4f20-824f-75ffa14d2c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.118128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa30cd-8f34-4f20-824f-75ffa14d2c70 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.118128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa30cd-8f34-4f20-824f-75ffa14d2c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.118128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa30cd-8f34-4f20-824f-75ffa14d2c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.118598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa30cd-8f34-4f20-824f-75ffa14d2c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.119460 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa30cd-8f34-4f20-824f-75ffa14d2c70 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.121032 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d768220-222a-4c21-8725-45ce7ec89690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.122099 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d768220-222a-4c21-8725-45ce7ec89690 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.122385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d768220-222a-4c21-8725-45ce7ec89690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.122780 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d768220-222a-4c21-8725-45ce7ec89690 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.123524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d768220-222a-4c21-8725-45ce7ec89690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.125172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d768220-222a-4c21-8725-45ce7ec89690 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.129899 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 771/1538] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:00 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:00.131186 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7450-f957-4a9e-bfae-b45554cf96d1 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.131478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7450-f957-4a9e-bfae-b45554cf96d1 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.131777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7450-f957-4a9e-bfae-b45554cf96d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.136814 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 768/1539] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:00.137836 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d768220-222a-4c21-8725-45ce7ec89690 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.148009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d768220-222a-4c21-8725-45ce7ec89690 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.151482 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d8dc7450-f957-4a9e-bfae-b45554cf96d1 None None] MFA Rules not processed for user `28d331f2997547968c51fec87598420f`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:00.152626 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ae27d-3d91-4881-9f92-b5f89c56156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.152756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d8dc7450-f957-4a9e-bfae-b45554cf96d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:00.153287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ae27d-3d91-4881-9f92-b5f89c56156d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.153553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ae27d-3d91-4881-9f92-b5f89c56156d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.153827 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ae27d-3d91-4881-9f92-b5f89c56156d admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.154561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ae27d-3d91-4881-9f92-b5f89c56156d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.156160 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ae27d-3d91-4881-9f92-b5f89c56156d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.166955 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 769/1540] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:00.167823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ae27d-3d91-4881-9f92-b5f89c56156d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.179517 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ae27d-3d91-4881-9f92-b5f89c56156d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.184270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcdad4-caec-48db-8680-ad732763b2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.184971 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcdad4-caec-48db-8680-ad732763b2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.185273 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcdad4-caec-48db-8680-ad732763b2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.185546 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcdad4-caec-48db-8680-ad732763b2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.186537 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcdad4-caec-48db-8680-ad732763b2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.187871 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcdad4-caec-48db-8680-ad732763b2e0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.198575 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 770/1541] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:00.200096 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b9d93-e2da-448b-984b-780760e790e7 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.200377 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b9d93-e2da-448b-984b-780760e790e7 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.200705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b9d93-e2da-448b-984b-780760e790e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.227004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 772/1542] 10.222.0.87 () {58 vars in 1057 bytes} [Fri Oct 29 01:29:00 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:00.228180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-8a5b9d93-e2da-448b-984b-780760e790e7 None None] MFA Rules not processed for user `eb7980403926443ba1c1c1f71f4f6ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:00.228333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eb8e3-8d61-49bc-b42d-8d1d533bb7a5 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.228620 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eb8e3-8d61-49bc-b42d-8d1d533bb7a5 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.228898 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eb8e3-8d61-49bc-b42d-8d1d533bb7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.229417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8a5b9d93-e2da-448b-984b-780760e790e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:00.262678 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-127eb8e3-8d61-49bc-b42d-8d1d533bb7a5 None None] MFA Rules not processed for user `b6830e4efd0e43a489be164906ed9657`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:00.263938 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-127eb8e3-8d61-49bc-b42d-8d1d533bb7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:00.302200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 771/1543] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:00 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:00.303045 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b9d93-e2da-448b-984b-780760e790e7 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.313671 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b9d93-e2da-448b-984b-780760e790e7 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.318759 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606de9b9-9d02-49c3-9b56-220f7cc36017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.319416 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606de9b9-9d02-49c3-9b56-220f7cc36017 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.319698 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606de9b9-9d02-49c3-9b56-220f7cc36017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.320136 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606de9b9-9d02-49c3-9b56-220f7cc36017 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.321669 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606de9b9-9d02-49c3-9b56-220f7cc36017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.322416 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606de9b9-9d02-49c3-9b56-220f7cc36017 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.329774 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 773/1544] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:00 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:00.330488 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eb8e3-8d61-49bc-b42d-8d1d533bb7a5 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.335064 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 772/1545] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:00.336097 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606de9b9-9d02-49c3-9b56-220f7cc36017 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.341320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eb8e3-8d61-49bc-b42d-8d1d533bb7a5 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.345773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606de9b9-9d02-49c3-9b56-220f7cc36017 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.345896 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a70d1-61ab-4897-89e0-f8a440b5135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.346655 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a70d1-61ab-4897-89e0-f8a440b5135f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.347425 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a70d1-61ab-4897-89e0-f8a440b5135f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.347740 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a70d1-61ab-4897-89e0-f8a440b5135f admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.348472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a70d1-61ab-4897-89e0-f8a440b5135f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.350053 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a70d1-61ab-4897-89e0-f8a440b5135f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.351144 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d051d8-3bba-452c-acd1-7e5a7f51ce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.352205 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d051d8-3bba-452c-acd1-7e5a7f51ce49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.352486 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d051d8-3bba-452c-acd1-7e5a7f51ce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.352793 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d051d8-3bba-452c-acd1-7e5a7f51ce49 admin admin] PATH_INFO: `/v3/projects/c6df2f9d2bd74ac6860185fc740e5181/users/b52c4feb901c4137be7d259ef150dddd/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.360251 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 774/1546] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:00.360888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a70d1-61ab-4897-89e0-f8a440b5135f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.368629 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d051d8-3bba-452c-acd1-7e5a7f51ce49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6df2f9d2bd74ac6860185fc740e5181, user_id=b52c4feb901c4137be7d259ef150dddd, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.371222 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a70d1-61ab-4897-89e0-f8a440b5135f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.371357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d051d8-3bba-452c-acd1-7e5a7f51ce49 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.375865 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb40b6a-9def-48bb-bcd8-741f87954da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.376733 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb40b6a-9def-48bb-bcd8-741f87954da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.377012 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb40b6a-9def-48bb-bcd8-741f87954da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.377282 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb40b6a-9def-48bb-bcd8-741f87954da5 admin admin] PATH_INFO: `/v3/projects/c51a2093a0874d52a08f6e25489ba181/users/045dda1ff9b44334954c08e63fcd20c0/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.391746 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb40b6a-9def-48bb-bcd8-741f87954da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51a2093a0874d52a08f6e25489ba181, user_id=045dda1ff9b44334954c08e63fcd20c0, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.394957 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb40b6a-9def-48bb-bcd8-741f87954da5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.479693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 773/1547] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:00 2021] PUT /identity/v3/projects/c6df2f9d2bd74ac6860185fc740e5181/users/b52c4feb901c4137be7d259ef150dddd/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:00.480517 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d051d8-3bba-452c-acd1-7e5a7f51ce49 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.492294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 775/1548] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:00 2021] PUT /identity/v3/projects/c51a2093a0874d52a08f6e25489ba181/users/045dda1ff9b44334954c08e63fcd20c0/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:00.493210 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb40b6a-9def-48bb-bcd8-741f87954da5 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.541194 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d051d8-3bba-452c-acd1-7e5a7f51ce49 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.562486 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb40b6a-9def-48bb-bcd8-741f87954da5 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.568570 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c32ada-deac-4365-a0d8-655168642139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.569220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c32ada-deac-4365-a0d8-655168642139 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.569499 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c32ada-deac-4365-a0d8-655168642139 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.569770 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c32ada-deac-4365-a0d8-655168642139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.598452 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b972fa-bb0c-49a3-b20b-89bd77716ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.599252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b972fa-bb0c-49a3-b20b-89bd77716ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.599532 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b972fa-bb0c-49a3-b20b-89bd77716ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.599825 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b972fa-bb0c-49a3-b20b-89bd77716ed8 admin admin] PATH_INFO: `/v3/projects/bfb1a96bc2154de787f2d217b2ac27f7/users/df16eb9ac1b7472ebe95d3739604e27b/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.615745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b972fa-bb0c-49a3-b20b-89bd77716ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb1a96bc2154de787f2d217b2ac27f7, user_id=df16eb9ac1b7472ebe95d3739604e27b, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.618380 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b972fa-bb0c-49a3-b20b-89bd77716ed8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.625201 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c32ada-deac-4365-a0d8-655168642139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.626761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c32ada-deac-4365-a0d8-655168642139 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.636120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 776/1549] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:00 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:00.636877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c32ada-deac-4365-a0d8-655168642139 service nova] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.646100 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c32ada-deac-4365-a0d8-655168642139 service nova] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.650718 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02625f3-ecb8-4468-a56e-26de61252d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.651340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02625f3-ecb8-4468-a56e-26de61252d66 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.651623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02625f3-ecb8-4468-a56e-26de61252d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.651927 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02625f3-ecb8-4468-a56e-26de61252d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.652603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02625f3-ecb8-4468-a56e-26de61252d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.654475 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02625f3-ecb8-4468-a56e-26de61252d66 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.689909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 774/1550] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:00 2021] PUT /identity/v3/projects/bfb1a96bc2154de787f2d217b2ac27f7/users/df16eb9ac1b7472ebe95d3739604e27b/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:00.691647 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b972fa-bb0c-49a3-b20b-89bd77716ed8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.750070 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b972fa-bb0c-49a3-b20b-89bd77716ed8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.755436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaae70-40f2-4389-8c78-f3ed1f6514d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.756107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaae70-40f2-4389-8c78-f3ed1f6514d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.756382 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaae70-40f2-4389-8c78-f3ed1f6514d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.756665 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaae70-40f2-4389-8c78-f3ed1f6514d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.757392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcaae70-40f2-4389-8c78-f3ed1f6514d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.759254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcaae70-40f2-4389-8c78-f3ed1f6514d9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.775116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 777/1551] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:00 2021] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:00.775116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02625f3-ecb8-4468-a56e-26de61252d66 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.834404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02625f3-ecb8-4468-a56e-26de61252d66 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.839152 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566f0b6-7197-4320-811b-df4424bd1b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.840206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566f0b6-7197-4320-811b-df4424bd1b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.840733 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 775/1552] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:00 2021] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:00.844374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaae70-40f2-4389-8c78-f3ed1f6514d9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:00.844492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566f0b6-7197-4320-811b-df4424bd1b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.844492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566f0b6-7197-4320-811b-df4424bd1b13 admin admin] PATH_INFO: `/v3/projects/4b037cd872fe4e0b8b9429048c567b1b/users/ac27192a9b2148f4bff8814f63813098/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.860699 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566f0b6-7197-4320-811b-df4424bd1b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b037cd872fe4e0b8b9429048c567b1b, user_id=ac27192a9b2148f4bff8814f63813098, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.864274 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566f0b6-7197-4320-811b-df4424bd1b13 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.917402 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaae70-40f2-4389-8c78-f3ed1f6514d9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:00.922316 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab61b8-6c41-49d3-98fc-249c9ceaba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:00.923185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab61b8-6c41-49d3-98fc-249c9ceaba0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.923469 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab61b8-6c41-49d3-98fc-249c9ceaba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.923789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab61b8-6c41-49d3-98fc-249c9ceaba0f admin admin] PATH_INFO: `/v3/projects/413ce1a7d8504d0b9f656d9e623f9005/users/78823bdcff4e45d8ab82558b434f188d/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.939014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab61b8-6c41-49d3-98fc-249c9ceaba0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=413ce1a7d8504d0b9f656d9e623f9005, user_id=78823bdcff4e45d8ab82558b434f188d, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:00.942137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab61b8-6c41-49d3-98fc-249c9ceaba0f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:00.947009 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 778/1553] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:00 2021] PUT /identity/v3/projects/4b037cd872fe4e0b8b9429048c567b1b/users/ac27192a9b2148f4bff8814f63813098/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:00.948422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d66d04-5cc9-49b2-af24-7162d5d5da00 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:00.948706 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d66d04-5cc9-49b2-af24-7162d5d5da00 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:00.948977 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d66d04-5cc9-49b2-af24-7162d5d5da00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:00.975125 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-05d66d04-5cc9-49b2-af24-7162d5d5da00 None None] MFA Rules not processed for user `b52c4feb901c4137be7d259ef150dddd`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:00.976428 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-05d66d04-5cc9-49b2-af24-7162d5d5da00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:01.015503 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 776/1554] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:00 2021] PUT /identity/v3/projects/413ce1a7d8504d0b9f656d9e623f9005/users/78823bdcff4e45d8ab82558b434f188d/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:01.017252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5677649-536c-4f1b-8fca-335af127c952 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.017554 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5677649-536c-4f1b-8fca-335af127c952 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.018364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5677649-536c-4f1b-8fca-335af127c952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.036959 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-a5677649-536c-4f1b-8fca-335af127c952 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:01.038240 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a5677649-536c-4f1b-8fca-335af127c952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:01.041578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 779/1555] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:00 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:01.044207 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcfc93-f8ee-4753-aa24-c22310d7ca83 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.044496 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcfc93-f8ee-4753-aa24-c22310d7ca83 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.044771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcfc93-f8ee-4753-aa24-c22310d7ca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.062225 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-7edcfc93-f8ee-4753-aa24-c22310d7ca83 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:01.063408 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7edcfc93-f8ee-4753-aa24-c22310d7ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:01.101291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 777/1556] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:01.102107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5677649-536c-4f1b-8fca-335af127c952 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.118301 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5677649-536c-4f1b-8fca-335af127c952 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.118301 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1914d-dfdd-4b9f-a5a6-736cdc5768ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.118301 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1914d-dfdd-4b9f-a5a6-736cdc5768ae admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.118301 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1914d-dfdd-4b9f-a5a6-736cdc5768ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.118760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1914d-dfdd-4b9f-a5a6-736cdc5768ae admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.119300 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1914d-dfdd-4b9f-a5a6-736cdc5768ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.121330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1914d-dfdd-4b9f-a5a6-736cdc5768ae admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.124275 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 780/1557] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:01.125087 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcfc93-f8ee-4753-aa24-c22310d7ca83 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.134290 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcfc93-f8ee-4753-aa24-c22310d7ca83 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.138847 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c50429-a35d-47f4-b59d-9eb879226147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.139503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50429-a35d-47f4-b59d-9eb879226147 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.139826 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50429-a35d-47f4-b59d-9eb879226147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.140105 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50429-a35d-47f4-b59d-9eb879226147 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.140802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c50429-a35d-47f4-b59d-9eb879226147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.147047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c50429-a35d-47f4-b59d-9eb879226147 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.250493 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 778/1558] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:01 2021] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:01.252062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8f3b0-8d51-411d-b732-4d192c65cda5 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.252349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8f3b0-8d51-411d-b732-4d192c65cda5 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.252623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8f3b0-8d51-411d-b732-4d192c65cda5 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.254955 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 779/1559] 10.222.0.87 () {54 vars in 912 bytes} [Fri Oct 29 01:29:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:29:01.256045 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64f373-131f-48e6-a308-36ea31e96588 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.261762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64f373-131f-48e6-a308-36ea31e96588 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.261762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64f373-131f-48e6-a308-36ea31e96588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.263844 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 781/1560] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:01 2021] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:01.265271 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005b3e-1c35-4a42-8336-50665be2e55d None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.265557 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005b3e-1c35-4a42-8336-50665be2e55d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.265834 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005b3e-1c35-4a42-8336-50665be2e55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.277342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-8c64f373-131f-48e6-a308-36ea31e96588 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:01.278558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8c64f373-131f-48e6-a308-36ea31e96588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:01.283266 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-84005b3e-1c35-4a42-8336-50665be2e55d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:01.284472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-84005b3e-1c35-4a42-8336-50665be2e55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:01.286633 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 780/1561] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:01.287424 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64f373-131f-48e6-a308-36ea31e96588 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.297825 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 782/1562] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:01.297825 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005b3e-1c35-4a42-8336-50665be2e55d None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.346066 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64f373-131f-48e6-a308-36ea31e96588 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.349557 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005b3e-1c35-4a42-8336-50665be2e55d None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.350404 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7499b-8a24-4934-b469-9c23687f641b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.351071 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7499b-8a24-4934-b469-9c23687f641b service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.351342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7499b-8a24-4934-b469-9c23687f641b service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.351615 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7499b-8a24-4934-b469-9c23687f641b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.353230 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714301f-c9f3-40bd-b5ea-133608d9efaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.353891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714301f-c9f3-40bd-b5ea-133608d9efaf service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.354171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714301f-c9f3-40bd-b5ea-133608d9efaf service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.354463 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714301f-c9f3-40bd-b5ea-133608d9efaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.364510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714301f-c9f3-40bd-b5ea-133608d9efaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.365937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714301f-c9f3-40bd-b5ea-133608d9efaf service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.375232 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 783/1563] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:01.376091 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714301f-c9f3-40bd-b5ea-133608d9efaf service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.384272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714301f-c9f3-40bd-b5ea-133608d9efaf service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.388120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdab0e-3881-49be-b575-a8c327fec7f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.388963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdab0e-3881-49be-b575-a8c327fec7f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.389102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdab0e-3881-49be-b575-a8c327fec7f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.389287 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdab0e-3881-49be-b575-a8c327fec7f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.398874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdab0e-3881-49be-b575-a8c327fec7f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.400353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdab0e-3881-49be-b575-a8c327fec7f8 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.410154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 784/1564] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:01.410831 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdab0e-3881-49be-b575-a8c327fec7f8 service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.413447 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7499b-8a24-4934-b469-9c23687f641b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.414868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7499b-8a24-4934-b469-9c23687f641b service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.420122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdab0e-3881-49be-b575-a8c327fec7f8 service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.424477 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 781/1565] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:01 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:01.424776 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff2c3f-fbd8-471d-86da-23e8ebf6dde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.425966 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2c3f-fbd8-471d-86da-23e8ebf6dde0 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.426249 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2c3f-fbd8-471d-86da-23e8ebf6dde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.426518 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2c3f-fbd8-471d-86da-23e8ebf6dde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.426926 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328721c-59ac-467f-8e8c-0bec092222e1 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.427212 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328721c-59ac-467f-8e8c-0bec092222e1 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.427334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff2c3f-fbd8-471d-86da-23e8ebf6dde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.427511 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328721c-59ac-467f-8e8c-0bec092222e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.429034 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff2c3f-fbd8-471d-86da-23e8ebf6dde0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.439668 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 785/1566] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:01.441428 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff2c3f-fbd8-471d-86da-23e8ebf6dde0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.449119 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-9328721c-59ac-467f-8e8c-0bec092222e1 None None] MFA Rules not processed for user `28d331f2997547968c51fec87598420f`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:01.450664 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9328721c-59ac-467f-8e8c-0bec092222e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:01.451447 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff2c3f-fbd8-471d-86da-23e8ebf6dde0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.456345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb18e9b-6247-44e0-80e1-ae4e9ccc83cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.457115 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb18e9b-6247-44e0-80e1-ae4e9ccc83cf admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.457267 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb18e9b-6247-44e0-80e1-ae4e9ccc83cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.457539 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb18e9b-6247-44e0-80e1-ae4e9ccc83cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.458286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb18e9b-6247-44e0-80e1-ae4e9ccc83cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.459922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb18e9b-6247-44e0-80e1-ae4e9ccc83cf admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.470119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 786/1567] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:01.472814 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb18e9b-6247-44e0-80e1-ae4e9ccc83cf admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.485434 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb18e9b-6247-44e0-80e1-ae4e9ccc83cf admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.490258 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881730a8-8930-4bea-ac4d-aec186d2ccfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.491164 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881730a8-8930-4bea-ac4d-aec186d2ccfd service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.491164 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881730a8-8930-4bea-ac4d-aec186d2ccfd service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.491440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881730a8-8930-4bea-ac4d-aec186d2ccfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.501938 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881730a8-8930-4bea-ac4d-aec186d2ccfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.506258 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881730a8-8930-4bea-ac4d-aec186d2ccfd service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.515796 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 787/1568] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:01.516418 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881730a8-8930-4bea-ac4d-aec186d2ccfd service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.525124 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881730a8-8930-4bea-ac4d-aec186d2ccfd service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.528942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c26b5e-62a2-468f-a2d5-3435f08c8ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.529543 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26b5e-62a2-468f-a2d5-3435f08c8ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.529842 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26b5e-62a2-468f-a2d5-3435f08c8ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.530099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26b5e-62a2-468f-a2d5-3435f08c8ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.540974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c26b5e-62a2-468f-a2d5-3435f08c8ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.542545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c26b5e-62a2-468f-a2d5-3435f08c8ea2 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.554098 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 782/1570] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:29:01 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:01.554307 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 788/1570] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:01.554968 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328721c-59ac-467f-8e8c-0bec092222e1 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.557898 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c26b5e-62a2-468f-a2d5-3435f08c8ea2 service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.567410 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328721c-59ac-467f-8e8c-0bec092222e1 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.572569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c26b5e-62a2-468f-a2d5-3435f08c8ea2 service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.574002 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a02c3-9e7f-494d-8b66-22ee75580cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.576353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a02c3-9e7f-494d-8b66-22ee75580cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.576681 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a02c3-9e7f-494d-8b66-22ee75580cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.576980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a02c3-9e7f-494d-8b66-22ee75580cc8 admin admin] PATH_INFO: `/v3/projects/95e14d61ca2e48bb8b52f18cf0a2018b/users/3de1c1601b3c4ecf944d7a6f955b6314/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.578778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767851e8-ff48-4ea1-8669-6d8739e11f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.580179 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767851e8-ff48-4ea1-8669-6d8739e11f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.580179 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767851e8-ff48-4ea1-8669-6d8739e11f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.580597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767851e8-ff48-4ea1-8669-6d8739e11f63 admin admin] PATH_INFO: `/v3/projects/1355e79fed3c427db546cf4eee2c8036/users/9243dcef502c441a8a1c3be161c6a77a/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.599509 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a02c3-9e7f-494d-8b66-22ee75580cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e14d61ca2e48bb8b52f18cf0a2018b, user_id=3de1c1601b3c4ecf944d7a6f955b6314, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.605503 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a02c3-9e7f-494d-8b66-22ee75580cc8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.609793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767851e8-ff48-4ea1-8669-6d8739e11f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1355e79fed3c427db546cf4eee2c8036, user_id=9243dcef502c441a8a1c3be161c6a77a, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.613167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767851e8-ff48-4ea1-8669-6d8739e11f63 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.712436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 789/1571] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:01 2021] PUT /identity/v3/projects/1355e79fed3c427db546cf4eee2c8036/users/9243dcef502c441a8a1c3be161c6a77a/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:01.712984 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767851e8-ff48-4ea1-8669-6d8739e11f63 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.717213 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 783/1572] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:01 2021] PUT /identity/v3/projects/95e14d61ca2e48bb8b52f18cf0a2018b/users/3de1c1601b3c4ecf944d7a6f955b6314/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:01.723589 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a02c3-9e7f-494d-8b66-22ee75580cc8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.779343 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767851e8-ff48-4ea1-8669-6d8739e11f63 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.844500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a02c3-9e7f-494d-8b66-22ee75580cc8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.850006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081ed2b-d28b-4c1c-8641-4c692a78b3eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.850154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac362737-0765-47df-894e-60efddf3b33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.850265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081ed2b-d28b-4c1c-8641-4c692a78b3eb service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.850375 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac362737-0765-47df-894e-60efddf3b33d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.850461 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac362737-0765-47df-894e-60efddf3b33d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.850682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac362737-0765-47df-894e-60efddf3b33d admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.850819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081ed2b-d28b-4c1c-8641-4c692a78b3eb service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.851014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081ed2b-d28b-4c1c-8641-4c692a78b3eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.851424 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac362737-0765-47df-894e-60efddf3b33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.853065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac362737-0765-47df-894e-60efddf3b33d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.869761 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 784/1573] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:01 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:01.869761 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac362737-0765-47df-894e-60efddf3b33d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.888031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac362737-0765-47df-894e-60efddf3b33d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.893134 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6059539-1a75-41d8-b6d7-d8038af491d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.894521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6059539-1a75-41d8-b6d7-d8038af491d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.894926 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6059539-1a75-41d8-b6d7-d8038af491d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.895206 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6059539-1a75-41d8-b6d7-d8038af491d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.896050 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6059539-1a75-41d8-b6d7-d8038af491d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.897644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6059539-1a75-41d8-b6d7-d8038af491d7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.909439 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 785/1574] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:01 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:01.911049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6059539-1a75-41d8-b6d7-d8038af491d7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:01.921150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6059539-1a75-41d8-b6d7-d8038af491d7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:01.935200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b815ec5-d0c1-4091-bdfd-c58de88fc049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:01.937166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b815ec5-d0c1-4091-bdfd-c58de88fc049 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:01.938234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b815ec5-d0c1-4091-bdfd-c58de88fc049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:01.938707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b815ec5-d0c1-4091-bdfd-c58de88fc049 admin admin] PATH_INFO: `/v3/projects/1355e79fed3c427db546cf4eee2c8036/users/9243dcef502c441a8a1c3be161c6a77a/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:01.943454 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b815ec5-d0c1-4091-bdfd-c58de88fc049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1355e79fed3c427db546cf4eee2c8036, user_id=9243dcef502c441a8a1c3be161c6a77a, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.946895 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b815ec5-d0c1-4091-bdfd-c58de88fc049 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.955158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081ed2b-d28b-4c1c-8641-4c692a78b3eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:01.956854 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081ed2b-d28b-4c1c-8641-4c692a78b3eb service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:01.961928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 786/1575] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:01 2021] PUT /identity/v3/projects/1355e79fed3c427db546cf4eee2c8036/users/9243dcef502c441a8a1c3be161c6a77a/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:01.962673 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b815ec5-d0c1-4091-bdfd-c58de88fc049 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:02.001017 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 790/1576] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:02.001612 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e0f7e-1647-47d4-a773-fa1e5671a5f0 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:02.001897 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e0f7e-1647-47d4-a773-fa1e5671a5f0 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:02.005539 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e0f7e-1647-47d4-a773-fa1e5671a5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:02.066663 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-0c0e0f7e-1647-47d4-a773-fa1e5671a5f0 None None] MFA Rules not processed for user `9243dcef502c441a8a1c3be161c6a77a`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:02.068069 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b815ec5-d0c1-4091-bdfd-c58de88fc049 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:02.069390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0c0e0f7e-1647-47d4-a773-fa1e5671a5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:02.080070 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa293b-ad0b-4931-a53d-afffeb799f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:02.080709 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa293b-ad0b-4931-a53d-afffeb799f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:02.081026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa293b-ad0b-4931-a53d-afffeb799f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:02.081350 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa293b-ad0b-4931-a53d-afffeb799f47 admin admin] PATH_INFO: `/v3/projects/95e14d61ca2e48bb8b52f18cf0a2018b/users/3de1c1601b3c4ecf944d7a6f955b6314/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:02.084668 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa293b-ad0b-4931-a53d-afffeb799f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e14d61ca2e48bb8b52f18cf0a2018b, user_id=3de1c1601b3c4ecf944d7a6f955b6314, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:02.088976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa293b-ad0b-4931-a53d-afffeb799f47 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:02.107870 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 787/1577] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:01 2021] PUT /identity/v3/projects/95e14d61ca2e48bb8b52f18cf0a2018b/users/3de1c1601b3c4ecf944d7a6f955b6314/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:02.126708 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0212a-9318-4072-8581-07d60021bcda None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:02.127043 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0212a-9318-4072-8581-07d60021bcda None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:02.127391 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0212a-9318-4072-8581-07d60021bcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:02.182869 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 791/1578] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:02 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:02.201968 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-86f0212a-9318-4072-8581-07d60021bcda None None] MFA Rules not processed for user `3de1c1601b3c4ecf944d7a6f955b6314`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:02.210831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-86f0212a-9318-4072-8581-07d60021bcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:02.319946 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 788/1579] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:02 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:02.589928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e0f7e-1647-47d4-a773-fa1e5671a5f0 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:02.658513 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e0f7e-1647-47d4-a773-fa1e5671a5f0 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:02.719211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d283ae-fdcd-48cc-b843-4ab5834a9e09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:02.720041 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d283ae-fdcd-48cc-b843-4ab5834a9e09 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:02.720399 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d283ae-fdcd-48cc-b843-4ab5834a9e09 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:02.720760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d283ae-fdcd-48cc-b843-4ab5834a9e09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:02.808065 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d283ae-fdcd-48cc-b843-4ab5834a9e09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:02.810056 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d283ae-fdcd-48cc-b843-4ab5834a9e09 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:02.824793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 792/1580] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:02 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:02.930182 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0212a-9318-4072-8581-07d60021bcda None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:02.943505 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0212a-9318-4072-8581-07d60021bcda None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:02.954052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248577-6990-4c6a-ac09-087e4b4cf057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:02.954789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248577-6990-4c6a-ac09-087e4b4cf057 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:02.956104 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248577-6990-4c6a-ac09-087e4b4cf057 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:02.956104 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248577-6990-4c6a-ac09-087e4b4cf057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:02.976534 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92248577-6990-4c6a-ac09-087e4b4cf057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:02.977980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92248577-6990-4c6a-ac09-087e4b4cf057 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:03.000063 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 789/1581] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:02 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:03.360129 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f7918-a1ec-4bc6-924d-28b0a48241de None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:03.361134 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f7918-a1ec-4bc6-924d-28b0a48241de None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:03.361563 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f7918-a1ec-4bc6-924d-28b0a48241de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:03.398807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248577-6990-4c6a-ac09-087e4b4cf057 service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:03.412763 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-6a0f7918-a1ec-4bc6-924d-28b0a48241de None None] MFA Rules not processed for user `df16eb9ac1b7472ebe95d3739604e27b`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:03.414175 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6a0f7918-a1ec-4bc6-924d-28b0a48241de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:03.426541 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248577-6990-4c6a-ac09-087e4b4cf057 service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:03.454772 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2276c1c-8bf5-4876-b355-b8d7c7459fb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:03.455477 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2276c1c-8bf5-4876-b355-b8d7c7459fb7 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:03.460525 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2276c1c-8bf5-4876-b355-b8d7c7459fb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:03.460525 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2276c1c-8bf5-4876-b355-b8d7c7459fb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:03.564213 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 793/1582] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:03 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:03.566701 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403ff60-2c87-4605-a902-ce5dfc0408a0 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:03.575920 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403ff60-2c87-4605-a902-ce5dfc0408a0 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:03.575920 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403ff60-2c87-4605-a902-ce5dfc0408a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:03.614818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8403ff60-2c87-4605-a902-ce5dfc0408a0 None None] MFA Rules not processed for user `df16eb9ac1b7472ebe95d3739604e27b`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:03.616673 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8403ff60-2c87-4605-a902-ce5dfc0408a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:03.629776 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2276c1c-8bf5-4876-b355-b8d7c7459fb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:03.631229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2276c1c-8bf5-4876-b355-b8d7c7459fb7 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:03.639554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 794/1583] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:03 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:03.642718 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403ff60-2c87-4605-a902-ce5dfc0408a0 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:03.654175 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 790/1584] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:03 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:29:03.662240 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2276c1c-8bf5-4876-b355-b8d7c7459fb7 service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:03.685245 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403ff60-2c87-4605-a902-ce5dfc0408a0 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:03.707323 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7498e-af8a-40c6-82ff-34203b7a3a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:03.713815 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7498e-af8a-40c6-82ff-34203b7a3a15 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:03.716048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7498e-af8a-40c6-82ff-34203b7a3a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:03.716964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7498e-af8a-40c6-82ff-34203b7a3a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:03.793121 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2276c1c-8bf5-4876-b355-b8d7c7459fb7 service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:03.809318 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68719bad-3257-4d1b-9643-62e85150cef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:03.810390 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68719bad-3257-4d1b-9643-62e85150cef1 service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:03.810883 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68719bad-3257-4d1b-9643-62e85150cef1 service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:03.811360 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68719bad-3257-4d1b-9643-62e85150cef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:03.821546 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68719bad-3257-4d1b-9643-62e85150cef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:03.823473 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68719bad-3257-4d1b-9643-62e85150cef1 service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:03.837385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 791/1585] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:03 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:03.851389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7498e-af8a-40c6-82ff-34203b7a3a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:03.853484 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7498e-af8a-40c6-82ff-34203b7a3a15 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:03.867781 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 795/1586] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:03 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:03.963041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de720d6f-7aba-41e1-af62-35ae99177cb9 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:03.964098 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de720d6f-7aba-41e1-af62-35ae99177cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:03.965197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de720d6f-7aba-41e1-af62-35ae99177cb9 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:03.967822 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 792/1587] 10.222.0.87 () {54 vars in 960 bytes} [Fri Oct 29 01:29:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:29:03.985577 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7841-107e-4df5-ae2a-2060a5ba65d3 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:03.985577 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7841-107e-4df5-ae2a-2060a5ba65d3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:03.985577 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7841-107e-4df5-ae2a-2060a5ba65d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:04.018408 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-110c7841-107e-4df5-ae2a-2060a5ba65d3 None None] MFA Rules not processed for user `28d331f2997547968c51fec87598420f`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:04.020656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-110c7841-107e-4df5-ae2a-2060a5ba65d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:04.036904 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 796/1588] 10.222.0.87 () {58 vars in 1057 bytes} [Fri Oct 29 01:29:03 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:04.043861 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2054e-4a4b-4424-bfc6-874e6007990c None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:04.044547 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2054e-4a4b-4424-bfc6-874e6007990c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:04.045287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2054e-4a4b-4424-bfc6-874e6007990c None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:04.049337 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 793/1589] 10.222.0.87 () {54 vars in 912 bytes} [Fri Oct 29 01:29:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:29:04.062423 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e74d7f-1ecf-4553-a85c-2a960a9cbf38 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:04.062754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e74d7f-1ecf-4553-a85c-2a960a9cbf38 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:04.063242 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e74d7f-1ecf-4553-a85c-2a960a9cbf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:04.093834 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-64e74d7f-1ecf-4553-a85c-2a960a9cbf38 None None] MFA Rules not processed for user `28d331f2997547968c51fec87598420f`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:04.095671 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-64e74d7f-1ecf-4553-a85c-2a960a9cbf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:04.106814 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 797/1590] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:29:04 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:04.407691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2054e-4a4b-4424-bfc6-874e6007990c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:04.425354 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2054e-4a4b-4424-bfc6-874e6007990c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:04.436313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15e93e-dd30-40ac-9aef-af57e650a59f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:04.437148 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15e93e-dd30-40ac-9aef-af57e650a59f service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:04.438926 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15e93e-dd30-40ac-9aef-af57e650a59f service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:04.439309 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15e93e-dd30-40ac-9aef-af57e650a59f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:04.463738 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15e93e-dd30-40ac-9aef-af57e650a59f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:04.467396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15e93e-dd30-40ac-9aef-af57e650a59f service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:04.484007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 794/1591] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:04 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:04.501790 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93999a6d-51d3-4f89-9532-092b51188c43 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:04.502341 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93999a6d-51d3-4f89-9532-092b51188c43 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:04.502719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93999a6d-51d3-4f89-9532-092b51188c43 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:04.506692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 798/1592] 10.222.0.87 () {54 vars in 912 bytes} [Fri Oct 29 01:29:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:29:04.516031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d62bd3-f9d5-417a-aacb-7c92e85ebb47 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:04.516550 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d62bd3-f9d5-417a-aacb-7c92e85ebb47 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:04.517075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d62bd3-f9d5-417a-aacb-7c92e85ebb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:04.576347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-74d62bd3-f9d5-417a-aacb-7c92e85ebb47 None None] MFA Rules not processed for user `48b92ce8a3bd4d1ebfd94249d525addb`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:04.579384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-74d62bd3-f9d5-417a-aacb-7c92e85ebb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:04.710643 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 795/1593] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:29:04 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:04.720427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93999a6d-51d3-4f89-9532-092b51188c43 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:04.749086 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93999a6d-51d3-4f89-9532-092b51188c43 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:04.759331 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aa673-a638-44f9-be93-6a8c69a125d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:04.760369 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa673-a638-44f9-be93-6a8c69a125d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:04.760883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa673-a638-44f9-be93-6a8c69a125d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:04.761368 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa673-a638-44f9-be93-6a8c69a125d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:04.778241 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3aa673-a638-44f9-be93-6a8c69a125d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:04.787438 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3aa673-a638-44f9-be93-6a8c69a125d8 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:04.807235 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 799/1594] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:04 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:05.852400 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d62bd3-f9d5-417a-aacb-7c92e85ebb47 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:05.965967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d62bd3-f9d5-417a-aacb-7c92e85ebb47 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:05.977040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc4f9c-4465-48c2-aab4-255cced78d6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa303a60fec4ac5aaeb96c6618b387e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:05.983653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc4f9c-4465-48c2-aab4-255cced78d6b service placement] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:05.983913 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc4f9c-4465-48c2-aab4-255cced78d6b service placement] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:05.984197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc4f9c-4465-48c2-aab4-255cced78d6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:05.990006 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6fcc4f9c-4465-48c2-aab4-255cced78d6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:06.042637 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc4f9c-4465-48c2-aab4-255cced78d6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:06.046516 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc4f9c-4465-48c2-aab4-255cced78d6b service placement] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:06.072558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 796/1595] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:05 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:29:13.228743 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b454-fd05-408c-904b-30cdd0d30869 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:13.229352 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b454-fd05-408c-904b-30cdd0d30869 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:13.229782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b454-fd05-408c-904b-30cdd0d30869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:13.294777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-0896b454-fd05-408c-904b-30cdd0d30869 None None] MFA Rules not processed for user `78823bdcff4e45d8ab82558b434f188d`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:13.296040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0896b454-fd05-408c-904b-30cdd0d30869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:13.407246 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8caf5-b394-46fa-8800-b922d490e4b6 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:13.408041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8caf5-b394-46fa-8800-b922d490e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:13.408479 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8caf5-b394-46fa-8800-b922d490e4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:13.473989 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 800/1596] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:13 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:13.476810 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896b454-fd05-408c-904b-30cdd0d30869 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:13.489529 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-22d8caf5-b394-46fa-8800-b922d490e4b6 None None] MFA Rules not processed for user `045dda1ff9b44334954c08e63fcd20c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:13.489529 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-22d8caf5-b394-46fa-8800-b922d490e4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:13.503316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896b454-fd05-408c-904b-30cdd0d30869 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:13.513480 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05cb98-74fe-4569-9014-aee8778fa26c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:13.514141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05cb98-74fe-4569-9014-aee8778fa26c service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:13.514700 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05cb98-74fe-4569-9014-aee8778fa26c service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:13.514990 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05cb98-74fe-4569-9014-aee8778fa26c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:13.546850 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05cb98-74fe-4569-9014-aee8778fa26c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:13.549688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05cb98-74fe-4569-9014-aee8778fa26c service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:13.578114 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 801/1597] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:13 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:13.661754 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 797/1598] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:13 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:14.136545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05cb98-74fe-4569-9014-aee8778fa26c service nova] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:14.175458 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05cb98-74fe-4569-9014-aee8778fa26c service nova] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:14.200508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044fd12-0137-476d-bbf1-67b0e959cdb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:14.201869 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044fd12-0137-476d-bbf1-67b0e959cdb8 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:14.202388 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044fd12-0137-476d-bbf1-67b0e959cdb8 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:14.202896 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044fd12-0137-476d-bbf1-67b0e959cdb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:14.225371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044fd12-0137-476d-bbf1-67b0e959cdb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:14.230695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044fd12-0137-476d-bbf1-67b0e959cdb8 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:14.260653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 802/1599] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:14 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:14.505992 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e58d7-cb1f-4e6a-ade5-0dce369b62b1 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:14.506482 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e58d7-cb1f-4e6a-ade5-0dce369b62b1 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:14.506568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e58d7-cb1f-4e6a-ade5-0dce369b62b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:14.605967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-8c4e58d7-cb1f-4e6a-ade5-0dce369b62b1 None None] MFA Rules not processed for user `ac27192a9b2148f4bff8814f63813098`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:14.607198 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8c4e58d7-cb1f-4e6a-ade5-0dce369b62b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:14.772248 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 798/1600] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:14 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:14.777941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160a713-5833-4651-b5a6-622bbc999f41 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:14.778310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160a713-5833-4651-b5a6-622bbc999f41 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:14.778664 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160a713-5833-4651-b5a6-622bbc999f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:14.839238 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d160a713-5833-4651-b5a6-622bbc999f41 None None] MFA Rules not processed for user `ac27192a9b2148f4bff8814f63813098`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:14.839646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d160a713-5833-4651-b5a6-622bbc999f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:14.876488 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 803/1601] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:14 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:14.886334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e58d7-cb1f-4e6a-ade5-0dce369b62b1 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:14.914278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e58d7-cb1f-4e6a-ade5-0dce369b62b1 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:14.934449 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d381cd-32fe-40b8-b7fc-a4c157572cf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:14.936426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d381cd-32fe-40b8-b7fc-a4c157572cf0 service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:14.937496 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d381cd-32fe-40b8-b7fc-a4c157572cf0 service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:14.949065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d381cd-32fe-40b8-b7fc-a4c157572cf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:14.970681 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d381cd-32fe-40b8-b7fc-a4c157572cf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:14.973965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d381cd-32fe-40b8-b7fc-a4c157572cf0 service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:14.998017 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 799/1602] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:14 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:15.668703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ee997-b4f4-45aa-9931-d71c59454f78 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:15.668703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ee997-b4f4-45aa-9931-d71c59454f78 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:15.668703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ee997-b4f4-45aa-9931-d71c59454f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:15.668703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-a94ee997-b4f4-45aa-9931-d71c59454f78 None None] MFA Rules not processed for user `48b92ce8a3bd4d1ebfd94249d525addb`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:15.668703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a94ee997-b4f4-45aa-9931-d71c59454f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:15.668703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 804/1603] 10.222.0.83 () {58 vars in 1015 bytes} [Fri Oct 29 01:29:15 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:15.678139 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb787f-fa68-4c71-ac43-6fd9547de32b None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:15.678139 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb787f-fa68-4c71-ac43-6fd9547de32b None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:15.678139 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb787f-fa68-4c71-ac43-6fd9547de32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:15.681799 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ee997-b4f4-45aa-9931-d71c59454f78 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:15.683502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-f3eb787f-fa68-4c71-ac43-6fd9547de32b None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:15.686219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ee997-b4f4-45aa-9931-d71c59454f78 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:15.689155 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-f3eb787f-fa68-4c71-ac43-6fd9547de32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:15.691052 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665400d5-6f5b-4b56-a05f-60c774407fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:15.695172 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665400d5-6f5b-4b56-a05f-60c774407fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:15.695172 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665400d5-6f5b-4b56-a05f-60c774407fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:15.695172 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665400d5-6f5b-4b56-a05f-60c774407fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:15.712999 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665400d5-6f5b-4b56-a05f-60c774407fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:15.714461 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665400d5-6f5b-4b56-a05f-60c774407fa2 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:15.733494 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 805/1604] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:15 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:29:15.785989 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760f30-0ebb-47a4-b8dc-8780b445ace1 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:15.786431 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760f30-0ebb-47a4-b8dc-8780b445ace1 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:15.787108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760f30-0ebb-47a4-b8dc-8780b445ace1 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:15.790697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 806/1605] 10.222.0.87 () {54 vars in 912 bytes} [Fri Oct 29 01:29:15 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:29:15.797206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459265-154d-48d3-9c2c-87494098cd25 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:15.797695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459265-154d-48d3-9c2c-87494098cd25 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:15.798110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459265-154d-48d3-9c2c-87494098cd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:15.829294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-c8459265-154d-48d3-9c2c-87494098cd25 None None] MFA Rules not processed for user `48b92ce8a3bd4d1ebfd94249d525addb`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:15.833468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c8459265-154d-48d3-9c2c-87494098cd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:15.836794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 800/1606] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:29:15 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:15.849655 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 807/1607] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:29:15 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:15.885834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb787f-fa68-4c71-ac43-6fd9547de32b None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:15.897502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb787f-fa68-4c71-ac43-6fd9547de32b None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:15.901406 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2123c2-cdb7-48a4-9c6d-a6b3b5c53b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:15.902317 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2123c2-cdb7-48a4-9c6d-a6b3b5c53b69 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:15.902790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2123c2-cdb7-48a4-9c6d-a6b3b5c53b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:15.903250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2123c2-cdb7-48a4-9c6d-a6b3b5c53b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:15.912664 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2123c2-cdb7-48a4-9c6d-a6b3b5c53b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:15.916302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2123c2-cdb7-48a4-9c6d-a6b3b5c53b69 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:15.929699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 801/1608] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:15 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:16.341278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8459265-154d-48d3-9c2c-87494098cd25 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:16.343219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c8459265-154d-48d3-9c2c-87494098cd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:16.427019 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8459265-154d-48d3-9c2c-87494098cd25 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:16.432860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fd64b-faf9-419a-9e53-8cedfe64aff5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:16.433686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fd64b-faf9-419a-9e53-8cedfe64aff5 service swift] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:16.434069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fd64b-faf9-419a-9e53-8cedfe64aff5 service swift] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:16.434475 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fd64b-faf9-419a-9e53-8cedfe64aff5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:16.445412 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fd64b-faf9-419a-9e53-8cedfe64aff5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:16.448608 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fd64b-faf9-419a-9e53-8cedfe64aff5 service swift] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:16.481906 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 808/1609] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:29:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 01:29:17.406757 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548106e9-a2ac-4e77-9a2a-4e7e25f94666 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:17.407348 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548106e9-a2ac-4e77-9a2a-4e7e25f94666 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:17.407860 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548106e9-a2ac-4e77-9a2a-4e7e25f94666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:17.542375 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-548106e9-a2ac-4e77-9a2a-4e7e25f94666 None None] MFA Rules not processed for user `ac27192a9b2148f4bff8814f63813098`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:17.546194 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-548106e9-a2ac-4e77-9a2a-4e7e25f94666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:17.617572 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 802/1610] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:17 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:19.894961 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defcda9-cc3b-46be-b3ba-69427022675d None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:19.895552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defcda9-cc3b-46be-b3ba-69427022675d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:19.895552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defcda9-cc3b-46be-b3ba-69427022675d None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:19.898033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 809/1611] 10.222.0.87 () {54 vars in 921 bytes} [Fri Oct 29 01:29:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:29:19.910945 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71cfee-cf7d-474e-80c0-7c50f92ababa None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:19.910945 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71cfee-cf7d-474e-80c0-7c50f92ababa None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:19.910945 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71cfee-cf7d-474e-80c0-7c50f92ababa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:19.945627 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-1b71cfee-cf7d-474e-80c0-7c50f92ababa None None] MFA Rules not processed for user `28d331f2997547968c51fec87598420f`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:19.950873 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-1b71cfee-cf7d-474e-80c0-7c50f92ababa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:19.977414 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 803/1612] 10.222.0.87 () {58 vars in 1018 bytes} [Fri Oct 29 01:29:19 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:20.000019 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defcda9-cc3b-46be-b3ba-69427022675d None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:20.056202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defcda9-cc3b-46be-b3ba-69427022675d None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:20.056202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa675bd-c0d8-49f4-92ab-3bea557786d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:20.056202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa675bd-c0d8-49f4-92ab-3bea557786d9 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:20.056202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa675bd-c0d8-49f4-92ab-3bea557786d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:20.057781 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa675bd-c0d8-49f4-92ab-3bea557786d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:20.080926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa675bd-c0d8-49f4-92ab-3bea557786d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:20.082796 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa675bd-c0d8-49f4-92ab-3bea557786d9 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:20.114072 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 810/1613] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:19 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:22.105948 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71cfee-cf7d-474e-80c0-7c50f92ababa None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:22.323707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71cfee-cf7d-474e-80c0-7c50f92ababa None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:22.323707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a94221-4669-4984-97a9-c7d1c4ba74dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:22.323707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94221-4669-4984-97a9-c7d1c4ba74dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:22.323707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94221-4669-4984-97a9-c7d1c4ba74dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:22.325963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94221-4669-4984-97a9-c7d1c4ba74dc admin admin] PATH_INFO: `/v3/users/ea9114bcc3504d1788fba123a1d4b0a1` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:22.325963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a94221-4669-4984-97a9-c7d1c4ba74dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9114bcc3504d1788fba123a1d4b0a1)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:22.325963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: WARNING py.warnings [None req-32a94221-4669-4984-97a9-c7d1c4ba74dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:29:22.325963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: warnings.warn(msg) Oct 29 01:29:22.325963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: Oct 29 01:29:22.325963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a94221-4669-4984-97a9-c7d1c4ba74dc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:22.641262 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453338f-bec8-4116-bcea-d2876fc6bd43 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:22.641262 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453338f-bec8-4116-bcea-d2876fc6bd43 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:22.641262 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453338f-bec8-4116-bcea-d2876fc6bd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:22.714668 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-6453338f-bec8-4116-bcea-d2876fc6bd43 None None] MFA Rules not processed for user `045dda1ff9b44334954c08e63fcd20c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:22.719891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6453338f-bec8-4116-bcea-d2876fc6bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:22.720478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-32a94221-4669-4984-97a9-c7d1c4ba74dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9114bcc3504d1788fba123a1d4b0a1'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:22.769231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 811/1614] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:22 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:22.803307 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-32a94221-4669-4984-97a9-c7d1c4ba74dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9114bcc3504d1788fba123a1d4b0a1'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:22.803654 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-32a94221-4669-4984-97a9-c7d1c4ba74dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9114bcc3504d1788fba123a1d4b0a1'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:22.880286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-32a94221-4669-4984-97a9-c7d1c4ba74dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9114bcc3504d1788fba123a1d4b0a1'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:22.942002 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962027f2-6dd9-4da2-b500-e1a063c8c30f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:22.942414 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962027f2-6dd9-4da2-b500-e1a063c8c30f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:22.942880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962027f2-6dd9-4da2-b500-e1a063c8c30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:22.966080 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-32a94221-4669-4984-97a9-c7d1c4ba74dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9114bcc3504d1788fba123a1d4b0a1'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:23.005471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 804/1615] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:29:22 2021] DELETE /identity/v3/users/ea9114bcc3504d1788fba123a1d4b0a1 => generated 0 bytes in 901 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:23.026598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9983bc9-31ea-4881-8f22-a44076a950be None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:23.026985 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9983bc9-31ea-4881-8f22-a44076a950be None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:23.027274 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9983bc9-31ea-4881-8f22-a44076a950be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:23.033162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-962027f2-6dd9-4da2-b500-e1a063c8c30f None None] MFA Rules not processed for user `78823bdcff4e45d8ab82558b434f188d`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:23.035264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-962027f2-6dd9-4da2-b500-e1a063c8c30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:23.114492 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-c9983bc9-31ea-4881-8f22-a44076a950be None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:23.120073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c9983bc9-31ea-4881-8f22-a44076a950be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:23.321110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 805/1616] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:23.333566 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 812/1617] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:22 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:23.430874 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9983bc9-31ea-4881-8f22-a44076a950be None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:23.432831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c9983bc9-31ea-4881-8f22-a44076a950be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:23.610543 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9983bc9-31ea-4881-8f22-a44076a950be None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:23.617908 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb09885-499a-4180-8022-2d5f0ec9af44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:23.619210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb09885-499a-4180-8022-2d5f0ec9af44 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:23.619790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb09885-499a-4180-8022-2d5f0ec9af44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:23.620418 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb09885-499a-4180-8022-2d5f0ec9af44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:23.635399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb09885-499a-4180-8022-2d5f0ec9af44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:23.637518 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb09885-499a-4180-8022-2d5f0ec9af44 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:23.656068 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 806/1618] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:23.945171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962027f2-6dd9-4da2-b500-e1a063c8c30f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:23.946646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-962027f2-6dd9-4da2-b500-e1a063c8c30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:24.010949 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962027f2-6dd9-4da2-b500-e1a063c8c30f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:24.034823 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3fba4-366a-42b8-beec-3c7e85101ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:24.035918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3fba4-366a-42b8-beec-3c7e85101ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:24.036439 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3fba4-366a-42b8-beec-3c7e85101ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:24.037446 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3fba4-366a-42b8-beec-3c7e85101ce8 admin admin] PATH_INFO: `/v3/users/b52c4feb901c4137be7d259ef150dddd` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:24.040032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3fba4-366a-42b8-beec-3c7e85101ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b52c4feb901c4137be7d259ef150dddd)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:24.057892 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3fba4-366a-42b8-beec-3c7e85101ce8 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:24.779260 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c9f3fba4-366a-42b8-beec-3c7e85101ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b52c4feb901c4137be7d259ef150dddd'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:24.781201 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c9f3fba4-366a-42b8-beec-3c7e85101ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b52c4feb901c4137be7d259ef150dddd'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:24.835447 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c9f3fba4-366a-42b8-beec-3c7e85101ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b52c4feb901c4137be7d259ef150dddd'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:24.884117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c9f3fba4-366a-42b8-beec-3c7e85101ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b52c4feb901c4137be7d259ef150dddd'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:24.992968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c9f3fba4-366a-42b8-beec-3c7e85101ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b52c4feb901c4137be7d259ef150dddd'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:25.001398 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 813/1619] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:29:23 2021] DELETE /identity/v3/users/b52c4feb901c4137be7d259ef150dddd => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:25.005975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ad899-161b-4663-a4d2-973c526869ed None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:25.006809 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ad899-161b-4663-a4d2-973c526869ed None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:25.007248 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ad899-161b-4663-a4d2-973c526869ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:25.071762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-608ad899-161b-4663-a4d2-973c526869ed None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:25.075599 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-608ad899-161b-4663-a4d2-973c526869ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:25.222705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 807/1620] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:25.253795 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3fba4-366a-42b8-beec-3c7e85101ce8 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:25.255798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c9f3fba4-366a-42b8-beec-3c7e85101ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:25.367222 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3fba4-366a-42b8-beec-3c7e85101ce8 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:25.372671 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf91aa-0301-4e01-828d-88842a1f4b5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:25.374244 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf91aa-0301-4e01-828d-88842a1f4b5d service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:25.374919 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf91aa-0301-4e01-828d-88842a1f4b5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:25.375671 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf91aa-0301-4e01-828d-88842a1f4b5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:25.389025 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf91aa-0301-4e01-828d-88842a1f4b5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:25.391512 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf91aa-0301-4e01-828d-88842a1f4b5d service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:25.405335 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 814/1621] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:25.442592 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ad899-161b-4663-a4d2-973c526869ed None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:25.444535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-608ad899-161b-4663-a4d2-973c526869ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:25.480901 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ad899-161b-4663-a4d2-973c526869ed None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:25.519096 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ca67e-9966-4d13-b8a4-701c01b02953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:25.521440 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ca67e-9966-4d13-b8a4-701c01b02953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:25.522086 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ca67e-9966-4d13-b8a4-701c01b02953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:25.522592 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ca67e-9966-4d13-b8a4-701c01b02953 admin admin] PATH_INFO: `/v3/projects/5a5b0bd4a6574488a9735c09f46d000f` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:25.524376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ca67e-9966-4d13-b8a4-701c01b02953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5b0bd4a6574488a9735c09f46d000f)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:25.527607 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ca67e-9966-4d13-b8a4-701c01b02953 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:25.921174 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-712ca67e-9966-4d13-b8a4-701c01b02953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5b0bd4a6574488a9735c09f46d000f', 'request_id': 'req-712ca67e-9966-4d13-b8a4-701c01b02953'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:26.015597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-712ca67e-9966-4d13-b8a4-701c01b02953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5b0bd4a6574488a9735c09f46d000f', 'request_id': 'req-712ca67e-9966-4d13-b8a4-701c01b02953'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:26.044118 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-712ca67e-9966-4d13-b8a4-701c01b02953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5b0bd4a6574488a9735c09f46d000f', 'request_id': 'req-712ca67e-9966-4d13-b8a4-701c01b02953'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:26.085551 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-712ca67e-9966-4d13-b8a4-701c01b02953 admin admin] The token cache is being invalidate because project 5a5b0bd4a6574488a9735c09f46d000f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:26.086138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-712ca67e-9966-4d13-b8a4-701c01b02953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:26.087423 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-712ca67e-9966-4d13-b8a4-701c01b02953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:26.100683 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 808/1622] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:25 2021] DELETE /identity/v3/projects/5a5b0bd4a6574488a9735c09f46d000f => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:26.105596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4de36d-036c-440c-af54-e662a6adbb1c None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:26.106542 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4de36d-036c-440c-af54-e662a6adbb1c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:26.106960 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4de36d-036c-440c-af54-e662a6adbb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:26.139899 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-3c4de36d-036c-440c-af54-e662a6adbb1c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:26.145510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3c4de36d-036c-440c-af54-e662a6adbb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:26.368225 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 815/1623] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:26.378784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae18f36-af14-4a1b-94fa-78dcefb794b4 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:26.379339 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae18f36-af14-4a1b-94fa-78dcefb794b4 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:26.379761 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae18f36-af14-4a1b-94fa-78dcefb794b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:26.441948 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-dae18f36-af14-4a1b-94fa-78dcefb794b4 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:26.445152 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-dae18f36-af14-4a1b-94fa-78dcefb794b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:26.468647 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 809/1624] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:26.470490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4de36d-036c-440c-af54-e662a6adbb1c None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:26.500368 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4de36d-036c-440c-af54-e662a6adbb1c None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:26.511212 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22585657-5517-48ec-887a-69cc5d5f9cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:26.511930 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22585657-5517-48ec-887a-69cc5d5f9cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:26.512228 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22585657-5517-48ec-887a-69cc5d5f9cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:26.512492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22585657-5517-48ec-887a-69cc5d5f9cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:26.513248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22585657-5517-48ec-887a-69cc5d5f9cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:29:26.513550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22585657-5517-48ec-887a-69cc5d5f9cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:26.515565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22585657-5517-48ec-887a-69cc5d5f9cc7 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:26.582116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 816/1625] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:29:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:29:26.585317 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae18f36-af14-4a1b-94fa-78dcefb794b4 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:26.598447 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae18f36-af14-4a1b-94fa-78dcefb794b4 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:26.638266 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ad925-2aa9-4e2e-b026-605b1f8a4f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:26.638950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ad925-2aa9-4e2e-b026-605b1f8a4f96 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:26.639230 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ad925-2aa9-4e2e-b026-605b1f8a4f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:26.639504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ad925-2aa9-4e2e-b026-605b1f8a4f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:26.647224 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ad925-2aa9-4e2e-b026-605b1f8a4f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:26.653410 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ad925-2aa9-4e2e-b026-605b1f8a4f96 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:26.866972 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 810/1626] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:26 2021] POST /identity/v3/projects => generated 369 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:26.868727 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22585657-5517-48ec-887a-69cc5d5f9cc7 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:26.897387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22585657-5517-48ec-887a-69cc5d5f9cc7 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:26.985461 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1b66f-e9b9-4897-a423-61bbfaff167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:26.986895 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1b66f-e9b9-4897-a423-61bbfaff167b admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:26.987600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1b66f-e9b9-4897-a423-61bbfaff167b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:26.988142 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1b66f-e9b9-4897-a423-61bbfaff167b admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:26.989033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1b66f-e9b9-4897-a423-61bbfaff167b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:26.992459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1b66f-e9b9-4897-a423-61bbfaff167b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:27.041508 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ad925-2aa9-4e2e-b026-605b1f8a4f96 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:27.044003 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-963ad925-2aa9-4e2e-b026-605b1f8a4f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:27.068399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ad925-2aa9-4e2e-b026-605b1f8a4f96 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:27.093298 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e7692-b304-493b-9ebc-eca3f7e45860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:27.094504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e7692-b304-493b-9ebc-eca3f7e45860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:27.094942 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e7692-b304-493b-9ebc-eca3f7e45860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:27.095356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e7692-b304-493b-9ebc-eca3f7e45860 admin admin] PATH_INFO: `/v3/users/eb7980403926443ba1c1c1f71f4f6ef3` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:27.097614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e7692-b304-493b-9ebc-eca3f7e45860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7980403926443ba1c1c1f71f4f6ef3)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:27.104094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e7692-b304-493b-9ebc-eca3f7e45860 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:27.206232 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 817/1627] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:26 2021] POST /identity/v3/users => generated 285 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:27.208008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1b66f-e9b9-4897-a423-61bbfaff167b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:27.273248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1b66f-e9b9-4897-a423-61bbfaff167b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:27.273248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e8fd8-1fc4-44d5-bf82-5427a3f932a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:27.273248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e8fd8-1fc4-44d5-bf82-5427a3f932a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:27.273248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e8fd8-1fc4-44d5-bf82-5427a3f932a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:27.273549 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e8fd8-1fc4-44d5-bf82-5427a3f932a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:27.273549 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e8fd8-1fc4-44d5-bf82-5427a3f932a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:27.273549 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e8fd8-1fc4-44d5-bf82-5427a3f932a0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:27.273549 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 818/1628] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:27 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:27.277347 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e8fd8-1fc4-44d5-bf82-5427a3f932a0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:27.295842 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e8fd8-1fc4-44d5-bf82-5427a3f932a0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:27.306022 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0879227-23af-40be-ab59-9fad2e1f68f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:27.306978 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0879227-23af-40be-ab59-9fad2e1f68f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:27.307268 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0879227-23af-40be-ab59-9fad2e1f68f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:27.307544 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0879227-23af-40be-ab59-9fad2e1f68f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:27.308625 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0879227-23af-40be-ab59-9fad2e1f68f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:27.311139 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0879227-23af-40be-ab59-9fad2e1f68f1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:27.336808 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 819/1629] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:27 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:27.340817 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0879227-23af-40be-ab59-9fad2e1f68f1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:27.357856 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0879227-23af-40be-ab59-9fad2e1f68f1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:27.367627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8caf1-27f4-438b-8993-86541b027c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:27.375081 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8caf1-27f4-438b-8993-86541b027c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:27.375375 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8caf1-27f4-438b-8993-86541b027c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:27.375657 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8caf1-27f4-438b-8993-86541b027c88 admin admin] PATH_INFO: `/v3/projects/98c0b525bcb943199447d80d01c77e7e/users/4cc6c54209b042c195fd02e98164f416/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:27.411250 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8caf1-27f4-438b-8993-86541b027c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c0b525bcb943199447d80d01c77e7e, user_id=4cc6c54209b042c195fd02e98164f416, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:27.411250 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8caf1-27f4-438b-8993-86541b027c88 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:27.553539 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 820/1630] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:27 2021] PUT /identity/v3/projects/98c0b525bcb943199447d80d01c77e7e/users/4cc6c54209b042c195fd02e98164f416/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:29:27.561734 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be81e8d-5b6a-41b9-9516-9a82eb98a890 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:27.562106 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be81e8d-5b6a-41b9-9516-9a82eb98a890 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:27.562385 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be81e8d-5b6a-41b9-9516-9a82eb98a890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:27.612229 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-5be81e8d-5b6a-41b9-9516-9a82eb98a890 None None] MFA Rules not processed for user `4cc6c54209b042c195fd02e98164f416`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:27.612229 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-5be81e8d-5b6a-41b9-9516-9a82eb98a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:27.688837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2a5e7692-b304-493b-9ebc-eca3f7e45860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7980403926443ba1c1c1f71f4f6ef3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:27.709187 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2a5e7692-b304-493b-9ebc-eca3f7e45860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7980403926443ba1c1c1f71f4f6ef3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:27.711529 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2a5e7692-b304-493b-9ebc-eca3f7e45860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7980403926443ba1c1c1f71f4f6ef3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:27.742212 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2a5e7692-b304-493b-9ebc-eca3f7e45860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7980403926443ba1c1c1f71f4f6ef3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:27.786874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 821/1631] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:27 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:27.786874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be81e8d-5b6a-41b9-9516-9a82eb98a890 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:27.799813 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-5be81e8d-5b6a-41b9-9516-9a82eb98a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:27.976306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be81e8d-5b6a-41b9-9516-9a82eb98a890 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:27.976306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:27.976306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:27.976306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:27.978724 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d admin admin] PATH_INFO: `/v3/projects/c6df2f9d2bd74ac6860185fc740e5181` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:27.978724 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6df2f9d2bd74ac6860185fc740e5181)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:27.978724 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: WARNING py.warnings [None req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:29:27.978724 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: warnings.warn(msg) Oct 29 01:29:27.978724 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: Oct 29 01:29:27.978724 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:28.152164 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2a5e7692-b304-493b-9ebc-eca3f7e45860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7980403926443ba1c1c1f71f4f6ef3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:28.163381 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 811/1632] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:29:27 2021] DELETE /identity/v3/users/eb7980403926443ba1c1c1f71f4f6ef3 => generated 0 bytes in 1122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:29:28.170580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e7692-b304-493b-9ebc-eca3f7e45860 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:28.170580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2a5e7692-b304-493b-9ebc-eca3f7e45860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:28.288629 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e7692-b304-493b-9ebc-eca3f7e45860 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:28.297638 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf9193-86af-42cf-95a7-e6902d61dcee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:28.298245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf9193-86af-42cf-95a7-e6902d61dcee service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:28.298529 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf9193-86af-42cf-95a7-e6902d61dcee service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:28.299404 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf9193-86af-42cf-95a7-e6902d61dcee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:28.342505 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6df2f9d2bd74ac6860185fc740e5181', 'request_id': 'req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:28.412467 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf9193-86af-42cf-95a7-e6902d61dcee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:28.414335 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf9193-86af-42cf-95a7-e6902d61dcee service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:28.427977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 812/1633] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:28 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:28.429279 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93284561-c55e-4a3b-817c-4b407b0bcff7 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:28.429612 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93284561-c55e-4a3b-817c-4b407b0bcff7 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:28.429870 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93284561-c55e-4a3b-817c-4b407b0bcff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:28.454739 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-93284561-c55e-4a3b-817c-4b407b0bcff7 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:28.456419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-93284561-c55e-4a3b-817c-4b407b0bcff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:28.578709 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 813/1634] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:28.585704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93284561-c55e-4a3b-817c-4b407b0bcff7 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:28.585704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-93284561-c55e-4a3b-817c-4b407b0bcff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:28.618281 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6df2f9d2bd74ac6860185fc740e5181', 'request_id': 'req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:28.636778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6df2f9d2bd74ac6860185fc740e5181', 'request_id': 'req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:28.680576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d admin admin] The token cache is being invalidate because project c6df2f9d2bd74ac6860185fc740e5181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:28.682991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:28.684634 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-47fabe06-7672-4f2e-a4e3-6eb9f1f7268d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:28.689184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 822/1635] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:27 2021] DELETE /identity/v3/projects/c6df2f9d2bd74ac6860185fc740e5181 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:28.696062 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891630e-62fa-4f67-864d-25d8f678aae0 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:28.696397 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891630e-62fa-4f67-864d-25d8f678aae0 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:28.696894 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891630e-62fa-4f67-864d-25d8f678aae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:28.738622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93284561-c55e-4a3b-817c-4b407b0bcff7 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:28.738782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-4891630e-62fa-4f67-864d-25d8f678aae0 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:28.738782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4891630e-62fa-4f67-864d-25d8f678aae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:28.738923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ba299-ecc8-4089-9934-e9fb2d861f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:28.738923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ba299-ecc8-4089-9934-e9fb2d861f3c service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:28.738923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ba299-ecc8-4089-9934-e9fb2d861f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:28.738923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ba299-ecc8-4089-9934-e9fb2d861f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:28.741558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9e6ba299-ecc8-4089-9934-e9fb2d861f3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:28.762151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 823/1636] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:28.764215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5392058-a906-4670-9b00-0060c64ec7f4 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:28.764575 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5392058-a906-4670-9b00-0060c64ec7f4 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:28.764848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5392058-a906-4670-9b00-0060c64ec7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:28.770407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ba299-ecc8-4089-9934-e9fb2d861f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:28.773550 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ba299-ecc8-4089-9934-e9fb2d861f3c service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:28.789680 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 814/1637] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:28.799688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-b5392058-a906-4670-9b00-0060c64ec7f4 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:28.801373 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b5392058-a906-4670-9b00-0060c64ec7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:28.817707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 824/1638] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:28.828838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ba299-ecc8-4089-9934-e9fb2d861f3c service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:28.833660 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ba299-ecc8-4089-9934-e9fb2d861f3c service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:28.839378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add79d8-f603-4143-9bd7-035ffb1a0644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:28.840279 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add79d8-f603-4143-9bd7-035ffb1a0644 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:28.840587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add79d8-f603-4143-9bd7-035ffb1a0644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:28.840888 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add79d8-f603-4143-9bd7-035ffb1a0644 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:28.841831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add79d8-f603-4143-9bd7-035ffb1a0644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:29:28.842167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add79d8-f603-4143-9bd7-035ffb1a0644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:28.843936 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add79d8-f603-4143-9bd7-035ffb1a0644 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:28.864494 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 815/1639] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:29:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:29:28.869020 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5392058-a906-4670-9b00-0060c64ec7f4 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:28.880487 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5392058-a906-4670-9b00-0060c64ec7f4 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:28.886702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5e875-72ed-4c03-8a12-ea0f412376a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:28.887952 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5e875-72ed-4c03-8a12-ea0f412376a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:28.887952 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5e875-72ed-4c03-8a12-ea0f412376a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:28.888509 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5e875-72ed-4c03-8a12-ea0f412376a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:28.889454 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5e875-72ed-4c03-8a12-ea0f412376a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:28.891988 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5e875-72ed-4c03-8a12-ea0f412376a0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:29.037309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 825/1640] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:28 2021] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:29.040746 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add79d8-f603-4143-9bd7-035ffb1a0644 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:29.066280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add79d8-f603-4143-9bd7-035ffb1a0644 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:29.203862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f4768-4b02-48dc-b96b-4c3c758518ed None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:29.204298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f4768-4b02-48dc-b96b-4c3c758518ed None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:29.204688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f4768-4b02-48dc-b96b-4c3c758518ed None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:29.207404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 826/1641] 10.222.0.87 () {54 vars in 921 bytes} [Fri Oct 29 01:29:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:29:29.214344 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3f401-769a-45be-bfa6-ad1b7760ba25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:29.215045 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3f401-769a-45be-bfa6-ad1b7760ba25 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:29.215332 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3f401-769a-45be-bfa6-ad1b7760ba25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:29.215603 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3f401-769a-45be-bfa6-ad1b7760ba25 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:29.216345 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3f401-769a-45be-bfa6-ad1b7760ba25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:29.218603 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3f401-769a-45be-bfa6-ad1b7760ba25 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:29.221883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b330f9-d77b-4c86-8919-b27519b04ad5 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:29.222611 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b330f9-d77b-4c86-8919-b27519b04ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:29.223034 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b330f9-d77b-4c86-8919-b27519b04ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:29.255960 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d0b330f9-d77b-4c86-8919-b27519b04ad5 None None] MFA Rules not processed for user `28d331f2997547968c51fec87598420f`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:29.260738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d0b330f9-d77b-4c86-8919-b27519b04ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:29.382023 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 816/1642] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:29 2021] POST /identity/v3/users => generated 286 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:29.382481 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 827/1643] 10.222.0.87 () {58 vars in 1018 bytes} [Fri Oct 29 01:29:29 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:29.383238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3f401-769a-45be-bfa6-ad1b7760ba25 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:29.407810 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3f401-769a-45be-bfa6-ad1b7760ba25 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:29.430030 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11018b17-0b9a-49e0-abf8-3ba22099215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:29.438240 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11018b17-0b9a-49e0-abf8-3ba22099215f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:29.438240 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11018b17-0b9a-49e0-abf8-3ba22099215f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:29.438240 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11018b17-0b9a-49e0-abf8-3ba22099215f admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:29.438240 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11018b17-0b9a-49e0-abf8-3ba22099215f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:29.438240 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11018b17-0b9a-49e0-abf8-3ba22099215f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:29.447381 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 817/1644] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:29 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:29.452005 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b330f9-d77b-4c86-8919-b27519b04ad5 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:29.485473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b330f9-d77b-4c86-8919-b27519b04ad5 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:29.496959 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3744013-96eb-4906-9a17-3d34a1aaa156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:29.499838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3744013-96eb-4906-9a17-3d34a1aaa156 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:29.499838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3744013-96eb-4906-9a17-3d34a1aaa156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:29.499838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3744013-96eb-4906-9a17-3d34a1aaa156 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:29.499838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3744013-96eb-4906-9a17-3d34a1aaa156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:29.501451 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3744013-96eb-4906-9a17-3d34a1aaa156 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:29.522779 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 828/1645] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:29 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:29.524110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11018b17-0b9a-49e0-abf8-3ba22099215f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:29.544574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11018b17-0b9a-49e0-abf8-3ba22099215f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:29.553209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0e3d3-5dfd-4b8a-9373-52a5ac3ba607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:29.558693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0e3d3-5dfd-4b8a-9373-52a5ac3ba607 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:29.558693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0e3d3-5dfd-4b8a-9373-52a5ac3ba607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:29.558693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0e3d3-5dfd-4b8a-9373-52a5ac3ba607 admin admin] PATH_INFO: `/v3/projects/8a75e95f98a4401abb52d191eff9db7f/users/4280070b4d974b4193b846d39d2abe93/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:29.575608 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0e3d3-5dfd-4b8a-9373-52a5ac3ba607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a75e95f98a4401abb52d191eff9db7f, user_id=4280070b4d974b4193b846d39d2abe93, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:29.578580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0e3d3-5dfd-4b8a-9373-52a5ac3ba607 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:29.600736 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3744013-96eb-4906-9a17-3d34a1aaa156 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:29.602447 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-f3744013-96eb-4906-9a17-3d34a1aaa156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:29.619976 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3744013-96eb-4906-9a17-3d34a1aaa156 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:29.625922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8fed7-4a9b-4056-84c1-a95dcbe347e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:29.626565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8fed7-4a9b-4056-84c1-a95dcbe347e7 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:29.626882 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8fed7-4a9b-4056-84c1-a95dcbe347e7 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:29.628068 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8fed7-4a9b-4056-84c1-a95dcbe347e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:29.641389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8fed7-4a9b-4056-84c1-a95dcbe347e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:29.644308 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8fed7-4a9b-4056-84c1-a95dcbe347e7 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:29.656532 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 829/1646] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:29 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:29.657392 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8fed7-4a9b-4056-84c1-a95dcbe347e7 service nova] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:29.659564 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a5e8fed7-4a9b-4056-84c1-a95dcbe347e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:29.692296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8fed7-4a9b-4056-84c1-a95dcbe347e7 service nova] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:29.696655 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:29.697478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:29.698079 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:29.698198 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] PATH_INFO: `/v3/projects/78aef7315cec45edb329feeef343d983` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:29.699398 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78aef7315cec45edb329feeef343d983)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:29.701577 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:29.725236 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 818/1647] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:29 2021] PUT /identity/v3/projects/8a75e95f98a4401abb52d191eff9db7f/users/4280070b4d974b4193b846d39d2abe93/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:29.735549 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81975745-3c0f-4b62-9288-545c0ef2dcd6 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:29.736026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81975745-3c0f-4b62-9288-545c0ef2dcd6 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:29.736902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81975745-3c0f-4b62-9288-545c0ef2dcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:29.795869 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-81975745-3c0f-4b62-9288-545c0ef2dcd6 None None] MFA Rules not processed for user `4280070b4d974b4193b846d39d2abe93`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:29.797200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-81975745-3c0f-4b62-9288-545c0ef2dcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:29.910253 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78aef7315cec45edb329feeef343d983', 'request_id': 'req-da6b3a65-6661-4b1d-bc5c-aed51120b73c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:29.926196 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 819/1648] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:29 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:30.044615 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81975745-3c0f-4b62-9288-545c0ef2dcd6 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:30.132799 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81975745-3c0f-4b62-9288-545c0ef2dcd6 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:30.181089 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78aef7315cec45edb329feeef343d983', 'request_id': 'req-da6b3a65-6661-4b1d-bc5c-aed51120b73c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:30.187403 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78aef7315cec45edb329feeef343d983', 'request_id': 'req-da6b3a65-6661-4b1d-bc5c-aed51120b73c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:30.201011 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] The token cache is being invalidate because project 78aef7315cec45edb329feeef343d983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:30.201301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:30.202284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:30.202808 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01c11f-02b0-4b43-950e-634cbc720a92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:30.203717 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 830/1649] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:29 2021] DELETE /identity/v3/projects/78aef7315cec45edb329feeef343d983 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:30.203875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01c11f-02b0-4b43-950e-634cbc720a92 service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:30.203875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01c11f-02b0-4b43-950e-634cbc720a92 service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:30.204193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01c11f-02b0-4b43-950e-634cbc720a92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:30.206114 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ff01c11f-02b0-4b43-950e-634cbc720a92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:30.208174 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:30.209545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:30.309637 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b3a65-6661-4b1d-bc5c-aed51120b73c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:30.320158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0f578-9b84-4334-ad62-2e8db68f3938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:30.321033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0f578-9b84-4334-ad62-2e8db68f3938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:30.321404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0f578-9b84-4334-ad62-2e8db68f3938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:30.321609 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0f578-9b84-4334-ad62-2e8db68f3938 admin admin] PATH_INFO: `/v3/users/3de1c1601b3c4ecf944d7a6f955b6314` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:30.324098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0f578-9b84-4334-ad62-2e8db68f3938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de1c1601b3c4ecf944d7a6f955b6314)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:30.326354 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0f578-9b84-4334-ad62-2e8db68f3938 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:30.348609 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01c11f-02b0-4b43-950e-634cbc720a92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:30.351001 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01c11f-02b0-4b43-950e-634cbc720a92 service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:30.362768 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 820/1650] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:30 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:29:30.588487 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-64d0f578-9b84-4334-ad62-2e8db68f3938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de1c1601b3c4ecf944d7a6f955b6314'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:30.589281 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-64d0f578-9b84-4334-ad62-2e8db68f3938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de1c1601b3c4ecf944d7a6f955b6314'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:30.606645 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01c11f-02b0-4b43-950e-634cbc720a92 service nova] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:30.609151 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ff01c11f-02b0-4b43-950e-634cbc720a92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:30.626518 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01c11f-02b0-4b43-950e-634cbc720a92 service nova] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:30.631905 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-64d0f578-9b84-4334-ad62-2e8db68f3938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de1c1601b3c4ecf944d7a6f955b6314'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:30.632103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2ac95-e3e8-4544-b9e1-b216cf0066c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:30.633092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ac95-e3e8-4544-b9e1-b216cf0066c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:30.633435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ac95-e3e8-4544-b9e1-b216cf0066c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:30.633814 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ac95-e3e8-4544-b9e1-b216cf0066c4 admin admin] PATH_INFO: `/v3/users/4280070b4d974b4193b846d39d2abe93` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:30.635010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2ac95-e3e8-4544-b9e1-b216cf0066c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4280070b4d974b4193b846d39d2abe93)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:30.637100 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2ac95-e3e8-4544-b9e1-b216cf0066c4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:30.639047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-64d0f578-9b84-4334-ad62-2e8db68f3938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de1c1601b3c4ecf944d7a6f955b6314'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:30.712606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-64d0f578-9b84-4334-ad62-2e8db68f3938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de1c1601b3c4ecf944d7a6f955b6314'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:30.727303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 831/1651] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:29:30 2021] DELETE /identity/v3/users/3de1c1601b3c4ecf944d7a6f955b6314 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:30.847926 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-90d2ac95-e3e8-4544-b9e1-b216cf0066c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4280070b4d974b4193b846d39d2abe93'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:30.857944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-90d2ac95-e3e8-4544-b9e1-b216cf0066c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4280070b4d974b4193b846d39d2abe93'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:30.858682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-90d2ac95-e3e8-4544-b9e1-b216cf0066c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4280070b4d974b4193b846d39d2abe93'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:30.877573 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-90d2ac95-e3e8-4544-b9e1-b216cf0066c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4280070b4d974b4193b846d39d2abe93'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:31.067131 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-90d2ac95-e3e8-4544-b9e1-b216cf0066c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4280070b4d974b4193b846d39d2abe93'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:31.076823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 821/1652] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:29:30 2021] DELETE /identity/v3/users/4280070b4d974b4193b846d39d2abe93 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:29:31.081720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf71ed-7249-4a8b-beba-29ec504063cd None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:31.082011 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf71ed-7249-4a8b-beba-29ec504063cd None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:31.082385 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf71ed-7249-4a8b-beba-29ec504063cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:31.102473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-6baf71ed-7249-4a8b-beba-29ec504063cd None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:31.103684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6baf71ed-7249-4a8b-beba-29ec504063cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:31.170333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 832/1653] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:31.184627 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2ac95-e3e8-4544-b9e1-b216cf0066c4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:31.186273 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-90d2ac95-e3e8-4544-b9e1-b216cf0066c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:31.248438 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2ac95-e3e8-4544-b9e1-b216cf0066c4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:31.252682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ded55-6d56-4686-a359-1b9d2b22aecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:31.253525 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ded55-6d56-4686-a359-1b9d2b22aecd service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:31.253801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ded55-6d56-4686-a359-1b9d2b22aecd service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:31.254068 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ded55-6d56-4686-a359-1b9d2b22aecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:31.263308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ded55-6d56-4686-a359-1b9d2b22aecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:31.264755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ded55-6d56-4686-a359-1b9d2b22aecd service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:31.274769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 822/1654] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:31.353401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf71ed-7249-4a8b-beba-29ec504063cd None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:31.354895 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6baf71ed-7249-4a8b-beba-29ec504063cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:31.370545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf71ed-7249-4a8b-beba-29ec504063cd None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:31.375483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:31.376437 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:31.376786 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:31.377564 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee admin admin] PATH_INFO: `/v3/projects/95e14d61ca2e48bb8b52f18cf0a2018b` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:31.379203 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e14d61ca2e48bb8b52f18cf0a2018b)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:31.381369 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:31.535763 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e14d61ca2e48bb8b52f18cf0a2018b', 'request_id': 'req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:31.650141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e14d61ca2e48bb8b52f18cf0a2018b', 'request_id': 'req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:31.659307 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e14d61ca2e48bb8b52f18cf0a2018b', 'request_id': 'req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:31.676245 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee admin admin] The token cache is being invalidate because project 95e14d61ca2e48bb8b52f18cf0a2018b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:31.676804 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:31.677803 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-84809e46-7bb7-4d5d-84a5-5cb9d6fc25ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:31.680891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 833/1655] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:31 2021] DELETE /identity/v3/projects/95e14d61ca2e48bb8b52f18cf0a2018b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:31.686970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc45f-b88b-4ba3-82af-cbdf4a1e049b None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:31.687777 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc45f-b88b-4ba3-82af-cbdf4a1e049b None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:31.688891 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc45f-b88b-4ba3-82af-cbdf4a1e049b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:31.709980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-b7ebc45f-b88b-4ba3-82af-cbdf4a1e049b None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:31.711308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b7ebc45f-b88b-4ba3-82af-cbdf4a1e049b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:31.809445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 823/1656] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:31.811871 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd535c-1cc9-4c03-9915-400b065e2ab6 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:31.812422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd535c-1cc9-4c03-9915-400b065e2ab6 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:31.812809 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd535c-1cc9-4c03-9915-400b065e2ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:31.838362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-7cfd535c-1cc9-4c03-9915-400b065e2ab6 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:31.839881 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7cfd535c-1cc9-4c03-9915-400b065e2ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:31.851347 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 834/1657] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:31.857159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc45f-b88b-4ba3-82af-cbdf4a1e049b None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:31.875945 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc45f-b88b-4ba3-82af-cbdf4a1e049b None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:31.884915 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33e38a-4868-4675-aed1-aea808772ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:31.886093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33e38a-4868-4675-aed1-aea808772ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:31.886412 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33e38a-4868-4675-aed1-aea808772ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:31.886692 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33e38a-4868-4675-aed1-aea808772ed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:31.887622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33e38a-4868-4675-aed1-aea808772ed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:29:31.887975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33e38a-4868-4675-aed1-aea808772ed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:31.889571 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33e38a-4868-4675-aed1-aea808772ed9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:31.908731 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 824/1658] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:29:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:29:31.909710 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd535c-1cc9-4c03-9915-400b065e2ab6 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:31.928695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd535c-1cc9-4c03-9915-400b065e2ab6 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:31.954465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af624e-485c-4be2-b9c5-0e0a11850cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:31.954465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af624e-485c-4be2-b9c5-0e0a11850cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:31.954465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af624e-485c-4be2-b9c5-0e0a11850cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:31.954465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af624e-485c-4be2-b9c5-0e0a11850cc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:31.955587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af624e-485c-4be2-b9c5-0e0a11850cc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:31.966102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af624e-485c-4be2-b9c5-0e0a11850cc1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:32.111891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 835/1659] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:31 2021] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:32.114426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33e38a-4868-4675-aed1-aea808772ed9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:32.127534 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33e38a-4868-4675-aed1-aea808772ed9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:32.208302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af624e-485c-4be2-b9c5-0e0a11850cc1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:32.216119 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e0555-292d-4521-b892-3fa87afa507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:32.216876 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e0555-292d-4521-b892-3fa87afa507b admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:32.217157 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e0555-292d-4521-b892-3fa87afa507b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:32.217431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e0555-292d-4521-b892-3fa87afa507b admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:32.217984 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c9af624e-485c-4be2-b9c5-0e0a11850cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:32.218189 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e0555-292d-4521-b892-3fa87afa507b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:32.220172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e0555-292d-4521-b892-3fa87afa507b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:32.238366 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af624e-485c-4be2-b9c5-0e0a11850cc1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:32.251031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:32.271778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:32.272072 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:32.272359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab admin admin] PATH_INFO: `/v3/projects/8a75e95f98a4401abb52d191eff9db7f` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:32.276977 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a75e95f98a4401abb52d191eff9db7f)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:32.283302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:32.382217 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 825/1660] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:32 2021] POST /identity/v3/users => generated 283 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:32.394379 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e0555-292d-4521-b892-3fa87afa507b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:32.423398 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e0555-292d-4521-b892-3fa87afa507b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:32.435570 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a75e95f98a4401abb52d191eff9db7f', 'request_id': 'req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:32.509359 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e58a77-ab66-4d8c-b9da-c555af6f8e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:32.510181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e58a77-ab66-4d8c-b9da-c555af6f8e93 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:32.510620 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e58a77-ab66-4d8c-b9da-c555af6f8e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:32.511286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e58a77-ab66-4d8c-b9da-c555af6f8e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:32.513130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e58a77-ab66-4d8c-b9da-c555af6f8e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:32.514983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e58a77-ab66-4d8c-b9da-c555af6f8e93 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:32.519597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a75e95f98a4401abb52d191eff9db7f', 'request_id': 'req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:32.527349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a75e95f98a4401abb52d191eff9db7f', 'request_id': 'req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:32.532478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 826/1661] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:32 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:32.536020 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e58a77-ab66-4d8c-b9da-c555af6f8e93 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:32.547014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab admin admin] The token cache is being invalidate because project 8a75e95f98a4401abb52d191eff9db7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:32.547014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:32.547498 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eb6db4a8-ddf9-45e6-afc4-ad4725214cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:32.548170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e58a77-ab66-4d8c-b9da-c555af6f8e93 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:32.550827 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 836/1662] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:32 2021] DELETE /identity/v3/projects/8a75e95f98a4401abb52d191eff9db7f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:32.555395 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90ab72-0b79-49f2-913a-5679d71c15d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:32.556350 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90ab72-0b79-49f2-913a-5679d71c15d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:32.557042 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90ab72-0b79-49f2-913a-5679d71c15d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:32.558319 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b6ab-3030-4107-b7a3-69a2f6e1908d None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:32.558558 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b6ab-3030-4107-b7a3-69a2f6e1908d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:32.558905 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b6ab-3030-4107-b7a3-69a2f6e1908d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:32.566865 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90ab72-0b79-49f2-913a-5679d71c15d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:32.570907 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90ab72-0b79-49f2-913a-5679d71c15d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:32.574236 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90ab72-0b79-49f2-913a-5679d71c15d8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:32.590513 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 827/1663] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:32 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:32.591939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90ab72-0b79-49f2-913a-5679d71c15d8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:32.593886 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-dd90ab72-0b79-49f2-913a-5679d71c15d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:32.597816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d4f0b6ab-3030-4107-b7a3-69a2f6e1908d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:32.599334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d4f0b6ab-3030-4107-b7a3-69a2f6e1908d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:32.609105 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 837/1664] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:32.610561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90ab72-0b79-49f2-913a-5679d71c15d8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:32.617433 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f60a5-2065-49ec-af56-a67d655d998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:32.618422 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f60a5-2065-49ec-af56-a67d655d998f admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:32.618707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f60a5-2065-49ec-af56-a67d655d998f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:32.618992 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f60a5-2065-49ec-af56-a67d655d998f admin admin] PATH_INFO: `/v3/projects/4cc5d89194164c61a059ad65dc57b026/users/e8cc5af6ebf743d391d37b56078f532d/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:32.644697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f60a5-2065-49ec-af56-a67d655d998f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc5d89194164c61a059ad65dc57b026, user_id=e8cc5af6ebf743d391d37b56078f532d, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:32.648210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f60a5-2065-49ec-af56-a67d655d998f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:32.660900 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d975a-5bd1-424b-a801-70d0a101b97a None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:32.661813 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d975a-5bd1-424b-a801-70d0a101b97a None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:32.662291 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d975a-5bd1-424b-a801-70d0a101b97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:32.683906 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-004d975a-5bd1-424b-a801-70d0a101b97a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:32.684872 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-004d975a-5bd1-424b-a801-70d0a101b97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:32.698033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 838/1665] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:32.703426 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d975a-5bd1-424b-a801-70d0a101b97a None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:32.713316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d975a-5bd1-424b-a801-70d0a101b97a None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:32.718322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97be927-b75c-4c56-908a-0025714ca136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:32.719134 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97be927-b75c-4c56-908a-0025714ca136 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:32.719312 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97be927-b75c-4c56-908a-0025714ca136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:32.719556 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97be927-b75c-4c56-908a-0025714ca136 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:32.720845 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97be927-b75c-4c56-908a-0025714ca136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:29:32.720845 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97be927-b75c-4c56-908a-0025714ca136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:32.722462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97be927-b75c-4c56-908a-0025714ca136 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:32.735635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 839/1666] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:29:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:29:32.740587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97be927-b75c-4c56-908a-0025714ca136 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:32.746439 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 828/1667] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:32 2021] PUT /identity/v3/projects/4cc5d89194164c61a059ad65dc57b026/users/e8cc5af6ebf743d391d37b56078f532d/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:32.754162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97be927-b75c-4c56-908a-0025714ca136 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:32.807138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e2eb9-c38c-4102-bfe2-8883f94fb44e None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:32.808108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e2eb9-c38c-4102-bfe2-8883f94fb44e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:32.808108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e2eb9-c38c-4102-bfe2-8883f94fb44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:32.839651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-380e2eb9-c38c-4102-bfe2-8883f94fb44e None None] MFA Rules not processed for user `e8cc5af6ebf743d391d37b56078f532d`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:32.840982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-380e2eb9-c38c-4102-bfe2-8883f94fb44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:32.902922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42952d-9c41-46cd-9a75-223ef7154a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:32.903637 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42952d-9c41-46cd-9a75-223ef7154a27 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:32.903954 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42952d-9c41-46cd-9a75-223ef7154a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:32.904278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42952d-9c41-46cd-9a75-223ef7154a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:32.905025 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42952d-9c41-46cd-9a75-223ef7154a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:32.907139 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42952d-9c41-46cd-9a75-223ef7154a27 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:32.960426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 829/1668] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:32 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:32.962701 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e2eb9-c38c-4102-bfe2-8883f94fb44e None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:32.977781 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e2eb9-c38c-4102-bfe2-8883f94fb44e None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:32.987774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15560df-dee0-4f72-a2ed-a805d6c8b717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:32.988538 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15560df-dee0-4f72-a2ed-a805d6c8b717 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:32.989022 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15560df-dee0-4f72-a2ed-a805d6c8b717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:32.989299 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15560df-dee0-4f72-a2ed-a805d6c8b717 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:32.990026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15560df-dee0-4f72-a2ed-a805d6c8b717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:32.992467 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15560df-dee0-4f72-a2ed-a805d6c8b717 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:33.034540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 840/1669] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:32 2021] POST /identity/v3/projects => generated 383 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:29:33.038912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42952d-9c41-46cd-9a75-223ef7154a27 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:33.140299 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42952d-9c41-46cd-9a75-223ef7154a27 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:33.147321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8d10e-5996-4598-8e74-85b0c042f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:33.148642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d10e-5996-4598-8e74-85b0c042f32c admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:33.148642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d10e-5996-4598-8e74-85b0c042f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:33.148913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d10e-5996-4598-8e74-85b0c042f32c admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:33.149631 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8d10e-5996-4598-8e74-85b0c042f32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:33.151848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8d10e-5996-4598-8e74-85b0c042f32c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:33.227758 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 830/1670] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:32 2021] POST /identity/v3/projects => generated 363 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:29:33.229530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15560df-dee0-4f72-a2ed-a805d6c8b717 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:33.232982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-f15560df-dee0-4f72-a2ed-a805d6c8b717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:33.343711 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 841/1671] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:33 2021] POST /identity/v3/users => generated 292 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:29:33.344706 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8d10e-5996-4598-8e74-85b0c042f32c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:33.354498 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15560df-dee0-4f72-a2ed-a805d6c8b717 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:33.359214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8d10e-5996-4598-8e74-85b0c042f32c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:33.360172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16f74f-a6cf-43fd-bcbc-6b063005cdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:33.361578 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16f74f-a6cf-43fd-bcbc-6b063005cdc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:33.362799 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16f74f-a6cf-43fd-bcbc-6b063005cdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:33.363071 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16f74f-a6cf-43fd-bcbc-6b063005cdc2 admin admin] PATH_INFO: `/v3/users/4cc6c54209b042c195fd02e98164f416` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:33.365054 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16f74f-a6cf-43fd-bcbc-6b063005cdc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc6c54209b042c195fd02e98164f416)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:33.366957 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c1023-179f-4b9f-a82f-64743dcf170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:33.367614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16f74f-a6cf-43fd-bcbc-6b063005cdc2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:33.367802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c1023-179f-4b9f-a82f-64743dcf170f admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:33.368191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c1023-179f-4b9f-a82f-64743dcf170f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:33.369096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c1023-179f-4b9f-a82f-64743dcf170f admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:33.369917 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c1023-179f-4b9f-a82f-64743dcf170f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:33.372057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c1023-179f-4b9f-a82f-64743dcf170f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:33.484324 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 842/1672] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:33 2021] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:33.485656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c1023-179f-4b9f-a82f-64743dcf170f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:33.497832 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c1023-179f-4b9f-a82f-64743dcf170f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:33.503832 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d281c7b-f05c-4b73-9073-d4953292996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:33.504813 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d281c7b-f05c-4b73-9073-d4953292996c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:33.505304 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d281c7b-f05c-4b73-9073-d4953292996c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:33.505884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d281c7b-f05c-4b73-9073-d4953292996c admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:33.507002 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d281c7b-f05c-4b73-9073-d4953292996c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:33.508913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d281c7b-f05c-4b73-9073-d4953292996c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:33.521062 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 843/1673] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:33 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:33.530811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d281c7b-f05c-4b73-9073-d4953292996c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:33.534298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d281c7b-f05c-4b73-9073-d4953292996c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:33.541783 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4baf36-e380-47c9-951b-34ad8ec47a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:33.542464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4baf36-e380-47c9-951b-34ad8ec47a56 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:33.542745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4baf36-e380-47c9-951b-34ad8ec47a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:33.543017 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4baf36-e380-47c9-951b-34ad8ec47a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:33.543816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4baf36-e380-47c9-951b-34ad8ec47a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:33.545410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4baf36-e380-47c9-951b-34ad8ec47a56 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:33.556604 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 844/1674] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:33 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:33.557426 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4baf36-e380-47c9-951b-34ad8ec47a56 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:33.567255 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f16f74f-a6cf-43fd-bcbc-6b063005cdc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc6c54209b042c195fd02e98164f416'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:33.568045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4baf36-e380-47c9-951b-34ad8ec47a56 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:33.572867 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c18ca-4cf8-46a5-8045-7fcd3e6a08d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:33.573543 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c18ca-4cf8-46a5-8045-7fcd3e6a08d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:33.573820 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c18ca-4cf8-46a5-8045-7fcd3e6a08d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:33.574093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c18ca-4cf8-46a5-8045-7fcd3e6a08d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:33.575194 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c18ca-4cf8-46a5-8045-7fcd3e6a08d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:33.576676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f16f74f-a6cf-43fd-bcbc-6b063005cdc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc6c54209b042c195fd02e98164f416'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:33.576924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c18ca-4cf8-46a5-8045-7fcd3e6a08d9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:33.577504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f16f74f-a6cf-43fd-bcbc-6b063005cdc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc6c54209b042c195fd02e98164f416'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:33.588376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 845/1675] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:33.589212 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c18ca-4cf8-46a5-8045-7fcd3e6a08d9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:33.590907 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-127c18ca-4cf8-46a5-8045-7fcd3e6a08d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:33.600903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f16f74f-a6cf-43fd-bcbc-6b063005cdc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc6c54209b042c195fd02e98164f416'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:33.604442 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c18ca-4cf8-46a5-8045-7fcd3e6a08d9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:33.609378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a1f0d-047d-4a94-ae8f-c04e7befffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:33.610273 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a1f0d-047d-4a94-ae8f-c04e7befffa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:33.610550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a1f0d-047d-4a94-ae8f-c04e7befffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:33.610821 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a1f0d-047d-4a94-ae8f-c04e7befffa1 admin admin] PATH_INFO: `/v3/projects/b63de553bb794861b8cfcbb305d26933/users/3967945b2b7d447aa737cb6373bbcd64/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:33.626636 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a1f0d-047d-4a94-ae8f-c04e7befffa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63de553bb794861b8cfcbb305d26933, user_id=3967945b2b7d447aa737cb6373bbcd64, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:33.629522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a1f0d-047d-4a94-ae8f-c04e7befffa1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:33.723539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f16f74f-a6cf-43fd-bcbc-6b063005cdc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc6c54209b042c195fd02e98164f416'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:33.733228 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 831/1676] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:29:33 2021] DELETE /identity/v3/users/4cc6c54209b042c195fd02e98164f416 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:33.737166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16f74f-a6cf-43fd-bcbc-6b063005cdc2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:33.738749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6f16f74f-a6cf-43fd-bcbc-6b063005cdc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:33.760635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 846/1677] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:33 2021] PUT /identity/v3/projects/b63de553bb794861b8cfcbb305d26933/users/3967945b2b7d447aa737cb6373bbcd64/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:33.762610 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f07ad-2486-4265-abd0-49441ba47b95 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:33.763060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f07ad-2486-4265-abd0-49441ba47b95 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:33.764031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f07ad-2486-4265-abd0-49441ba47b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:33.799121 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-bd1f07ad-2486-4265-abd0-49441ba47b95 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:33.800782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-bd1f07ad-2486-4265-abd0-49441ba47b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:33.843223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16f74f-a6cf-43fd-bcbc-6b063005cdc2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:33.915826 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 847/1678] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:33.918289 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f07ad-2486-4265-abd0-49441ba47b95 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:33.931653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f07ad-2486-4265-abd0-49441ba47b95 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:33.940147 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89c677-ea17-4712-8230-e6986b5a0ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:33.941390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c677-ea17-4712-8230-e6986b5a0ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:33.941746 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c677-ea17-4712-8230-e6986b5a0ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:33.942091 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c677-ea17-4712-8230-e6986b5a0ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:33.942964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89c677-ea17-4712-8230-e6986b5a0ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:33.945301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89c677-ea17-4712-8230-e6986b5a0ef0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:33.963883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 848/1679] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:33 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:33.963883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89c677-ea17-4712-8230-e6986b5a0ef0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:33.966111 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0a89c677-ea17-4712-8230-e6986b5a0ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:33.983583 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a104acc-a306-4dd3-8d55-9b743c395afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:33.984850 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a104acc-a306-4dd3-8d55-9b743c395afa admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:33.985141 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a104acc-a306-4dd3-8d55-9b743c395afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:33.985898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a104acc-a306-4dd3-8d55-9b743c395afa admin admin] PATH_INFO: `/v3/projects/1512450f9efa4545a9d2d856526d9317/users/e77533f5ea94497eaaa0514bbf05b0dc/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:34.015226 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a104acc-a306-4dd3-8d55-9b743c395afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1512450f9efa4545a9d2d856526d9317, user_id=e77533f5ea94497eaaa0514bbf05b0dc, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:34.019573 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a104acc-a306-4dd3-8d55-9b743c395afa admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:34.060456 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89c677-ea17-4712-8230-e6986b5a0ef0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:34.066784 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a53c8a-77a7-4863-bbc8-ddbc0a7e8f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:34.068818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a53c8a-77a7-4863-bbc8-ddbc0a7e8f22 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:34.068818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a53c8a-77a7-4863-bbc8-ddbc0a7e8f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:34.068818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a53c8a-77a7-4863-bbc8-ddbc0a7e8f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:34.082814 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a53c8a-77a7-4863-bbc8-ddbc0a7e8f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:34.084533 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a53c8a-77a7-4863-bbc8-ddbc0a7e8f22 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:34.097579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 832/1680] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:33 2021] PUT /identity/v3/projects/1512450f9efa4545a9d2d856526d9317/users/e77533f5ea94497eaaa0514bbf05b0dc/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:34.098577 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a104acc-a306-4dd3-8d55-9b743c395afa admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:34.118554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 849/1681] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:34.119954 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b85ce2-ccec-4327-b266-6d28a61f304e None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:34.120244 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b85ce2-ccec-4327-b266-6d28a61f304e None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:34.121056 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b85ce2-ccec-4327-b266-6d28a61f304e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:34.173032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-f4b85ce2-ccec-4327-b266-6d28a61f304e None None] MFA Rules not processed for user `e77533f5ea94497eaaa0514bbf05b0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:34.174797 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-f4b85ce2-ccec-4327-b266-6d28a61f304e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:34.232194 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a104acc-a306-4dd3-8d55-9b743c395afa admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:34.238754 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cf391-102c-4b47-94ea-d0f3387312e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:34.239668 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cf391-102c-4b47-94ea-d0f3387312e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:34.240055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cf391-102c-4b47-94ea-d0f3387312e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:34.240322 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cf391-102c-4b47-94ea-d0f3387312e5 admin admin] PATH_INFO: `/v3/projects/b63de553bb794861b8cfcbb305d26933/users/3967945b2b7d447aa737cb6373bbcd64/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:34.243021 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cf391-102c-4b47-94ea-d0f3387312e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63de553bb794861b8cfcbb305d26933, user_id=3967945b2b7d447aa737cb6373bbcd64, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:34.245938 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cf391-102c-4b47-94ea-d0f3387312e5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:34.261917 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 833/1682] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:34 2021] PUT /identity/v3/projects/b63de553bb794861b8cfcbb305d26933/users/3967945b2b7d447aa737cb6373bbcd64/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:34.272751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769428b-95ed-4ab7-ab06-056ca23483c2 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:34.273031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769428b-95ed-4ab7-ab06-056ca23483c2 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:34.273302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769428b-95ed-4ab7-ab06-056ca23483c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:34.297926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 850/1683] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:34 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:34.303076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b85ce2-ccec-4327-b266-6d28a61f304e None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:34.314780 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-c769428b-95ed-4ab7-ab06-056ca23483c2 None None] MFA Rules not processed for user `3967945b2b7d447aa737cb6373bbcd64`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:34.317728 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c769428b-95ed-4ab7-ab06-056ca23483c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:34.319291 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b85ce2-ccec-4327-b266-6d28a61f304e None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:34.410449 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15688de-e8d9-4bf0-9e80-cd36b3cdfdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:34.411746 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15688de-e8d9-4bf0-9e80-cd36b3cdfdee admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:34.412506 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15688de-e8d9-4bf0-9e80-cd36b3cdfdee admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:34.413298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15688de-e8d9-4bf0-9e80-cd36b3cdfdee admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:34.414752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15688de-e8d9-4bf0-9e80-cd36b3cdfdee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:34.420195 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15688de-e8d9-4bf0-9e80-cd36b3cdfdee admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:34.424076 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 834/1684] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:34 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:34.438432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769428b-95ed-4ab7-ab06-056ca23483c2 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:34.443523 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c769428b-95ed-4ab7-ab06-056ca23483c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:34.522224 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769428b-95ed-4ab7-ab06-056ca23483c2 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:34.526178 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479e5ee-ffb1-43cb-a7df-f6ac456c16f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:34.526847 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479e5ee-ffb1-43cb-a7df-f6ac456c16f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:34.529820 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479e5ee-ffb1-43cb-a7df-f6ac456c16f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:34.529820 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479e5ee-ffb1-43cb-a7df-f6ac456c16f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:34.540932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479e5ee-ffb1-43cb-a7df-f6ac456c16f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:34.542598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479e5ee-ffb1-43cb-a7df-f6ac456c16f3 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:34.561477 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 835/1685] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:34 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:34.585848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 851/1686] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:34 2021] POST /identity/v3/projects => generated 381 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:29:34.591374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479e5ee-ffb1-43cb-a7df-f6ac456c16f3 service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:34.607102 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479e5ee-ffb1-43cb-a7df-f6ac456c16f3 service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:34.706811 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713588a-c3a8-43ab-8ac7-9738847fc7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:34.707588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713588a-c3a8-43ab-8ac7-9738847fc7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:34.707933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713588a-c3a8-43ab-8ac7-9738847fc7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:34.708377 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713588a-c3a8-43ab-8ac7-9738847fc7e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:34.708996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713588a-c3a8-43ab-8ac7-9738847fc7e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:34.711374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713588a-c3a8-43ab-8ac7-9738847fc7e4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:34.816056 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 836/1687] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:34 2021] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:34.820170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15688de-e8d9-4bf0-9e80-cd36b3cdfdee admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:34.833484 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15688de-e8d9-4bf0-9e80-cd36b3cdfdee admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:34.839573 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a70a50-8aeb-4727-8153-02dd26dcd7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:34.840435 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a70a50-8aeb-4727-8153-02dd26dcd7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:34.840805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a70a50-8aeb-4727-8153-02dd26dcd7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:34.841158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a70a50-8aeb-4727-8153-02dd26dcd7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:34.857464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a70a50-8aeb-4727-8153-02dd26dcd7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:34.859682 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a70a50-8aeb-4727-8153-02dd26dcd7f0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:34.907790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713588a-c3a8-43ab-8ac7-9738847fc7e4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:34.909413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 852/1688] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:34 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:29:34.911663 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a70a50-8aeb-4727-8153-02dd26dcd7f0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:34.929170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a70a50-8aeb-4727-8153-02dd26dcd7f0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:34.937775 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8caf74-38e4-4838-b9b0-0c734cca9647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:34.938816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8caf74-38e4-4838-b9b0-0c734cca9647 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:34.939851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8caf74-38e4-4838-b9b0-0c734cca9647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:34.940229 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8caf74-38e4-4838-b9b0-0c734cca9647 admin admin] PATH_INFO: `/v3/projects/ab50ff8e2e084ca4b2b9cde22ad54cc6/users/56d8c0e3fc82402fb9c70160475a97ef/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:34.994172 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8caf74-38e4-4838-b9b0-0c734cca9647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab50ff8e2e084ca4b2b9cde22ad54cc6, user_id=56d8c0e3fc82402fb9c70160475a97ef, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:35.007787 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8caf74-38e4-4838-b9b0-0c734cca9647 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:35.062926 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713588a-c3a8-43ab-8ac7-9738847fc7e4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:35.075957 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1a3d6-42b8-4f24-b88a-520a0e66658d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:35.076637 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1a3d6-42b8-4f24-b88a-520a0e66658d service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:35.076915 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1a3d6-42b8-4f24-b88a-520a0e66658d service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:35.077186 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1a3d6-42b8-4f24-b88a-520a0e66658d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:35.081426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ffc1a3d6-42b8-4f24-b88a-520a0e66658d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:35.174196 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1a3d6-42b8-4f24-b88a-520a0e66658d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:35.177153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1a3d6-42b8-4f24-b88a-520a0e66658d service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:35.206491 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 837/1689] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:34 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:35.325402 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 853/1690] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:34 2021] PUT /identity/v3/projects/ab50ff8e2e084ca4b2b9cde22ad54cc6/users/56d8c0e3fc82402fb9c70160475a97ef/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:35.329323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1a3d6-42b8-4f24-b88a-520a0e66658d service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:35.344732 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1a3d6-42b8-4f24-b88a-520a0e66658d service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:35.362469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8caf74-38e4-4838-b9b0-0c734cca9647 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:35.364936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7d8caf74-38e4-4838-b9b0-0c734cca9647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:35.466211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3fd52-030b-4275-98c9-69882351aeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:35.466890 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3fd52-030b-4275-98c9-69882351aeda admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:35.467180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3fd52-030b-4275-98c9-69882351aeda admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:35.467452 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3fd52-030b-4275-98c9-69882351aeda admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:35.468227 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3fd52-030b-4275-98c9-69882351aeda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:35.469818 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3fd52-030b-4275-98c9-69882351aeda admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:35.476963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8caf74-38e4-4838-b9b0-0c734cca9647 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:35.484084 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 838/1691] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:35 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:35.484248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070c9d6-aeac-4ee2-936a-f372cc6586bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:35.484248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070c9d6-aeac-4ee2-936a-f372cc6586bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:35.484248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070c9d6-aeac-4ee2-936a-f372cc6586bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:35.484248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070c9d6-aeac-4ee2-936a-f372cc6586bd admin admin] PATH_INFO: `/v3/projects/98c0b525bcb943199447d80d01c77e7e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:35.485085 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3fd52-030b-4275-98c9-69882351aeda admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:35.485196 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070c9d6-aeac-4ee2-936a-f372cc6586bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c0b525bcb943199447d80d01c77e7e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:35.487913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070c9d6-aeac-4ee2-936a-f372cc6586bd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:35.497828 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3fd52-030b-4275-98c9-69882351aeda admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:35.503687 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922204a-05e4-481f-8983-d199a2e10b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:35.505725 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922204a-05e4-481f-8983-d199a2e10b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:35.505725 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922204a-05e4-481f-8983-d199a2e10b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:35.505725 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922204a-05e4-481f-8983-d199a2e10b9d admin admin] PATH_INFO: `/v3/projects/ab50ff8e2e084ca4b2b9cde22ad54cc6/users/56d8c0e3fc82402fb9c70160475a97ef/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:35.507408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922204a-05e4-481f-8983-d199a2e10b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab50ff8e2e084ca4b2b9cde22ad54cc6, user_id=56d8c0e3fc82402fb9c70160475a97ef, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:35.509917 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922204a-05e4-481f-8983-d199a2e10b9d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:35.525902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 839/1692] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:35 2021] PUT /identity/v3/projects/ab50ff8e2e084ca4b2b9cde22ad54cc6/users/56d8c0e3fc82402fb9c70160475a97ef/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:29:35.537994 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba560f1-9cc2-494c-9e4d-a2b2f6ab6bd6 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:35.540110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba560f1-9cc2-494c-9e4d-a2b2f6ab6bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:35.540110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba560f1-9cc2-494c-9e4d-a2b2f6ab6bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:35.566716 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-aba560f1-9cc2-494c-9e4d-a2b2f6ab6bd6 None None] MFA Rules not processed for user `56d8c0e3fc82402fb9c70160475a97ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:35.567961 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-aba560f1-9cc2-494c-9e4d-a2b2f6ab6bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:35.617492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-5070c9d6-aeac-4ee2-936a-f372cc6586bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c0b525bcb943199447d80d01c77e7e', 'request_id': 'req-5070c9d6-aeac-4ee2-936a-f372cc6586bd'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:35.656747 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 840/1693] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:35 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:35.668663 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba560f1-9cc2-494c-9e4d-a2b2f6ab6bd6 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:35.683023 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-5070c9d6-aeac-4ee2-936a-f372cc6586bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c0b525bcb943199447d80d01c77e7e', 'request_id': 'req-5070c9d6-aeac-4ee2-936a-f372cc6586bd'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:35.689574 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-5070c9d6-aeac-4ee2-936a-f372cc6586bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c0b525bcb943199447d80d01c77e7e', 'request_id': 'req-5070c9d6-aeac-4ee2-936a-f372cc6586bd'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:35.701353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-5070c9d6-aeac-4ee2-936a-f372cc6586bd admin admin] The token cache is being invalidate because project 98c0b525bcb943199447d80d01c77e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:35.702032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-5070c9d6-aeac-4ee2-936a-f372cc6586bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:35.702708 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-5070c9d6-aeac-4ee2-936a-f372cc6586bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:35.706036 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 854/1694] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:35 2021] DELETE /identity/v3/projects/98c0b525bcb943199447d80d01c77e7e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:35.711516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00118d5e-a18d-438d-83d6-da3763141885 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:35.716816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00118d5e-a18d-438d-83d6-da3763141885 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:35.716816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00118d5e-a18d-438d-83d6-da3763141885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:35.731470 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba560f1-9cc2-494c-9e4d-a2b2f6ab6bd6 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:35.738394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-00118d5e-a18d-438d-83d6-da3763141885 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:35.739962 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-00118d5e-a18d-438d-83d6-da3763141885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:35.793202 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574ccfe-4f48-42d9-9886-b408629df29b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:35.793855 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574ccfe-4f48-42d9-9886-b408629df29b service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:35.794274 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574ccfe-4f48-42d9-9886-b408629df29b service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:35.794628 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574ccfe-4f48-42d9-9886-b408629df29b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:35.796684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2574ccfe-4f48-42d9-9886-b408629df29b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:35.807883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 855/1695] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:35.817881 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52b9f1-55b6-43b3-a0f1-3c65f34270c5 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:35.818170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52b9f1-55b6-43b3-a0f1-3c65f34270c5 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:35.818438 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52b9f1-55b6-43b3-a0f1-3c65f34270c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:35.838881 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-9f52b9f1-55b6-43b3-a0f1-3c65f34270c5 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:35.840208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-9f52b9f1-55b6-43b3-a0f1-3c65f34270c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:35.850034 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 856/1696] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:35.854213 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52b9f1-55b6-43b3-a0f1-3c65f34270c5 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:35.864532 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52b9f1-55b6-43b3-a0f1-3c65f34270c5 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:35.870105 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853007a2-10b1-4cae-b089-0a52f0bd5f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:35.870834 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853007a2-10b1-4cae-b089-0a52f0bd5f4b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:35.871117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853007a2-10b1-4cae-b089-0a52f0bd5f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:35.871387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853007a2-10b1-4cae-b089-0a52f0bd5f4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:35.872824 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853007a2-10b1-4cae-b089-0a52f0bd5f4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:29:35.873170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853007a2-10b1-4cae-b089-0a52f0bd5f4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:35.874778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853007a2-10b1-4cae-b089-0a52f0bd5f4b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:35.890383 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 857/1697] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:29:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:29:35.896500 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853007a2-10b1-4cae-b089-0a52f0bd5f4b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:35.902951 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574ccfe-4f48-42d9-9886-b408629df29b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:35.904749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574ccfe-4f48-42d9-9886-b408629df29b service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:35.915028 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853007a2-10b1-4cae-b089-0a52f0bd5f4b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:35.921876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed9508-84aa-4e55-9565-a220dbec92db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:35.925168 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed9508-84aa-4e55-9565-a220dbec92db admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:35.925639 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed9508-84aa-4e55-9565-a220dbec92db admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:35.926253 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed9508-84aa-4e55-9565-a220dbec92db admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:35.927394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed9508-84aa-4e55-9565-a220dbec92db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:35.927515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 841/1698] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:35 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:29:35.930865 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed9508-84aa-4e55-9565-a220dbec92db admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:36.013969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574ccfe-4f48-42d9-9886-b408629df29b service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:36.019066 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2574ccfe-4f48-42d9-9886-b408629df29b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:36.027398 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574ccfe-4f48-42d9-9886-b408629df29b service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:36.032588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e48a37-ce6c-4fc8-a047-fabf902b217b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:36.036499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48a37-ce6c-4fc8-a047-fabf902b217b service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:36.036499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48a37-ce6c-4fc8-a047-fabf902b217b service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:36.036499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48a37-ce6c-4fc8-a047-fabf902b217b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:36.037956 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-31e48a37-ce6c-4fc8-a047-fabf902b217b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:36.089404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 858/1699] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:35 2021] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:29:36.094788 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed9508-84aa-4e55-9565-a220dbec92db admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:36.144032 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e48a37-ce6c-4fc8-a047-fabf902b217b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:36.144032 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e48a37-ce6c-4fc8-a047-fabf902b217b service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:36.162464 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 842/1700] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:36 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:29:36.309896 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed9508-84aa-4e55-9565-a220dbec92db admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:36.349760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5e170-03ca-4913-8ab0-fc6350ff168e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:36.351010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5e170-03ca-4913-8ab0-fc6350ff168e admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:36.351522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5e170-03ca-4913-8ab0-fc6350ff168e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:36.353305 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5e170-03ca-4913-8ab0-fc6350ff168e admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:36.364519 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5e170-03ca-4913-8ab0-fc6350ff168e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:36.374882 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5e170-03ca-4913-8ab0-fc6350ff168e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:36.509522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 859/1701] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:36 2021] POST /identity/v3/users => generated 290 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:36.514268 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e48a37-ce6c-4fc8-a047-fabf902b217b service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:36.534079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e48a37-ce6c-4fc8-a047-fabf902b217b service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:36.552039 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0dbf1-71e6-4ecc-a07f-28d09fc7a3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:36.552877 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0dbf1-71e6-4ecc-a07f-28d09fc7a3ba admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:36.553261 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0dbf1-71e6-4ecc-a07f-28d09fc7a3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:36.553781 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0dbf1-71e6-4ecc-a07f-28d09fc7a3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:36.554660 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0dbf1-71e6-4ecc-a07f-28d09fc7a3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:36.556436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0dbf1-71e6-4ecc-a07f-28d09fc7a3ba admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:36.571779 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 843/1702] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:36 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:36.576755 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5e170-03ca-4913-8ab0-fc6350ff168e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:36.593966 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5e170-03ca-4913-8ab0-fc6350ff168e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:36.599152 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786b461-6ea1-4faf-84d1-25c115c61cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:36.599936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786b461-6ea1-4faf-84d1-25c115c61cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:36.600220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786b461-6ea1-4faf-84d1-25c115c61cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:36.600492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786b461-6ea1-4faf-84d1-25c115c61cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:36.601240 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786b461-6ea1-4faf-84d1-25c115c61cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:36.602832 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786b461-6ea1-4faf-84d1-25c115c61cb6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:36.619092 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 860/1703] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:36 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:36.622104 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0dbf1-71e6-4ecc-a07f-28d09fc7a3ba admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:36.632714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0dbf1-71e6-4ecc-a07f-28d09fc7a3ba admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:36.638599 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0746f8-e29e-4674-b6e2-d264c4bd08e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:36.639776 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0746f8-e29e-4674-b6e2-d264c4bd08e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:36.640136 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0746f8-e29e-4674-b6e2-d264c4bd08e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:36.640474 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0746f8-e29e-4674-b6e2-d264c4bd08e2 admin admin] PATH_INFO: `/v3/projects/e884787cf37c45e0b45f73a860f68c93/users/3dae15c4604c4797af67b96fa29dff24/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:36.656588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0746f8-e29e-4674-b6e2-d264c4bd08e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e884787cf37c45e0b45f73a860f68c93, user_id=3dae15c4604c4797af67b96fa29dff24, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:36.659354 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0746f8-e29e-4674-b6e2-d264c4bd08e2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:36.791156 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 844/1704] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:36 2021] PUT /identity/v3/projects/e884787cf37c45e0b45f73a860f68c93/users/3dae15c4604c4797af67b96fa29dff24/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:36.842565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069461-f894-4ba2-a847-f812545fd0fd None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:36.843089 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069461-f894-4ba2-a847-f812545fd0fd None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:36.843285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069461-f894-4ba2-a847-f812545fd0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:36.903395 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-37069461-f894-4ba2-a847-f812545fd0fd None None] MFA Rules not processed for user `3dae15c4604c4797af67b96fa29dff24`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:36.906767 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-37069461-f894-4ba2-a847-f812545fd0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:37.020900 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 861/1705] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:36 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:37.025598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0746f8-e29e-4674-b6e2-d264c4bd08e2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:37.129115 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0746f8-e29e-4674-b6e2-d264c4bd08e2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:37.135169 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fdb23-bbc6-41c3-88d5-53a602a783c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:37.135985 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fdb23-bbc6-41c3-88d5-53a602a783c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:37.136096 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fdb23-bbc6-41c3-88d5-53a602a783c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:37.136406 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fdb23-bbc6-41c3-88d5-53a602a783c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:37.137167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fdb23-bbc6-41c3-88d5-53a602a783c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:37.139471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fdb23-bbc6-41c3-88d5-53a602a783c0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:37.258535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 845/1706] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:37 2021] POST /identity/v3/projects => generated 379 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:37.262596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37069461-f894-4ba2-a847-f812545fd0fd None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:37.279944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37069461-f894-4ba2-a847-f812545fd0fd None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:37.414462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7fd2f-6775-422a-830c-7c533637c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:37.416215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7fd2f-6775-422a-830c-7c533637c893 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:37.416774 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7fd2f-6775-422a-830c-7c533637c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:37.418813 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7fd2f-6775-422a-830c-7c533637c893 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:37.419660 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7fd2f-6775-422a-830c-7c533637c893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:37.426716 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7fd2f-6775-422a-830c-7c533637c893 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:37.558789 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 862/1707] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:37 2021] POST /identity/v3/users => generated 296 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:37.565698 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fdb23-bbc6-41c3-88d5-53a602a783c0 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:37.585197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fdb23-bbc6-41c3-88d5-53a602a783c0 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:37.594522 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab862df1-5fc2-4fc0-83a8-d8998925d401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:37.596302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab862df1-5fc2-4fc0-83a8-d8998925d401 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:37.600051 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab862df1-5fc2-4fc0-83a8-d8998925d401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:37.600051 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab862df1-5fc2-4fc0-83a8-d8998925d401 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:37.600051 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab862df1-5fc2-4fc0-83a8-d8998925d401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:37.602939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab862df1-5fc2-4fc0-83a8-d8998925d401 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:37.624598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 846/1708] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:37 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:37.632436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7fd2f-6775-422a-830c-7c533637c893 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:37.650468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7fd2f-6775-422a-830c-7c533637c893 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:37.657076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c7978-b304-4119-9891-7e8b0edee317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:37.658667 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7978-b304-4119-9891-7e8b0edee317 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:37.659108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7978-b304-4119-9891-7e8b0edee317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:37.659637 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7978-b304-4119-9891-7e8b0edee317 admin admin] PATH_INFO: `/v3/projects/f3cb8332a0ba4c848f4b4d1fdf82de51/users/b7e750920fd04eb999f1197f80f00565/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:37.676228 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c7978-b304-4119-9891-7e8b0edee317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3cb8332a0ba4c848f4b4d1fdf82de51, user_id=b7e750920fd04eb999f1197f80f00565, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:37.679388 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c7978-b304-4119-9891-7e8b0edee317 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:37.790466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 863/1709] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:37 2021] PUT /identity/v3/projects/f3cb8332a0ba4c848f4b4d1fdf82de51/users/b7e750920fd04eb999f1197f80f00565/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:37.791011 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab862df1-5fc2-4fc0-83a8-d8998925d401 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:37.795201 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab862df1-5fc2-4fc0-83a8-d8998925d401 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:37.951188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6000f-b050-4e5f-b706-6e459765e20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:37.951975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6000f-b050-4e5f-b706-6e459765e20f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:37.952256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6000f-b050-4e5f-b706-6e459765e20f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:37.952533 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6000f-b050-4e5f-b706-6e459765e20f admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:37.953426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6000f-b050-4e5f-b706-6e459765e20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:37.955641 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6000f-b050-4e5f-b706-6e459765e20f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:37.981965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 847/1710] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:37 2021] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:37.986096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c7978-b304-4119-9891-7e8b0edee317 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:38.003666 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c7978-b304-4119-9891-7e8b0edee317 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:38.022690 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c693d-e640-4316-9934-a73766c15b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:38.027178 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c693d-e640-4316-9934-a73766c15b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:38.032476 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c693d-e640-4316-9934-a73766c15b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:38.033679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c693d-e640-4316-9934-a73766c15b37 admin admin] PATH_INFO: `/v3/projects/f3cb8332a0ba4c848f4b4d1fdf82de51/users/b7e750920fd04eb999f1197f80f00565/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:38.040082 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c693d-e640-4316-9934-a73766c15b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3cb8332a0ba4c848f4b4d1fdf82de51, user_id=b7e750920fd04eb999f1197f80f00565, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:38.043035 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c693d-e640-4316-9934-a73766c15b37 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:38.063494 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 864/1711] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:37 2021] PUT /identity/v3/projects/f3cb8332a0ba4c848f4b4d1fdf82de51/users/b7e750920fd04eb999f1197f80f00565/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:38.082609 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff46cd-7014-4cf2-bc1f-db9426d52587 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:38.083654 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff46cd-7014-4cf2-bc1f-db9426d52587 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:38.083961 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff46cd-7014-4cf2-bc1f-db9426d52587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:38.118868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ccff46cd-7014-4cf2-bc1f-db9426d52587 None None] MFA Rules not processed for user `b7e750920fd04eb999f1197f80f00565`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:38.120197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ccff46cd-7014-4cf2-bc1f-db9426d52587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:38.203548 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 848/1712] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:38 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:38.218298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c693d-e640-4316-9934-a73766c15b37 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:38.338348 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c693d-e640-4316-9934-a73766c15b37 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:38.343118 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bd5de-5e27-4b39-bccb-e2ac2919f1be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:38.343817 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bd5de-5e27-4b39-bccb-e2ac2919f1be service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:38.344105 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bd5de-5e27-4b39-bccb-e2ac2919f1be service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:38.344691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bd5de-5e27-4b39-bccb-e2ac2919f1be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:38.357901 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bd5de-5e27-4b39-bccb-e2ac2919f1be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:38.359707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bd5de-5e27-4b39-bccb-e2ac2919f1be service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:38.398625 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 865/1713] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:38 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:39.633626 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff46cd-7014-4cf2-bc1f-db9426d52587 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:39.635138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ccff46cd-7014-4cf2-bc1f-db9426d52587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:39.711497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff46cd-7014-4cf2-bc1f-db9426d52587 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:39.721582 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bd5de-5e27-4b39-bccb-e2ac2919f1be service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:39.722802 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5454f-e93e-473e-9f8c-3055e8ab2561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:39.723873 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5454f-e93e-473e-9f8c-3055e8ab2561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:39.724153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5454f-e93e-473e-9f8c-3055e8ab2561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:39.724425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5454f-e93e-473e-9f8c-3055e8ab2561 admin admin] PATH_INFO: `/v3/users/e8cc5af6ebf743d391d37b56078f532d` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:39.725893 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5454f-e93e-473e-9f8c-3055e8ab2561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8cc5af6ebf743d391d37b56078f532d)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:39.728633 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5454f-e93e-473e-9f8c-3055e8ab2561 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:39.730823 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bd5de-5e27-4b39-bccb-e2ac2919f1be service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:39.735967 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1111731-a5f6-4dff-8547-7fb004887a6e tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e750920fd04eb999f1197f80f00565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3cb8332a0ba4c848f4b4d1fdf82de51', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:39.736639 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111731-a5f6-4dff-8547-7fb004887a6e tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:39.736922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111731-a5f6-4dff-8547-7fb004887a6e tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:39.737200 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111731-a5f6-4dff-8547-7fb004887a6e tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:39.737945 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1111731-a5f6-4dff-8547-7fb004887a6e tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:29:39.738256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1111731-a5f6-4dff-8547-7fb004887a6e tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:39.739936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1111731-a5f6-4dff-8547-7fb004887a6e tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:39.755536 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 866/1714] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:29:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:29:39.758784 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1111731-a5f6-4dff-8547-7fb004887a6e tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:39.769222 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1111731-a5f6-4dff-8547-7fb004887a6e tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:39.773763 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cb6e9-fbf3-402a-9a02-f2118e5bc953 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e750920fd04eb999f1197f80f00565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3cb8332a0ba4c848f4b4d1fdf82de51', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:39.774409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cb6e9-fbf3-402a-9a02-f2118e5bc953 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:39.774694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cb6e9-fbf3-402a-9a02-f2118e5bc953 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:39.774971 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cb6e9-fbf3-402a-9a02-f2118e5bc953 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:39.775670 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cb6e9-fbf3-402a-9a02-f2118e5bc953 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:39.777587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cb6e9-fbf3-402a-9a02-f2118e5bc953 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:39.879522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 867/1715] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:39 2021] POST /identity/v3/projects => generated 353 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:29:39.883911 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cb6e9-fbf3-402a-9a02-f2118e5bc953 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:39.915574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a4b5454f-e93e-473e-9f8c-3055e8ab2561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8cc5af6ebf743d391d37b56078f532d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:39.925639 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a4b5454f-e93e-473e-9f8c-3055e8ab2561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8cc5af6ebf743d391d37b56078f532d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:39.926405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a4b5454f-e93e-473e-9f8c-3055e8ab2561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8cc5af6ebf743d391d37b56078f532d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:39.940632 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a4b5454f-e93e-473e-9f8c-3055e8ab2561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8cc5af6ebf743d391d37b56078f532d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:39.973425 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cb6e9-fbf3-402a-9a02-f2118e5bc953 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:39.980261 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a8758-b582-495e-9270-8b1dbbd7c960 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e750920fd04eb999f1197f80f00565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3cb8332a0ba4c848f4b4d1fdf82de51', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:39.980977 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a8758-b582-495e-9270-8b1dbbd7c960 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:39.981264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a8758-b582-495e-9270-8b1dbbd7c960 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:39.981548 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a8758-b582-495e-9270-8b1dbbd7c960 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:39.982303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a8758-b582-495e-9270-8b1dbbd7c960 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:29:39.982616 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a8758-b582-495e-9270-8b1dbbd7c960 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:39.984537 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a8758-b582-495e-9270-8b1dbbd7c960 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:39.998523 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 868/1716] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:29:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:29:40.008378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a8758-b582-495e-9270-8b1dbbd7c960 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:40.010984 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e91a8758-b582-495e-9270-8b1dbbd7c960 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:40.019599 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a4b5454f-e93e-473e-9f8c-3055e8ab2561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8cc5af6ebf743d391d37b56078f532d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:40.023349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 849/1717] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:29:39 2021] DELETE /identity/v3/users/e8cc5af6ebf743d391d37b56078f532d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:40.036706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd8a8-fce1-45a5-b324-3c0886f5f041 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:40.037541 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd8a8-fce1-45a5-b324-3c0886f5f041 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:40.039219 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd8a8-fce1-45a5-b324-3c0886f5f041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:40.083798 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-544dd8a8-fce1-45a5-b324-3c0886f5f041 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:40.085619 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-544dd8a8-fce1-45a5-b324-3c0886f5f041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:40.167513 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a8758-b582-495e-9270-8b1dbbd7c960 tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:40.210384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 850/1718] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:40.210384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dd8a8-fce1-45a5-b324-3c0886f5f041 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:40.210384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-544dd8a8-fce1-45a5-b324-3c0886f5f041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:40.254726 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dc62d-7666-4b0b-ae34-db95c57bdd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:40.255607 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dc62d-7666-4b0b-ae34-db95c57bdd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:40.256340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dc62d-7666-4b0b-ae34-db95c57bdd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:40.256617 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dc62d-7666-4b0b-ae34-db95c57bdd09 admin admin] PATH_INFO: `/v3/users/e77533f5ea94497eaaa0514bbf05b0dc` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:40.262638 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dc62d-7666-4b0b-ae34-db95c57bdd09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77533f5ea94497eaaa0514bbf05b0dc)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:40.268877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dc62d-7666-4b0b-ae34-db95c57bdd09 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:40.305516 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dd8a8-fce1-45a5-b324-3c0886f5f041 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:40.310404 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e750920fd04eb999f1197f80f00565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3cb8332a0ba4c848f4b4d1fdf82de51', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:40.311295 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:40.311584 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:40.311898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] PATH_INFO: `/v3/projects/012a6c75d4b449258008988b87ccfdd3` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:40.315202 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] RBAC: Authorizing `identity:delete_project(project_id=012a6c75d4b449258008988b87ccfdd3)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:40.316636 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:40.508894 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-855dc62d-7666-4b0b-ae34-db95c57bdd09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77533f5ea94497eaaa0514bbf05b0dc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:40.509615 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-855dc62d-7666-4b0b-ae34-db95c57bdd09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77533f5ea94497eaaa0514bbf05b0dc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:40.515091 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012a6c75d4b449258008988b87ccfdd3', 'request_id': 'req-6f24d579-bc72-4d94-9cff-daa768ba241f'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:40.529193 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-855dc62d-7666-4b0b-ae34-db95c57bdd09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77533f5ea94497eaaa0514bbf05b0dc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:40.536470 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-855dc62d-7666-4b0b-ae34-db95c57bdd09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77533f5ea94497eaaa0514bbf05b0dc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:40.580604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012a6c75d4b449258008988b87ccfdd3', 'request_id': 'req-6f24d579-bc72-4d94-9cff-daa768ba241f'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:40.587903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012a6c75d4b449258008988b87ccfdd3', 'request_id': 'req-6f24d579-bc72-4d94-9cff-daa768ba241f'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:40.600809 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] The token cache is being invalidate because project 012a6c75d4b449258008988b87ccfdd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:40.601096 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:40.601856 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:40.603567 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 851/1719] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:40 2021] DELETE /identity/v3/projects/012a6c75d4b449258008988b87ccfdd3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:40.604539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:40.606028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:40.648745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-855dc62d-7666-4b0b-ae34-db95c57bdd09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77533f5ea94497eaaa0514bbf05b0dc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:40.659178 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 869/1720] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:29:39 2021] DELETE /identity/v3/users/e77533f5ea94497eaaa0514bbf05b0dc => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:40.664279 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8c1a-a121-4da5-a68e-8294ab8655f7 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:40.664952 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8c1a-a121-4da5-a68e-8294ab8655f7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:40.665334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8c1a-a121-4da5-a68e-8294ab8655f7 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:40.667713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 870/1721] 10.222.0.87 () {54 vars in 921 bytes} [Fri Oct 29 01:29:40 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:29:40.668831 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396e578-0ce3-4004-9a9b-06048d8d3be2 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:40.669116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396e578-0ce3-4004-9a9b-06048d8d3be2 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:40.669849 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396e578-0ce3-4004-9a9b-06048d8d3be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:40.682121 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24d579-bc72-4d94-9cff-daa768ba241f tempest-VolumeQuotaClassesTest-126471577 tempest-VolumeQuotaClassesTest-126471577-project-admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:40.689550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-7396e578-0ce3-4004-9a9b-06048d8d3be2 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:40.690750 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7396e578-0ce3-4004-9a9b-06048d8d3be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:40.732775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62280ac6-b2db-4973-a191-ddd68e364547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:40.733406 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62280ac6-b2db-4973-a191-ddd68e364547 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:40.733835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62280ac6-b2db-4973-a191-ddd68e364547 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:40.734158 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62280ac6-b2db-4973-a191-ddd68e364547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:40.736691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-62280ac6-b2db-4973-a191-ddd68e364547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:40.761890 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 871/1722] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:40.763283 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542f313-ac28-469c-9927-91370b1f0339 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:40.763572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542f313-ac28-469c-9927-91370b1f0339 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:40.763926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542f313-ac28-469c-9927-91370b1f0339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:40.788092 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8542f313-ac28-469c-9927-91370b1f0339 None None] MFA Rules not processed for user `28d331f2997547968c51fec87598420f`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:40.789335 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8542f313-ac28-469c-9927-91370b1f0339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:40.814621 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62280ac6-b2db-4973-a191-ddd68e364547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:40.820627 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62280ac6-b2db-4973-a191-ddd68e364547 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:40.826989 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 852/1723] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:40.827931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62280ac6-b2db-4973-a191-ddd68e364547 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:40.839481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62280ac6-b2db-4973-a191-ddd68e364547 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:40.858269 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b538c3c-2c6d-4819-acd0-2eeac9a98381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:40.859124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b538c3c-2c6d-4819-acd0-2eeac9a98381 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:40.859403 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b538c3c-2c6d-4819-acd0-2eeac9a98381 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:40.859676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b538c3c-2c6d-4819-acd0-2eeac9a98381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:40.916730 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b538c3c-2c6d-4819-acd0-2eeac9a98381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:40.918170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b538c3c-2c6d-4819-acd0-2eeac9a98381 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:40.923645 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 872/1724] 10.222.0.87 () {58 vars in 1018 bytes} [Fri Oct 29 01:29:40 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:40.940258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 853/1725] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:41.101554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542f313-ac28-469c-9927-91370b1f0339 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:41.103259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8542f313-ac28-469c-9927-91370b1f0339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:41.121606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542f313-ac28-469c-9927-91370b1f0339 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:41.131270 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f21d1-29fd-47fb-a091-d9a99f94f0fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:41.131270 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f21d1-29fd-47fb-a091-d9a99f94f0fa service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:41.131270 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f21d1-29fd-47fb-a091-d9a99f94f0fa service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:41.131270 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f21d1-29fd-47fb-a091-d9a99f94f0fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:41.146902 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f21d1-29fd-47fb-a091-d9a99f94f0fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:41.148712 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f21d1-29fd-47fb-a091-d9a99f94f0fa service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:41.171389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 873/1726] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:41 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:41.242923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b538c3c-2c6d-4819-acd0-2eeac9a98381 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:41.244899 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-7b538c3c-2c6d-4819-acd0-2eeac9a98381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:41.277065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b538c3c-2c6d-4819-acd0-2eeac9a98381 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:41.284274 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13393f-83f4-4ea2-8135-8bb80a81ee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:41.285570 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13393f-83f4-4ea2-8135-8bb80a81ee87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:41.286173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13393f-83f4-4ea2-8135-8bb80a81ee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:41.286547 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13393f-83f4-4ea2-8135-8bb80a81ee87 admin admin] PATH_INFO: `/v3/users/3dae15c4604c4797af67b96fa29dff24` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:41.288167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13393f-83f4-4ea2-8135-8bb80a81ee87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dae15c4604c4797af67b96fa29dff24)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:41.290995 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13393f-83f4-4ea2-8135-8bb80a81ee87 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:41.366797 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f21d1-29fd-47fb-a091-d9a99f94f0fa service nova] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:41.368881 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-053f21d1-29fd-47fb-a091-d9a99f94f0fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:41.398463 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f21d1-29fd-47fb-a091-d9a99f94f0fa service nova] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:41.429260 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79370ee0-0567-434a-93d9-6de5ca7f3eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:41.430143 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79370ee0-0567-434a-93d9-6de5ca7f3eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:41.430418 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79370ee0-0567-434a-93d9-6de5ca7f3eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:41.430821 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79370ee0-0567-434a-93d9-6de5ca7f3eaf admin admin] PATH_INFO: `/v3/projects/4cc5d89194164c61a059ad65dc57b026` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:41.433317 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79370ee0-0567-434a-93d9-6de5ca7f3eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc5d89194164c61a059ad65dc57b026)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:41.439280 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79370ee0-0567-434a-93d9-6de5ca7f3eaf admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:41.483973 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2a13393f-83f4-4ea2-8135-8bb80a81ee87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dae15c4604c4797af67b96fa29dff24'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.491099 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2a13393f-83f4-4ea2-8135-8bb80a81ee87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dae15c4604c4797af67b96fa29dff24'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.493860 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2a13393f-83f4-4ea2-8135-8bb80a81ee87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dae15c4604c4797af67b96fa29dff24'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.505421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2a13393f-83f4-4ea2-8135-8bb80a81ee87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dae15c4604c4797af67b96fa29dff24'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.604238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2a13393f-83f4-4ea2-8135-8bb80a81ee87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dae15c4604c4797af67b96fa29dff24'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.613967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 854/1727] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:29:41 2021] DELETE /identity/v3/users/3dae15c4604c4797af67b96fa29dff24 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:41.617678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13393f-83f4-4ea2-8135-8bb80a81ee87 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:41.619197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2a13393f-83f4-4ea2-8135-8bb80a81ee87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:41.625846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-79370ee0-0567-434a-93d9-6de5ca7f3eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc5d89194164c61a059ad65dc57b026', 'request_id': 'req-79370ee0-0567-434a-93d9-6de5ca7f3eaf'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.690841 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13393f-83f4-4ea2-8135-8bb80a81ee87 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:41.696028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:41.696967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:41.697244 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:41.697515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] PATH_INFO: `/v3/projects/1512450f9efa4545a9d2d856526d9317` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:41.698960 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1512450f9efa4545a9d2d856526d9317)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:41.701241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:41.707174 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-79370ee0-0567-434a-93d9-6de5ca7f3eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc5d89194164c61a059ad65dc57b026', 'request_id': 'req-79370ee0-0567-434a-93d9-6de5ca7f3eaf'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.718165 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-79370ee0-0567-434a-93d9-6de5ca7f3eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc5d89194164c61a059ad65dc57b026', 'request_id': 'req-79370ee0-0567-434a-93d9-6de5ca7f3eaf'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.732358 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-79370ee0-0567-434a-93d9-6de5ca7f3eaf admin admin] The token cache is being invalidate because project 4cc5d89194164c61a059ad65dc57b026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:41.732649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-79370ee0-0567-434a-93d9-6de5ca7f3eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.733749 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-79370ee0-0567-434a-93d9-6de5ca7f3eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.736153 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 874/1728] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:41 2021] DELETE /identity/v3/projects/4cc5d89194164c61a059ad65dc57b026 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:29:41.737903 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080ff88-643d-4951-b384-97233bcd33df None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:41.742358 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080ff88-643d-4951-b384-97233bcd33df None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:41.742358 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080ff88-643d-4951-b384-97233bcd33df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:41.759648 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d080ff88-643d-4951-b384-97233bcd33df None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:41.761174 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d080ff88-643d-4951-b384-97233bcd33df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:41.769545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 875/1729] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:41.770488 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080ff88-643d-4951-b384-97233bcd33df None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:41.771766 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d080ff88-643d-4951-b384-97233bcd33df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:41.784324 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080ff88-643d-4951-b384-97233bcd33df None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:41.789457 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f21b3-64a7-4689-b138-49fdde3abe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:41.790776 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f21b3-64a7-4689-b138-49fdde3abe26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:41.791060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f21b3-64a7-4689-b138-49fdde3abe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:41.791336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f21b3-64a7-4689-b138-49fdde3abe26 admin admin] PATH_INFO: `/v3/users/3967945b2b7d447aa737cb6373bbcd64` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:41.792755 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f21b3-64a7-4689-b138-49fdde3abe26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3967945b2b7d447aa737cb6373bbcd64)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:41.794642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f21b3-64a7-4689-b138-49fdde3abe26 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:41.809381 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1512450f9efa4545a9d2d856526d9317', 'request_id': 'req-6baf2049-8946-4d67-a107-d42e5454fad5'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.861102 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1512450f9efa4545a9d2d856526d9317', 'request_id': 'req-6baf2049-8946-4d67-a107-d42e5454fad5'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.868251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1512450f9efa4545a9d2d856526d9317', 'request_id': 'req-6baf2049-8946-4d67-a107-d42e5454fad5'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.880529 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] The token cache is being invalidate because project 1512450f9efa4545a9d2d856526d9317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:41.880827 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.882042 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:41.883606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 855/1730] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:41 2021] DELETE /identity/v3/projects/1512450f9efa4545a9d2d856526d9317 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:41.884444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:41.885903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:41.955959 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf2049-8946-4d67-a107-d42e5454fad5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:41.959881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07ecd-8724-4c4e-ad15-9d7c3c581399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:41.966429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07ecd-8724-4c4e-ad15-9d7c3c581399 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:41.966429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07ecd-8724-4c4e-ad15-9d7c3c581399 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:41.966429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07ecd-8724-4c4e-ad15-9d7c3c581399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:41.966429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6ad07ecd-8724-4c4e-ad15-9d7c3c581399 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:42.000758 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ff4f21b3-64a7-4689-b138-49fdde3abe26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3967945b2b7d447aa737cb6373bbcd64'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.001547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ff4f21b3-64a7-4689-b138-49fdde3abe26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3967945b2b7d447aa737cb6373bbcd64'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.015153 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ff4f21b3-64a7-4689-b138-49fdde3abe26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3967945b2b7d447aa737cb6373bbcd64'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.022884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ff4f21b3-64a7-4689-b138-49fdde3abe26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3967945b2b7d447aa737cb6373bbcd64'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.029456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad07ecd-8724-4c4e-ad15-9d7c3c581399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:42.030842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad07ecd-8724-4c4e-ad15-9d7c3c581399 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:42.041326 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 856/1731] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:42.045805 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07ecd-8724-4c4e-ad15-9d7c3c581399 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:42.047209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6ad07ecd-8724-4c4e-ad15-9d7c3c581399 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:42.062140 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07ecd-8724-4c4e-ad15-9d7c3c581399 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:42.068197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95050e-3258-4df7-a4d4-19b207d7b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:42.069073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95050e-3258-4df7-a4d4-19b207d7b690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:42.069362 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95050e-3258-4df7-a4d4-19b207d7b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:42.069633 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95050e-3258-4df7-a4d4-19b207d7b690 admin admin] PATH_INFO: `/v3/users/56d8c0e3fc82402fb9c70160475a97ef` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:42.071089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95050e-3258-4df7-a4d4-19b207d7b690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d8c0e3fc82402fb9c70160475a97ef)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:42.073923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95050e-3258-4df7-a4d4-19b207d7b690 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:42.100728 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ff4f21b3-64a7-4689-b138-49fdde3abe26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3967945b2b7d447aa737cb6373bbcd64'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.111833 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 876/1732] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:29:41 2021] DELETE /identity/v3/users/3967945b2b7d447aa737cb6373bbcd64 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:42.315752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-db95050e-3258-4df7-a4d4-19b207d7b690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d8c0e3fc82402fb9c70160475a97ef'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.323610 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-db95050e-3258-4df7-a4d4-19b207d7b690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d8c0e3fc82402fb9c70160475a97ef'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.324432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-db95050e-3258-4df7-a4d4-19b207d7b690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d8c0e3fc82402fb9c70160475a97ef'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.355865 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-db95050e-3258-4df7-a4d4-19b207d7b690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d8c0e3fc82402fb9c70160475a97ef'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.418685 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-db95050e-3258-4df7-a4d4-19b207d7b690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d8c0e3fc82402fb9c70160475a97ef'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.460325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 857/1733] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:29:42 2021] DELETE /identity/v3/users/56d8c0e3fc82402fb9c70160475a97ef => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:42.554313 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f21b3-64a7-4689-b138-49fdde3abe26 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:42.555829 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-ff4f21b3-64a7-4689-b138-49fdde3abe26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:42.644554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f21b3-64a7-4689-b138-49fdde3abe26 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:42.708410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:42.709776 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:42.710167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:42.710476 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] PATH_INFO: `/v3/projects/e884787cf37c45e0b45f73a860f68c93` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:42.711979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e884787cf37c45e0b45f73a860f68c93)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:42.714151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:42.731124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95050e-3258-4df7-a4d4-19b207d7b690 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:42.733835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-db95050e-3258-4df7-a4d4-19b207d7b690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:42.756418 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95050e-3258-4df7-a4d4-19b207d7b690 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:42.781323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:42.782220 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:42.783109 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:42.783388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] PATH_INFO: `/v3/projects/b63de553bb794861b8cfcbb305d26933` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:42.785042 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63de553bb794861b8cfcbb305d26933)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:42.786936 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:42.856655 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e884787cf37c45e0b45f73a860f68c93', 'request_id': 'req-2d0fcc22-3db6-42b1-9c46-be92e2819922'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.907337 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63de553bb794861b8cfcbb305d26933', 'request_id': 'req-3c7d6d58-37c9-4f51-a1c9-9087031f0610'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.969026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e884787cf37c45e0b45f73a860f68c93', 'request_id': 'req-2d0fcc22-3db6-42b1-9c46-be92e2819922'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.977719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e884787cf37c45e0b45f73a860f68c93', 'request_id': 'req-2d0fcc22-3db6-42b1-9c46-be92e2819922'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.989211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] The token cache is being invalidate because project e884787cf37c45e0b45f73a860f68c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:42.989498 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.990199 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:42.991749 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 877/1734] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:42 2021] DELETE /identity/v3/projects/e884787cf37c45e0b45f73a860f68c93 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:42.994740 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:42.994740 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:43.037479 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63de553bb794861b8cfcbb305d26933', 'request_id': 'req-3c7d6d58-37c9-4f51-a1c9-9087031f0610'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:43.043974 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63de553bb794861b8cfcbb305d26933', 'request_id': 'req-3c7d6d58-37c9-4f51-a1c9-9087031f0610'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:43.057756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] The token cache is being invalidate because project b63de553bb794861b8cfcbb305d26933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:43.058047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:43.058842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:43.059683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fcc22-3db6-42b1-9c46-be92e2819922 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:43.065330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 858/1735] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:42 2021] DELETE /identity/v3/projects/b63de553bb794861b8cfcbb305d26933 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:43.065330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:43.065330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:43.122345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443d74d-834f-4959-a1ad-fbb413a78846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:43.123207 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443d74d-834f-4959-a1ad-fbb413a78846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:43.123483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443d74d-834f-4959-a1ad-fbb413a78846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:43.123780 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443d74d-834f-4959-a1ad-fbb413a78846 admin admin] PATH_INFO: `/v3/projects/ab50ff8e2e084ca4b2b9cde22ad54cc6` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:43.124976 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443d74d-834f-4959-a1ad-fbb413a78846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab50ff8e2e084ca4b2b9cde22ad54cc6)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:43.127649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443d74d-834f-4959-a1ad-fbb413a78846 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:43.139155 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d6d58-37c9-4f51-a1c9-9087031f0610 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:43.144610 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11909ed0-55c2-4145-824a-7b481d3fb35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:43.145475 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11909ed0-55c2-4145-824a-7b481d3fb35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:43.145754 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11909ed0-55c2-4145-824a-7b481d3fb35e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:43.146026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11909ed0-55c2-4145-824a-7b481d3fb35e admin admin] PATH_INFO: `/v3/users/b7e750920fd04eb999f1197f80f00565` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:43.147259 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11909ed0-55c2-4145-824a-7b481d3fb35e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e750920fd04eb999f1197f80f00565)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:43.149159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11909ed0-55c2-4145-824a-7b481d3fb35e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:43.261052 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a443d74d-834f-4959-a1ad-fbb413a78846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab50ff8e2e084ca4b2b9cde22ad54cc6', 'request_id': 'req-a443d74d-834f-4959-a1ad-fbb413a78846'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:43.340222 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a443d74d-834f-4959-a1ad-fbb413a78846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab50ff8e2e084ca4b2b9cde22ad54cc6', 'request_id': 'req-a443d74d-834f-4959-a1ad-fbb413a78846'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:43.348432 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a443d74d-834f-4959-a1ad-fbb413a78846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab50ff8e2e084ca4b2b9cde22ad54cc6', 'request_id': 'req-a443d74d-834f-4959-a1ad-fbb413a78846'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:43.369644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a443d74d-834f-4959-a1ad-fbb413a78846 admin admin] The token cache is being invalidate because project ab50ff8e2e084ca4b2b9cde22ad54cc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:43.369644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a443d74d-834f-4959-a1ad-fbb413a78846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:43.369822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a443d74d-834f-4959-a1ad-fbb413a78846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:43.371482 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 878/1736] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:42 2021] DELETE /identity/v3/projects/ab50ff8e2e084ca4b2b9cde22ad54cc6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:43.373517 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad340b4-8421-4da9-b7df-6fb94c50ed22 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:43.373808 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad340b4-8421-4da9-b7df-6fb94c50ed22 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:43.374088 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad340b4-8421-4da9-b7df-6fb94c50ed22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:43.383744 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-11909ed0-55c2-4145-824a-7b481d3fb35e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e750920fd04eb999f1197f80f00565'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:43.392083 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-11909ed0-55c2-4145-824a-7b481d3fb35e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e750920fd04eb999f1197f80f00565'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:43.392926 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-11909ed0-55c2-4145-824a-7b481d3fb35e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e750920fd04eb999f1197f80f00565'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:43.400374 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-cad340b4-8421-4da9-b7df-6fb94c50ed22 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:43.403829 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-cad340b4-8421-4da9-b7df-6fb94c50ed22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:43.405075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-11909ed0-55c2-4145-824a-7b481d3fb35e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e750920fd04eb999f1197f80f00565'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:43.466773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-11909ed0-55c2-4145-824a-7b481d3fb35e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e750920fd04eb999f1197f80f00565'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:43.474986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 859/1737] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:29:43 2021] DELETE /identity/v3/users/b7e750920fd04eb999f1197f80f00565 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:43.477215 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54659aa7-2cf3-4c6c-82e5-e9cf466dd5f5 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:43.477504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54659aa7-2cf3-4c6c-82e5-e9cf466dd5f5 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:43.477777 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54659aa7-2cf3-4c6c-82e5-e9cf466dd5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:43.493827 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 879/1738] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:43.502951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf73bab-5de8-4f36-92db-6372a7ffbe77 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:43.503253 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf73bab-5de8-4f36-92db-6372a7ffbe77 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:43.503533 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf73bab-5de8-4f36-92db-6372a7ffbe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:43.508841 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-54659aa7-2cf3-4c6c-82e5-e9cf466dd5f5 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:43.510135 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-54659aa7-2cf3-4c6c-82e5-e9cf466dd5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:43.523682 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8cf73bab-5de8-4f36-92db-6372a7ffbe77 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:43.525050 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8cf73bab-5de8-4f36-92db-6372a7ffbe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:43.605385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 860/1739] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:43.613925 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f714ae6-f228-4e71-a067-d2c53af026b1 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:43.614216 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f714ae6-f228-4e71-a067-d2c53af026b1 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:43.614525 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f714ae6-f228-4e71-a067-d2c53af026b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:43.630496 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 880/1740] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:43.633322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf73bab-5de8-4f36-92db-6372a7ffbe77 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:43.645043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf73bab-5de8-4f36-92db-6372a7ffbe77 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:43.646023 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-9f714ae6-f228-4e71-a067-d2c53af026b1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:43.647780 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9f714ae6-f228-4e71-a067-d2c53af026b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:43.651814 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4304d-c750-4084-9af8-0a5fe7f8468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:43.651814 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4304d-c750-4084-9af8-0a5fe7f8468c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:43.652189 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4304d-c750-4084-9af8-0a5fe7f8468c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:43.652853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4304d-c750-4084-9af8-0a5fe7f8468c admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:43.653745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4304d-c750-4084-9af8-0a5fe7f8468c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:29:43.654244 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4304d-c750-4084-9af8-0a5fe7f8468c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:43.656263 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4304d-c750-4084-9af8-0a5fe7f8468c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:43.660377 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 861/1741] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:43.663277 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f714ae6-f228-4e71-a067-d2c53af026b1 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:43.673647 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 881/1742] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:29:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:29:43.675584 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f714ae6-f228-4e71-a067-d2c53af026b1 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:43.680396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b22fdd-90cd-489c-ad60-56568ed89bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:43.681060 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b22fdd-90cd-489c-ad60-56568ed89bbf admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:43.681340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b22fdd-90cd-489c-ad60-56568ed89bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:43.681655 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b22fdd-90cd-489c-ad60-56568ed89bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:43.682483 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b22fdd-90cd-489c-ad60-56568ed89bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:29:43.682792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b22fdd-90cd-489c-ad60-56568ed89bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:43.683807 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4304d-c750-4084-9af8-0a5fe7f8468c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:43.684431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b22fdd-90cd-489c-ad60-56568ed89bbf admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:43.716989 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 862/1743] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:29:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:29:43.718267 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b22fdd-90cd-489c-ad60-56568ed89bbf admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:43.721438 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4304d-c750-4084-9af8-0a5fe7f8468c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:43.731078 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2afcc-ecb6-43dc-a4b7-92e6d20770c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:43.737643 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2afcc-ecb6-43dc-a4b7-92e6d20770c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:43.737643 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2afcc-ecb6-43dc-a4b7-92e6d20770c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:43.737643 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2afcc-ecb6-43dc-a4b7-92e6d20770c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:43.737979 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b22fdd-90cd-489c-ad60-56568ed89bbf admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:43.738407 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2afcc-ecb6-43dc-a4b7-92e6d20770c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:43.738407 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2afcc-ecb6-43dc-a4b7-92e6d20770c1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:43.739791 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fee36d-7734-4eda-b796-b174dbcbb266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:43.740560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fee36d-7734-4eda-b796-b174dbcbb266 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:43.740940 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fee36d-7734-4eda-b796-b174dbcbb266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:43.741315 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fee36d-7734-4eda-b796-b174dbcbb266 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:43.742147 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fee36d-7734-4eda-b796-b174dbcbb266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:43.744320 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fee36d-7734-4eda-b796-b174dbcbb266 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:43.814774 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 882/1744] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:43 2021] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:43.818638 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2afcc-ecb6-43dc-a4b7-92e6d20770c1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:43.863111 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 863/1745] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:43 2021] POST /identity/v3/projects => generated 409 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:43.879390 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fee36d-7734-4eda-b796-b174dbcbb266 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:43.934265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2afcc-ecb6-43dc-a4b7-92e6d20770c1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:44.031596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4cc67-4f85-4690-ac56-7e037be5366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:44.032401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4cc67-4f85-4690-ac56-7e037be5366f admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.033578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4cc67-4f85-4690-ac56-7e037be5366f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.033976 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4cc67-4f85-4690-ac56-7e037be5366f admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.034727 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4cc67-4f85-4690-ac56-7e037be5366f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:44.036889 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4cc67-4f85-4690-ac56-7e037be5366f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:44.046190 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fee36d-7734-4eda-b796-b174dbcbb266 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:44.054463 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3e630-ca59-4b48-a6a5-885b39326557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:44.055213 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e630-ca59-4b48-a6a5-885b39326557 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.055766 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e630-ca59-4b48-a6a5-885b39326557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.055960 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e630-ca59-4b48-a6a5-885b39326557 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.056768 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3e630-ca59-4b48-a6a5-885b39326557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:44.058789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3e630-ca59-4b48-a6a5-885b39326557 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:44.152766 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 864/1746] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:43 2021] POST /identity/v3/users => generated 305 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:44.153766 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3e630-ca59-4b48-a6a5-885b39326557 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:44.158389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 883/1747] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:43 2021] POST /identity/v3/users => generated 290 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:44.159248 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9fa3e630-ca59-4b48-a6a5-885b39326557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:44.159434 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4cc67-4f85-4690-ac56-7e037be5366f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:44.184859 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3e630-ca59-4b48-a6a5-885b39326557 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:44.190948 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:44.191875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.192044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4cc67-4f85-4690-ac56-7e037be5366f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:44.192199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.192552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] PATH_INFO: `/v3/projects/f3cb8332a0ba4c848f4b4d1fdf82de51` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.193845 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3cb8332a0ba4c848f4b4d1fdf82de51)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:44.196050 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:44.208605 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05759d6-d939-4f53-b377-8a8f92dee9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:44.209378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05759d6-d939-4f53-b377-8a8f92dee9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.209663 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05759d6-d939-4f53-b377-8a8f92dee9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.209942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05759d6-d939-4f53-b377-8a8f92dee9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.210701 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05759d6-d939-4f53-b377-8a8f92dee9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:44.212371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05759d6-d939-4f53-b377-8a8f92dee9a7 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:44.245427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 884/1748] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:44 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:44.247426 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05759d6-d939-4f53-b377-8a8f92dee9a7 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:44.264080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05759d6-d939-4f53-b377-8a8f92dee9a7 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:44.277902 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1851a1d-1524-4432-81d8-d334651bd7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:44.279411 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1851a1d-1524-4432-81d8-d334651bd7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.279411 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1851a1d-1524-4432-81d8-d334651bd7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.279411 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1851a1d-1524-4432-81d8-d334651bd7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.280436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1851a1d-1524-4432-81d8-d334651bd7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:44.282195 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1851a1d-1524-4432-81d8-d334651bd7a2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:44.302596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 885/1749] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:44 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:44.302596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1851a1d-1524-4432-81d8-d334651bd7a2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:44.313401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1851a1d-1524-4432-81d8-d334651bd7a2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:44.326157 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f6191-dc7c-4db2-b084-4bea3db36e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:44.327577 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f6191-dc7c-4db2-b084-4bea3db36e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.328484 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f6191-dc7c-4db2-b084-4bea3db36e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.328906 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f6191-dc7c-4db2-b084-4bea3db36e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.331194 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f6191-dc7c-4db2-b084-4bea3db36e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:44.334149 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f6191-dc7c-4db2-b084-4bea3db36e88 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:44.341625 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3cb8332a0ba4c848f4b4d1fdf82de51', 'request_id': 'req-eefac422-f4d5-4513-8de3-5de8347404a2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:44.357177 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 886/1750] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:44 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:44.358167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f6191-dc7c-4db2-b084-4bea3db36e88 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:44.372202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f6191-dc7c-4db2-b084-4bea3db36e88 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:44.420107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3cb8332a0ba4c848f4b4d1fdf82de51', 'request_id': 'req-eefac422-f4d5-4513-8de3-5de8347404a2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:44.427156 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3cb8332a0ba4c848f4b4d1fdf82de51', 'request_id': 'req-eefac422-f4d5-4513-8de3-5de8347404a2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:44.435972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a5315-15f4-4079-b3c8-5b2144ae22f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:44.436647 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a5315-15f4-4079-b3c8-5b2144ae22f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.436931 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a5315-15f4-4079-b3c8-5b2144ae22f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.437199 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a5315-15f4-4079-b3c8-5b2144ae22f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.437936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a5315-15f4-4079-b3c8-5b2144ae22f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:44.438773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] The token cache is being invalidate because project f3cb8332a0ba4c848f4b4d1fdf82de51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:44.439551 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a5315-15f4-4079-b3c8-5b2144ae22f0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:44.439714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:44.440426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:44.442134 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 865/1751] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:44 2021] DELETE /identity/v3/projects/f3cb8332a0ba4c848f4b4d1fdf82de51 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:44.442970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:44.444605 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:44.452603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 887/1752] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:44 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:44.454244 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e8519-8ab5-486b-836c-bad0949a83cc None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.454572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e8519-8ab5-486b-836c-bad0949a83cc None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.457343 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e8519-8ab5-486b-836c-bad0949a83cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.468291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefac422-f4d5-4513-8de3-5de8347404a2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:44.477211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-cd5e8519-8ab5-486b-836c-bad0949a83cc None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:44.477449 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2f2e2-0bd0-42f9-b062-27211909178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:44.478453 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-cd5e8519-8ab5-486b-836c-bad0949a83cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:44.479025 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f2e2-0bd0-42f9-b062-27211909178f admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.479426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f2e2-0bd0-42f9-b062-27211909178f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.479856 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f2e2-0bd0-42f9-b062-27211909178f admin admin] PATH_INFO: `/v3/projects/2b66eccab4404d42b6291703f3eea606/users/7230712341084e999f7c82022054d31a/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.488328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 888/1753] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:44.489230 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e8519-8ab5-486b-836c-bad0949a83cc None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:44.490581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-cd5e8519-8ab5-486b-836c-bad0949a83cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:44.498697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2f2e2-0bd0-42f9-b062-27211909178f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b66eccab4404d42b6291703f3eea606, user_id=7230712341084e999f7c82022054d31a, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:44.501742 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2f2e2-0bd0-42f9-b062-27211909178f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:44.504469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e8519-8ab5-486b-836c-bad0949a83cc None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:44.509659 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985dbe7-d7da-40f5-896e-d2f672987a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:44.510577 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985dbe7-d7da-40f5-896e-d2f672987a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.510874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985dbe7-d7da-40f5-896e-d2f672987a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.511146 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985dbe7-d7da-40f5-896e-d2f672987a03 admin admin] PATH_INFO: `/v3/projects/784ea03a28b849a2afb4d90ea41b812e/users/c4ac0ecf0be047a6b004a5e07c345233/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.527555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985dbe7-d7da-40f5-896e-d2f672987a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784ea03a28b849a2afb4d90ea41b812e, user_id=c4ac0ecf0be047a6b004a5e07c345233, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:44.530178 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985dbe7-d7da-40f5-896e-d2f672987a03 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:44.591981 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 866/1754] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:44 2021] PUT /identity/v3/projects/2b66eccab4404d42b6291703f3eea606/users/7230712341084e999f7c82022054d31a/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:44.593481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f055-df99-434a-a6b2-a582b6331c1e None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.593767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f055-df99-434a-a6b2-a582b6331c1e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.594077 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f055-df99-434a-a6b2-a582b6331c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.618180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-7683f055-df99-434a-a6b2-a582b6331c1e None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:44.619568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-7683f055-df99-434a-a6b2-a582b6331c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:44.662417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 889/1755] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:44 2021] PUT /identity/v3/projects/784ea03a28b849a2afb4d90ea41b812e/users/c4ac0ecf0be047a6b004a5e07c345233/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:44.670272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7c951-1aca-4bea-ad05-46d02fbabc5e None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.670720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7c951-1aca-4bea-ad05-46d02fbabc5e None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.671015 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7c951-1aca-4bea-ad05-46d02fbabc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.691868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 867/1756] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:44.695181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18d472-3fa0-44c0-84de-e6c412722699 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.695181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18d472-3fa0-44c0-84de-e6c412722699 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.695181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18d472-3fa0-44c0-84de-e6c412722699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.725826 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-72d7c951-1aca-4bea-ad05-46d02fbabc5e None None] MFA Rules not processed for user `7230712341084e999f7c82022054d31a`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:44.727371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-72d7c951-1aca-4bea-ad05-46d02fbabc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:44.730396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ad18d472-3fa0-44c0-84de-e6c412722699 None None] MFA Rules not processed for user `c4ac0ecf0be047a6b004a5e07c345233`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:44.732156 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ad18d472-3fa0-44c0-84de-e6c412722699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:44.808237 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 890/1757] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:44 2021] POST /identity/v3/auth/tokens => generated 3429 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:44.809180 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7c951-1aca-4bea-ad05-46d02fbabc5e None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:44.869490 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 868/1758] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:44 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:44.872368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18d472-3fa0-44c0-84de-e6c412722699 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:44.900339 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7c951-1aca-4bea-ad05-46d02fbabc5e None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:44.905273 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55e0c5-68bf-4610-b4e1-9cfbaaa4756e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:44.905796 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55e0c5-68bf-4610-b4e1-9cfbaaa4756e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.906171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55e0c5-68bf-4610-b4e1-9cfbaaa4756e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.906536 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55e0c5-68bf-4610-b4e1-9cfbaaa4756e admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.907413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55e0c5-68bf-4610-b4e1-9cfbaaa4756e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:29:44.909111 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55e0c5-68bf-4610-b4e1-9cfbaaa4756e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:44.911102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55e0c5-68bf-4610-b4e1-9cfbaaa4756e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:44.925212 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 891/1759] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:29:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:29:44.926114 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55e0c5-68bf-4610-b4e1-9cfbaaa4756e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:44.936518 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55e0c5-68bf-4610-b4e1-9cfbaaa4756e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:44.942122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba386cd-3163-4994-b823-5947a5187370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:44.942782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba386cd-3163-4994-b823-5947a5187370 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.943064 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba386cd-3163-4994-b823-5947a5187370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.943339 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba386cd-3163-4994-b823-5947a5187370 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.944080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba386cd-3163-4994-b823-5947a5187370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:44.951844 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba386cd-3163-4994-b823-5947a5187370 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:44.960539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18d472-3fa0-44c0-84de-e6c412722699 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:44.965357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc054f-e19e-4121-969a-6d8422b22cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:44.966021 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc054f-e19e-4121-969a-6d8422b22cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:44.966304 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc054f-e19e-4121-969a-6d8422b22cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:44.966575 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc054f-e19e-4121-969a-6d8422b22cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:44.967282 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc054f-e19e-4121-969a-6d8422b22cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:44.969207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc054f-e19e-4121-969a-6d8422b22cf1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.062618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 892/1760] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:44 2021] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:45.063393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba386cd-3163-4994-b823-5947a5187370 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.085319 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 869/1761] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:44 2021] POST /identity/v3/projects => generated 409 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:45.086191 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc054f-e19e-4121-969a-6d8422b22cf1 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.135891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba386cd-3163-4994-b823-5947a5187370 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.153349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc054f-e19e-4121-969a-6d8422b22cf1 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.160407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c7f0f-cab5-4a55-b09b-ddacb90b2e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.161126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c7f0f-cab5-4a55-b09b-ddacb90b2e89 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.161404 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c7f0f-cab5-4a55-b09b-ddacb90b2e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.161675 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c7f0f-cab5-4a55-b09b-ddacb90b2e89 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.162421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c7f0f-cab5-4a55-b09b-ddacb90b2e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.165875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c7f0f-cab5-4a55-b09b-ddacb90b2e89 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.198188 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca6085-01a3-4140-b073-5c46302eadb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.198975 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca6085-01a3-4140-b073-5c46302eadb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.199331 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca6085-01a3-4140-b073-5c46302eadb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.199953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca6085-01a3-4140-b073-5c46302eadb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.200747 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca6085-01a3-4140-b073-5c46302eadb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.203092 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca6085-01a3-4140-b073-5c46302eadb2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.244363 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 870/1762] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:45 2021] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:45.245180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c7f0f-cab5-4a55-b09b-ddacb90b2e89 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.255459 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c7f0f-cab5-4a55-b09b-ddacb90b2e89 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.260322 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acee166-3853-463e-a477-4cfd0cfc0b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.260989 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acee166-3853-463e-a477-4cfd0cfc0b2b admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.261267 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acee166-3853-463e-a477-4cfd0cfc0b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.261537 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acee166-3853-463e-a477-4cfd0cfc0b2b admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.262240 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acee166-3853-463e-a477-4cfd0cfc0b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.264215 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acee166-3853-463e-a477-4cfd0cfc0b2b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.324012 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 893/1763] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:45 2021] POST /identity/v3/projects => generated 383 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:45.324012 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca6085-01a3-4140-b073-5c46302eadb2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.346650 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 871/1764] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:45 2021] POST /identity/v3/users => generated 311 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:45.348050 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acee166-3853-463e-a477-4cfd0cfc0b2b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.359088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acee166-3853-463e-a477-4cfd0cfc0b2b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.394930 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca6085-01a3-4140-b073-5c46302eadb2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.400689 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980cea9-89bd-47ed-a823-535a978be508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.401429 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980cea9-89bd-47ed-a823-535a978be508 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.401751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980cea9-89bd-47ed-a823-535a978be508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.402056 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980cea9-89bd-47ed-a823-535a978be508 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.402974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980cea9-89bd-47ed-a823-535a978be508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.404904 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980cea9-89bd-47ed-a823-535a978be508 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.423926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 894/1765] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:45 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:45.426073 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980cea9-89bd-47ed-a823-535a978be508 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.433270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b0ab0-1b79-415a-9afc-e594044f7107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.434235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b0ab0-1b79-415a-9afc-e594044f7107 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.434235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b0ab0-1b79-415a-9afc-e594044f7107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.434428 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b0ab0-1b79-415a-9afc-e594044f7107 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.435269 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b0ab0-1b79-415a-9afc-e594044f7107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.437959 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b0ab0-1b79-415a-9afc-e594044f7107 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.443464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980cea9-89bd-47ed-a823-535a978be508 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.449162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9b8f4-3571-4aca-a02e-3f268c49c945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.450176 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b8f4-3571-4aca-a02e-3f268c49c945 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.450520 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b8f4-3571-4aca-a02e-3f268c49c945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.450800 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b8f4-3571-4aca-a02e-3f268c49c945 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.451536 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9b8f4-3571-4aca-a02e-3f268c49c945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.453275 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9b8f4-3571-4aca-a02e-3f268c49c945 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.464131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 895/1766] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:45 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:45.465080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9b8f4-3571-4aca-a02e-3f268c49c945 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.475655 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9b8f4-3571-4aca-a02e-3f268c49c945 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.480385 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82933626-ad23-43e6-a3aa-cf45bb2852e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.481262 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82933626-ad23-43e6-a3aa-cf45bb2852e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.481539 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82933626-ad23-43e6-a3aa-cf45bb2852e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.481802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82933626-ad23-43e6-a3aa-cf45bb2852e1 admin admin] PATH_INFO: `/v3/projects/fedaaca72af646fda32b00f141fff6a5/users/6e5b3104caba4e57b9a5bd6fb5d197aa/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.499060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82933626-ad23-43e6-a3aa-cf45bb2852e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fedaaca72af646fda32b00f141fff6a5, user_id=6e5b3104caba4e57b9a5bd6fb5d197aa, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.504697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 872/1767] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:45 2021] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:45.504875 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82933626-ad23-43e6-a3aa-cf45bb2852e1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.504954 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b0ab0-1b79-415a-9afc-e594044f7107 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.515768 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b0ab0-1b79-415a-9afc-e594044f7107 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.522087 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c337dc0-b995-400e-beeb-de180e53b183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.523126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c337dc0-b995-400e-beeb-de180e53b183 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.523411 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c337dc0-b995-400e-beeb-de180e53b183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.537170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c337dc0-b995-400e-beeb-de180e53b183 admin admin] PATH_INFO: `/v3/projects/7dd041dc13664f24aea6e13a0b1df995/users/79d9afc2cd9d4f25abf93cdc62cbce84/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.546111 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c337dc0-b995-400e-beeb-de180e53b183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd041dc13664f24aea6e13a0b1df995, user_id=79d9afc2cd9d4f25abf93cdc62cbce84, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.549478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c337dc0-b995-400e-beeb-de180e53b183 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.591747 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 896/1768] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:45 2021] PUT /identity/v3/projects/fedaaca72af646fda32b00f141fff6a5/users/6e5b3104caba4e57b9a5bd6fb5d197aa/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:45.592596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82933626-ad23-43e6-a3aa-cf45bb2852e1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.633759 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 873/1769] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:45 2021] PUT /identity/v3/projects/7dd041dc13664f24aea6e13a0b1df995/users/79d9afc2cd9d4f25abf93cdc62cbce84/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:45.634591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c337dc0-b995-400e-beeb-de180e53b183 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.654904 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82933626-ad23-43e6-a3aa-cf45bb2852e1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.694493 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c337dc0-b995-400e-beeb-de180e53b183 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.699308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb56650-8037-4a0a-aecb-f5c0e67eb120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.700227 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb56650-8037-4a0a-aecb-f5c0e67eb120 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.700500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb56650-8037-4a0a-aecb-f5c0e67eb120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.700768 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb56650-8037-4a0a-aecb-f5c0e67eb120 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.701528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb56650-8037-4a0a-aecb-f5c0e67eb120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.703084 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb56650-8037-4a0a-aecb-f5c0e67eb120 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.712196 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386d901-f258-42ab-9e9a-b2a468b702a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.712860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386d901-f258-42ab-9e9a-b2a468b702a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.713167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386d901-f258-42ab-9e9a-b2a468b702a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.713437 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386d901-f258-42ab-9e9a-b2a468b702a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.714168 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386d901-f258-42ab-9e9a-b2a468b702a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.714516 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 874/1770] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:45 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:45.715331 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb56650-8037-4a0a-aecb-f5c0e67eb120 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.715816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386d901-f258-42ab-9e9a-b2a468b702a0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.725495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb56650-8037-4a0a-aecb-f5c0e67eb120 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.729464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 897/1771] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:45 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:45.729464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386d901-f258-42ab-9e9a-b2a468b702a0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.730219 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de3a98-f0be-4b69-be7f-7cb0d5ab6493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.730867 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de3a98-f0be-4b69-be7f-7cb0d5ab6493 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.731147 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de3a98-f0be-4b69-be7f-7cb0d5ab6493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.731421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de3a98-f0be-4b69-be7f-7cb0d5ab6493 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.732200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de3a98-f0be-4b69-be7f-7cb0d5ab6493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.733802 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de3a98-f0be-4b69-be7f-7cb0d5ab6493 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.737924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386d901-f258-42ab-9e9a-b2a468b702a0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.742597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741f7a7-572e-48d9-9d7c-67f70cacc552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.743479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741f7a7-572e-48d9-9d7c-67f70cacc552 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.743783 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741f7a7-572e-48d9-9d7c-67f70cacc552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.744054 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741f7a7-572e-48d9-9d7c-67f70cacc552 admin admin] PATH_INFO: `/v3/projects/fedaaca72af646fda32b00f141fff6a5/users/6e5b3104caba4e57b9a5bd6fb5d197aa/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.744622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 875/1772] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:45.745419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de3a98-f0be-4b69-be7f-7cb0d5ab6493 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.746086 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741f7a7-572e-48d9-9d7c-67f70cacc552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fedaaca72af646fda32b00f141fff6a5, user_id=6e5b3104caba4e57b9a5bd6fb5d197aa, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.748714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741f7a7-572e-48d9-9d7c-67f70cacc552 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.757635 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de3a98-f0be-4b69-be7f-7cb0d5ab6493 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.761184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 898/1773] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:45 2021] PUT /identity/v3/projects/fedaaca72af646fda32b00f141fff6a5/users/6e5b3104caba4e57b9a5bd6fb5d197aa/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:45.762594 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741f7a7-572e-48d9-9d7c-67f70cacc552 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.817388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058e44f-b20a-4ed2-9e69-1613b89cdb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.818369 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058e44f-b20a-4ed2-9e69-1613b89cdb4d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.818649 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058e44f-b20a-4ed2-9e69-1613b89cdb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.818921 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058e44f-b20a-4ed2-9e69-1613b89cdb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.819662 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058e44f-b20a-4ed2-9e69-1613b89cdb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.821276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058e44f-b20a-4ed2-9e69-1613b89cdb4d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.833394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741f7a7-572e-48d9-9d7c-67f70cacc552 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.838250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 876/1774] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:45 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:45.838250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d54e2-67b6-482d-9119-0bc442ea49e7 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.838250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d54e2-67b6-482d-9119-0bc442ea49e7 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.838250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d54e2-67b6-482d-9119-0bc442ea49e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.846785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffece661-a5c6-4c91-a582-a87264b23b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.847775 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffece661-a5c6-4c91-a582-a87264b23b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.848891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffece661-a5c6-4c91-a582-a87264b23b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.848891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffece661-a5c6-4c91-a582-a87264b23b9b admin admin] PATH_INFO: `/v3/projects/7dd041dc13664f24aea6e13a0b1df995/users/79d9afc2cd9d4f25abf93cdc62cbce84/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.850633 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffece661-a5c6-4c91-a582-a87264b23b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd041dc13664f24aea6e13a0b1df995, user_id=79d9afc2cd9d4f25abf93cdc62cbce84, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.856385 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffece661-a5c6-4c91-a582-a87264b23b9b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:45.865316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 899/1775] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:45 2021] PUT /identity/v3/projects/7dd041dc13664f24aea6e13a0b1df995/users/79d9afc2cd9d4f25abf93cdc62cbce84/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:45.870150 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffece661-a5c6-4c91-a582-a87264b23b9b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:45.890708 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-022d54e2-67b6-482d-9119-0bc442ea49e7 None None] MFA Rules not processed for user `6e5b3104caba4e57b9a5bd6fb5d197aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:45.892128 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-022d54e2-67b6-482d-9119-0bc442ea49e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:45.951636 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffece661-a5c6-4c91-a582-a87264b23b9b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:45.957266 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dd567-3ad7-4843-87a0-5e5d1ecd57eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:45.958252 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dd567-3ad7-4843-87a0-5e5d1ecd57eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.958626 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dd567-3ad7-4843-87a0-5e5d1ecd57eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.958965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dd567-3ad7-4843-87a0-5e5d1ecd57eb admin admin] PATH_INFO: `/v3/projects/cffb2d178ca849a382869f9d22823f9e/users/dfe7f677e68a418ab4dd1bbf7a3fc5b3/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.974427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 877/1776] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:45 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:45.975303 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19782-9ccb-42f3-acc9-7831edfe7d01 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:45.975657 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19782-9ccb-42f3-acc9-7831edfe7d01 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:45.975897 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19782-9ccb-42f3-acc9-7831edfe7d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:45.983666 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dd567-3ad7-4843-87a0-5e5d1ecd57eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffb2d178ca849a382869f9d22823f9e, user_id=dfe7f677e68a418ab4dd1bbf7a3fc5b3, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:45.987550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dd567-3ad7-4843-87a0-5e5d1ecd57eb admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:46.007094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-72a19782-9ccb-42f3-acc9-7831edfe7d01 None None] MFA Rules not processed for user `79d9afc2cd9d4f25abf93cdc62cbce84`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:46.008535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-72a19782-9ccb-42f3-acc9-7831edfe7d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:46.065332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 900/1777] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:45 2021] PUT /identity/v3/projects/cffb2d178ca849a382869f9d22823f9e/users/dfe7f677e68a418ab4dd1bbf7a3fc5b3/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:46.066364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dd567-3ad7-4843-87a0-5e5d1ecd57eb admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:46.068252 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6e7dd567-3ad7-4843-87a0-5e5d1ecd57eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:46.099259 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 878/1778] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:45 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:46.100595 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d8444-ff7a-46aa-8485-08b1d8fd632e None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:46.100882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d8444-ff7a-46aa-8485-08b1d8fd632e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:46.101159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d8444-ff7a-46aa-8485-08b1d8fd632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:46.133260 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-b69d8444-ff7a-46aa-8485-08b1d8fd632e None None] MFA Rules not processed for user `dfe7f677e68a418ab4dd1bbf7a3fc5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:46.135075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b69d8444-ff7a-46aa-8485-08b1d8fd632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:46.140419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dd567-3ad7-4843-87a0-5e5d1ecd57eb admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:46.144586 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccde69-5d4b-43a1-87c2-cfb6d77fcfc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:46.145241 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccde69-5d4b-43a1-87c2-cfb6d77fcfc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:46.145521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccde69-5d4b-43a1-87c2-cfb6d77fcfc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:46.145798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccde69-5d4b-43a1-87c2-cfb6d77fcfc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:46.212333 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 879/1779] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:46 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:46.213583 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d8444-ff7a-46aa-8485-08b1d8fd632e None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:46.215481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b69d8444-ff7a-46aa-8485-08b1d8fd632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:46.224155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccde69-5d4b-43a1-87c2-cfb6d77fcfc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:46.225587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccde69-5d4b-43a1-87c2-cfb6d77fcfc7 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:46.227524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d8444-ff7a-46aa-8485-08b1d8fd632e None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:46.231476 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af5be4-f609-423b-8ed3-fb43e9debdfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:46.232346 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af5be4-f609-423b-8ed3-fb43e9debdfa service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:46.232686 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af5be4-f609-423b-8ed3-fb43e9debdfa service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:46.233017 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af5be4-f609-423b-8ed3-fb43e9debdfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:46.235463 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 901/1780] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:46 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:46.236386 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccde69-5d4b-43a1-87c2-cfb6d77fcfc7 service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:46.300223 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccde69-5d4b-43a1-87c2-cfb6d77fcfc7 service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:46.301963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af5be4-f609-423b-8ed3-fb43e9debdfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:46.303417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af5be4-f609-423b-8ed3-fb43e9debdfa service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:46.305343 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90230261-3ff5-4abf-8c6b-c3dd925df660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:46.307162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90230261-3ff5-4abf-8c6b-c3dd925df660 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:46.307559 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90230261-3ff5-4abf-8c6b-c3dd925df660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:46.308614 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90230261-3ff5-4abf-8c6b-c3dd925df660 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:46.309264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90230261-3ff5-4abf-8c6b-c3dd925df660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:46.311222 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90230261-3ff5-4abf-8c6b-c3dd925df660 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:46.315469 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 880/1781] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:46 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:46.451460 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 902/1782] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:46 2021] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:46.455907 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af5be4-f609-423b-8ed3-fb43e9debdfa service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:46.469535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af5be4-f609-423b-8ed3-fb43e9debdfa service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:46.542287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f91cee-f1db-48db-a18a-42835b7abcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:46.543245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f91cee-f1db-48db-a18a-42835b7abcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:46.543531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f91cee-f1db-48db-a18a-42835b7abcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:46.543842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f91cee-f1db-48db-a18a-42835b7abcb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:46.552082 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f91cee-f1db-48db-a18a-42835b7abcb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:46.552082 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f91cee-f1db-48db-a18a-42835b7abcb1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:46.616039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90230261-3ff5-4abf-8c6b-c3dd925df660 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:46.690183 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 881/1783] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:46 2021] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:29:46.694701 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f91cee-f1db-48db-a18a-42835b7abcb1 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:46.710011 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f91cee-f1db-48db-a18a-42835b7abcb1 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:46.717420 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8fdf4-1ced-4988-a62b-4e3b2ad454aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:46.721676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8fdf4-1ced-4988-a62b-4e3b2ad454aa admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:46.721967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8fdf4-1ced-4988-a62b-4e3b2ad454aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:46.722256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8fdf4-1ced-4988-a62b-4e3b2ad454aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:46.728100 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8fdf4-1ced-4988-a62b-4e3b2ad454aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:46.729088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8fdf4-1ced-4988-a62b-4e3b2ad454aa admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:46.729723 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90230261-3ff5-4abf-8c6b-c3dd925df660 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:46.742367 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4799f2-7d53-4eb7-87a8-ed572deb99a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:46.743164 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4799f2-7d53-4eb7-87a8-ed572deb99a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:46.743548 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4799f2-7d53-4eb7-87a8-ed572deb99a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:46.744189 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4799f2-7d53-4eb7-87a8-ed572deb99a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:46.760275 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 882/1784] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:46 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:46.763144 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8fdf4-1ced-4988-a62b-4e3b2ad454aa admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:46.777262 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8fdf4-1ced-4988-a62b-4e3b2ad454aa admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:46.784317 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ded83-4ba6-43af-b9a1-c9bc6a4666c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:46.785526 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ded83-4ba6-43af-b9a1-c9bc6a4666c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:46.785803 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ded83-4ba6-43af-b9a1-c9bc6a4666c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:46.786075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ded83-4ba6-43af-b9a1-c9bc6a4666c0 admin admin] PATH_INFO: `/v3/projects/c0f4dc0a1d454674a6906bc5ad6e82b6/users/9f2f4b6aaade425880b878910aba3f63/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:46.802536 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ded83-4ba6-43af-b9a1-c9bc6a4666c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0f4dc0a1d454674a6906bc5ad6e82b6, user_id=9f2f4b6aaade425880b878910aba3f63, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:46.805466 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ded83-4ba6-43af-b9a1-c9bc6a4666c0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:46.809451 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4799f2-7d53-4eb7-87a8-ed572deb99a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:46.810900 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4799f2-7d53-4eb7-87a8-ed572deb99a9 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:46.821528 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 903/1785] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:46 2021] GET /identity/v3/auth/tokens => generated 3429 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:29:46.879878 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 883/1786] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:46 2021] PUT /identity/v3/projects/c0f4dc0a1d454674a6906bc5ad6e82b6/users/9f2f4b6aaade425880b878910aba3f63/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:46.885198 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4799f2-7d53-4eb7-87a8-ed572deb99a9 service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:46.896862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4799f2-7d53-4eb7-87a8-ed572deb99a9 service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:46.929986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ded83-4ba6-43af-b9a1-c9bc6a4666c0 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:46.965991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97cfd1-9a0a-4922-a981-6e96d854052a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:46.966661 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97cfd1-9a0a-4922-a981-6e96d854052a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:46.966988 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97cfd1-9a0a-4922-a981-6e96d854052a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:46.967275 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97cfd1-9a0a-4922-a981-6e96d854052a admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:46.968076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97cfd1-9a0a-4922-a981-6e96d854052a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:46.969719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97cfd1-9a0a-4922-a981-6e96d854052a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:46.983290 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 904/1787] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:46 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:46.984337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97cfd1-9a0a-4922-a981-6e96d854052a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:46.994127 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97cfd1-9a0a-4922-a981-6e96d854052a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:46.998161 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ded83-4ba6-43af-b9a1-c9bc6a4666c0 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:46.998817 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280d01e-1612-4224-9bfd-c4c9853acecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:46.999802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280d01e-1612-4224-9bfd-c4c9853acecc admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:47.000144 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280d01e-1612-4224-9bfd-c4c9853acecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:47.000487 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280d01e-1612-4224-9bfd-c4c9853acecc admin admin] PATH_INFO: `/v3/projects/c0f4dc0a1d454674a6906bc5ad6e82b6/users/9f2f4b6aaade425880b878910aba3f63/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:47.003032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280d01e-1612-4224-9bfd-c4c9853acecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0f4dc0a1d454674a6906bc5ad6e82b6, user_id=9f2f4b6aaade425880b878910aba3f63, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:47.003440 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25517f0-1886-4397-be1e-932bb2ab019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:47.004347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25517f0-1886-4397-be1e-932bb2ab019d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:47.004613 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25517f0-1886-4397-be1e-932bb2ab019d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:47.004884 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25517f0-1886-4397-be1e-932bb2ab019d admin admin] PATH_INFO: `/v3/users/c4ac0ecf0be047a6b004a5e07c345233` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:47.005790 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280d01e-1612-4224-9bfd-c4c9853acecc admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:47.006104 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25517f0-1886-4397-be1e-932bb2ab019d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ac0ecf0be047a6b004a5e07c345233)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:47.008081 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25517f0-1886-4397-be1e-932bb2ab019d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:47.017305 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 905/1788] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:46 2021] PUT /identity/v3/projects/c0f4dc0a1d454674a6906bc5ad6e82b6/users/9f2f4b6aaade425880b878910aba3f63/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:29:47.027814 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593dd2-8f9d-4d98-b1a9-73488235cf21 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:47.028100 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593dd2-8f9d-4d98-b1a9-73488235cf21 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:47.028419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593dd2-8f9d-4d98-b1a9-73488235cf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:47.056706 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-9a593dd2-8f9d-4d98-b1a9-73488235cf21 None None] MFA Rules not processed for user `9f2f4b6aaade425880b878910aba3f63`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:47.057895 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-9a593dd2-8f9d-4d98-b1a9-73488235cf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:47.124310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 906/1789] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:47 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:47.138483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a593dd2-8f9d-4d98-b1a9-73488235cf21 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:47.200868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b25517f0-1886-4397-be1e-932bb2ab019d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ac0ecf0be047a6b004a5e07c345233'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:47.205163 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a593dd2-8f9d-4d98-b1a9-73488235cf21 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:47.208801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b25517f0-1886-4397-be1e-932bb2ab019d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ac0ecf0be047a6b004a5e07c345233'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:47.209357 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4efda0-0ed4-4517-8e9f-a4cd9271e2d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:47.209530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b25517f0-1886-4397-be1e-932bb2ab019d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ac0ecf0be047a6b004a5e07c345233'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:47.210225 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4efda0-0ed4-4517-8e9f-a4cd9271e2d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:47.210603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4efda0-0ed4-4517-8e9f-a4cd9271e2d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:47.210974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4efda0-0ed4-4517-8e9f-a4cd9271e2d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:47.213040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-cc4efda0-0ed4-4517-8e9f-a4cd9271e2d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:47.225387 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b25517f0-1886-4397-be1e-932bb2ab019d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ac0ecf0be047a6b004a5e07c345233'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:47.284200 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4efda0-0ed4-4517-8e9f-a4cd9271e2d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:47.286881 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4efda0-0ed4-4517-8e9f-a4cd9271e2d3 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:47.302251 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 907/1790] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:47 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:29:47.328687 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b25517f0-1886-4397-be1e-932bb2ab019d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ac0ecf0be047a6b004a5e07c345233'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:47.335391 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 884/1791] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:29:46 2021] DELETE /identity/v3/users/c4ac0ecf0be047a6b004a5e07c345233 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:29:47.344635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796e9ca-0060-4f2a-8126-b88f7222a440 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:47.345440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796e9ca-0060-4f2a-8126-b88f7222a440 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:47.345730 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796e9ca-0060-4f2a-8126-b88f7222a440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:47.367836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-b796e9ca-0060-4f2a-8126-b88f7222a440 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:47.368959 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b796e9ca-0060-4f2a-8126-b88f7222a440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:47.437650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 908/1792] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:47.448142 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25517f0-1886-4397-be1e-932bb2ab019d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:47.449876 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b25517f0-1886-4397-be1e-932bb2ab019d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:47.511943 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25517f0-1886-4397-be1e-932bb2ab019d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:47.515988 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a590e1-83d9-457e-8fbe-fc7c52989f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:47.516690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a590e1-83d9-457e-8fbe-fc7c52989f57 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:47.517172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a590e1-83d9-457e-8fbe-fc7c52989f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:47.517751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a590e1-83d9-457e-8fbe-fc7c52989f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:47.527249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a590e1-83d9-457e-8fbe-fc7c52989f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:47.528703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a590e1-83d9-457e-8fbe-fc7c52989f57 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:47.539475 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 885/1793] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:29:48.108438 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796e9ca-0060-4f2a-8126-b88f7222a440 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:48.111337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b796e9ca-0060-4f2a-8126-b88f7222a440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:48.138148 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796e9ca-0060-4f2a-8126-b88f7222a440 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:48.145410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:48.160350 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:48.166463 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:48.166463 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] PATH_INFO: `/v3/projects/784ea03a28b849a2afb4d90ea41b812e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:48.166463 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] RBAC: Authorizing `identity:delete_project(project_id=784ea03a28b849a2afb4d90ea41b812e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:48.166463 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:48.378991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784ea03a28b849a2afb4d90ea41b812e', 'request_id': 'req-f0541ab5-a71c-4b50-8f50-f06934c1b32c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:48.472252 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784ea03a28b849a2afb4d90ea41b812e', 'request_id': 'req-f0541ab5-a71c-4b50-8f50-f06934c1b32c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:48.478862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784ea03a28b849a2afb4d90ea41b812e', 'request_id': 'req-f0541ab5-a71c-4b50-8f50-f06934c1b32c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:48.491517 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] The token cache is being invalidate because project 784ea03a28b849a2afb4d90ea41b812e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:48.491921 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:48.499344 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:48.502788 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 909/1794] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:48 2021] DELETE /identity/v3/projects/784ea03a28b849a2afb4d90ea41b812e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:48.506494 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a590e1-83d9-457e-8fbe-fc7c52989f57 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:48.516575 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a590e1-83d9-457e-8fbe-fc7c52989f57 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:48.575527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab739c1-e75f-475b-a07d-0d9cd6db7222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:48.576549 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab739c1-e75f-475b-a07d-0d9cd6db7222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:48.576831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab739c1-e75f-475b-a07d-0d9cd6db7222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:48.577106 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab739c1-e75f-475b-a07d-0d9cd6db7222 admin admin] PATH_INFO: `/v3/users/6e5b3104caba4e57b9a5bd6fb5d197aa` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:48.578369 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab739c1-e75f-475b-a07d-0d9cd6db7222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e5b3104caba4e57b9a5bd6fb5d197aa)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:48.580942 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab739c1-e75f-475b-a07d-0d9cd6db7222 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:48.748058 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4ab739c1-e75f-475b-a07d-0d9cd6db7222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e5b3104caba4e57b9a5bd6fb5d197aa'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:48.755573 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4ab739c1-e75f-475b-a07d-0d9cd6db7222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e5b3104caba4e57b9a5bd6fb5d197aa'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:48.756352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4ab739c1-e75f-475b-a07d-0d9cd6db7222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e5b3104caba4e57b9a5bd6fb5d197aa'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:48.768789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4ab739c1-e75f-475b-a07d-0d9cd6db7222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e5b3104caba4e57b9a5bd6fb5d197aa'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:48.826146 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4ab739c1-e75f-475b-a07d-0d9cd6db7222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e5b3104caba4e57b9a5bd6fb5d197aa'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:48.833187 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 886/1795] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:29:48 2021] DELETE /identity/v3/users/6e5b3104caba4e57b9a5bd6fb5d197aa => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:49.370302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:49.371977 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:49.396465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0541ab5-a71c-4b50-8f50-f06934c1b32c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:49.468410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fa232-5710-43c2-9a52-0513438e5a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:49.469189 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fa232-5710-43c2-9a52-0513438e5a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:49.469468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fa232-5710-43c2-9a52-0513438e5a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:49.470406 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fa232-5710-43c2-9a52-0513438e5a42 admin admin] PATH_INFO: `/v3/projects/fedaaca72af646fda32b00f141fff6a5` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:49.471845 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fa232-5710-43c2-9a52-0513438e5a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fedaaca72af646fda32b00f141fff6a5)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:49.473760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fa232-5710-43c2-9a52-0513438e5a42 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:49.587502 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3c4fa232-5710-43c2-9a52-0513438e5a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fedaaca72af646fda32b00f141fff6a5', 'request_id': 'req-3c4fa232-5710-43c2-9a52-0513438e5a42'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:49.643296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3c4fa232-5710-43c2-9a52-0513438e5a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fedaaca72af646fda32b00f141fff6a5', 'request_id': 'req-3c4fa232-5710-43c2-9a52-0513438e5a42'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:49.649855 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3c4fa232-5710-43c2-9a52-0513438e5a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fedaaca72af646fda32b00f141fff6a5', 'request_id': 'req-3c4fa232-5710-43c2-9a52-0513438e5a42'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:49.664162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3c4fa232-5710-43c2-9a52-0513438e5a42 admin admin] The token cache is being invalidate because project fedaaca72af646fda32b00f141fff6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:29:49.664162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3c4fa232-5710-43c2-9a52-0513438e5a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:49.664741 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3c4fa232-5710-43c2-9a52-0513438e5a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:29:49.666406 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 910/1796] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:29:49 2021] DELETE /identity/v3/projects/fedaaca72af646fda32b00f141fff6a5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:49.672130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395563e-c6d4-48f5-9a05-636c4223c49f None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:49.672645 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395563e-c6d4-48f5-9a05-636c4223c49f None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:49.673008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395563e-c6d4-48f5-9a05-636c4223c49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:49.693095 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d395563e-c6d4-48f5-9a05-636c4223c49f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:49.694391 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d395563e-c6d4-48f5-9a05-636c4223c49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:49.751610 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 887/1797] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:49.760771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc930a-b27b-4cc4-93a0-26d466f50ea2 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:49.761038 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc930a-b27b-4cc4-93a0-26d466f50ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:49.761306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc930a-b27b-4cc4-93a0-26d466f50ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:49.779870 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-18bc930a-b27b-4cc4-93a0-26d466f50ea2 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:49.781045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-18bc930a-b27b-4cc4-93a0-26d466f50ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:49.788940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 911/1798] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:29:49.793154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395563e-c6d4-48f5-9a05-636c4223c49f None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:49.802829 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395563e-c6d4-48f5-9a05-636c4223c49f None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:49.807443 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a2c12-f7c8-408c-a90a-00e7e8c8d7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:49.808126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a2c12-f7c8-408c-a90a-00e7e8c8d7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:49.808409 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a2c12-f7c8-408c-a90a-00e7e8c8d7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:49.808683 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a2c12-f7c8-408c-a90a-00e7e8c8d7f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:49.809417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a2c12-f7c8-408c-a90a-00e7e8c8d7f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:29:49.809721 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a2c12-f7c8-408c-a90a-00e7e8c8d7f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:49.811308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a2c12-f7c8-408c-a90a-00e7e8c8d7f1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:49.828740 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 888/1799] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:29:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:29:49.833965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc930a-b27b-4cc4-93a0-26d466f50ea2 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:49.843513 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc930a-b27b-4cc4-93a0-26d466f50ea2 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:49.848566 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57de6d-7611-4e5e-ba22-7c0e042cd28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:49.849234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57de6d-7611-4e5e-ba22-7c0e042cd28e admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:49.849503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57de6d-7611-4e5e-ba22-7c0e042cd28e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:49.849775 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57de6d-7611-4e5e-ba22-7c0e042cd28e admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:49.850489 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57de6d-7611-4e5e-ba22-7c0e042cd28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:49.852563 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57de6d-7611-4e5e-ba22-7c0e042cd28e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:49.948382 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 912/1800] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:29:49 2021] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:29:49.952869 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a2c12-f7c8-408c-a90a-00e7e8c8d7f1 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:49.962639 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a2c12-f7c8-408c-a90a-00e7e8c8d7f1 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:50.019719 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed22de-db67-404c-aeda-34d119783401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:50.020412 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed22de-db67-404c-aeda-34d119783401 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:50.020690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed22de-db67-404c-aeda-34d119783401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:50.020960 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed22de-db67-404c-aeda-34d119783401 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:50.021678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed22de-db67-404c-aeda-34d119783401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:50.023750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed22de-db67-404c-aeda-34d119783401 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:50.157829 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 889/1801] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:29:49 2021] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:29:50.162024 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57de6d-7611-4e5e-ba22-7c0e042cd28e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:50.173547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57de6d-7611-4e5e-ba22-7c0e042cd28e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:50.178644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa7d5f-7505-42ad-b33f-6bb9c903b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:50.178813 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa7d5f-7505-42ad-b33f-6bb9c903b462 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:50.179090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa7d5f-7505-42ad-b33f-6bb9c903b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:50.179360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa7d5f-7505-42ad-b33f-6bb9c903b462 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:50.180132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa7d5f-7505-42ad-b33f-6bb9c903b462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:50.181732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa7d5f-7505-42ad-b33f-6bb9c903b462 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:50.192761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 913/1802] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:50.196916 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed22de-db67-404c-aeda-34d119783401 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:50.207694 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed22de-db67-404c-aeda-34d119783401 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:50.212619 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c2170-70b8-4f77-9976-60de0466a286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:50.213371 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c2170-70b8-4f77-9976-60de0466a286 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:50.213658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c2170-70b8-4f77-9976-60de0466a286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:50.213933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c2170-70b8-4f77-9976-60de0466a286 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:50.214704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c2170-70b8-4f77-9976-60de0466a286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:50.216376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c2170-70b8-4f77-9976-60de0466a286 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:50.230369 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 890/1803] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:29:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:29:50.236987 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa7d5f-7505-42ad-b33f-6bb9c903b462 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:50.247206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa7d5f-7505-42ad-b33f-6bb9c903b462 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:50.252695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cba410-8342-4862-9ef5-a217921c12bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:50.253576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba410-8342-4862-9ef5-a217921c12bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:50.253882 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba410-8342-4862-9ef5-a217921c12bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:50.254154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba410-8342-4862-9ef5-a217921c12bc admin admin] PATH_INFO: `/v3/projects/e28a94be4c564fad8486abdd6cba47dd/users/f6fadb62d7ad4e96bf9b6a93072096ff/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:50.269601 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cba410-8342-4862-9ef5-a217921c12bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28a94be4c564fad8486abdd6cba47dd, user_id=f6fadb62d7ad4e96bf9b6a93072096ff, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:50.272273 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cba410-8342-4862-9ef5-a217921c12bc admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:50.357613 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 914/1804] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:29:50 2021] PUT /identity/v3/projects/e28a94be4c564fad8486abdd6cba47dd/users/f6fadb62d7ad4e96bf9b6a93072096ff/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:29:50.374510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648f31c-6b01-4e0c-86f5-56f449243d99 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:50.374714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648f31c-6b01-4e0c-86f5-56f449243d99 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:50.374982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648f31c-6b01-4e0c-86f5-56f449243d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:50.402004 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-8648f31c-6b01-4e0c-86f5-56f449243d99 None None] MFA Rules not processed for user `f6fadb62d7ad4e96bf9b6a93072096ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:29:50.403226 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8648f31c-6b01-4e0c-86f5-56f449243d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:50.468749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 891/1805] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:29:50 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:29:50.481690 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cba410-8342-4862-9ef5-a217921c12bc admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:50.483389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-68cba410-8342-4862-9ef5-a217921c12bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:50.551421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cba410-8342-4862-9ef5-a217921c12bc admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:50.555094 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc90c0-9c4c-4bda-a210-1c874b172e38 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0998dd32ba8648cfb7f43797a9266d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:50.555818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc90c0-9c4c-4bda-a210-1c874b172e38 service glance] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:50.556103 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc90c0-9c4c-4bda-a210-1c874b172e38 service glance] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:50.556378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc90c0-9c4c-4bda-a210-1c874b172e38 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:50.565959 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc90c0-9c4c-4bda-a210-1c874b172e38 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:50.567463 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc90c0-9c4c-4bda-a210-1c874b172e38 service glance] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:50.576931 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 915/1806] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:50 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:29:57.845870 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648f31c-6b01-4e0c-86f5-56f449243d99 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:29:57.846832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8648f31c-6b01-4e0c-86f5-56f449243d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:57.909393 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648f31c-6b01-4e0c-86f5-56f449243d99 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:29:57.913050 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52ac85-a9b7-4ad5-84ab-182e11260f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:29:57.913702 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52ac85-a9b7-4ad5-84ab-182e11260f2d service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:29:57.914116 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52ac85-a9b7-4ad5-84ab-182e11260f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:29:57.914425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52ac85-a9b7-4ad5-84ab-182e11260f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:29:57.918857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9b52ac85-a9b7-4ad5-84ab-182e11260f2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:29:58.012993 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52ac85-a9b7-4ad5-84ab-182e11260f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:29:58.014519 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52ac85-a9b7-4ad5-84ab-182e11260f2d service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:29:58.026971 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 892/1807] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:29:57 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:30:00.641728 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc90c0-9c4c-4bda-a210-1c874b172e38 service glance] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:00.643193 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0ffc90c0-9c4c-4bda-a210-1c874b172e38 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:00.728871 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc90c0-9c4c-4bda-a210-1c874b172e38 service glance] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:00.733773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f7e69-f6c2-414e-b39d-a664fee1fb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:00.734654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f7e69-f6c2-414e-b39d-a664fee1fb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:00.735496 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f7e69-f6c2-414e-b39d-a664fee1fb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:00.735980 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f7e69-f6c2-414e-b39d-a664fee1fb4d admin admin] PATH_INFO: `/v3/users/7230712341084e999f7c82022054d31a` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:00.737214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f7e69-f6c2-414e-b39d-a664fee1fb4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7230712341084e999f7c82022054d31a)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:00.739173 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f7e69-f6c2-414e-b39d-a664fee1fb4d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:00.930001 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-260f7e69-f6c2-414e-b39d-a664fee1fb4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7230712341084e999f7c82022054d31a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:00.930822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-260f7e69-f6c2-414e-b39d-a664fee1fb4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7230712341084e999f7c82022054d31a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:00.944154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-260f7e69-f6c2-414e-b39d-a664fee1fb4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7230712341084e999f7c82022054d31a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:00.951901 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-260f7e69-f6c2-414e-b39d-a664fee1fb4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7230712341084e999f7c82022054d31a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:01.002781 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-260f7e69-f6c2-414e-b39d-a664fee1fb4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7230712341084e999f7c82022054d31a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:01.010947 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 916/1808] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:00 2021] DELETE /identity/v3/users/7230712341084e999f7c82022054d31a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:01.015386 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127806e-4661-4269-98d8-d8ffc86bd5eb None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:01.015918 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127806e-4661-4269-98d8-d8ffc86bd5eb None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:01.016088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127806e-4661-4269-98d8-d8ffc86bd5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:01.035131 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-3127806e-4661-4269-98d8-d8ffc86bd5eb None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:01.036372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3127806e-4661-4269-98d8-d8ffc86bd5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:01.100150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 893/1809] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:01.111050 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f7e69-f6c2-414e-b39d-a664fee1fb4d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:01.115189 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-260f7e69-f6c2-414e-b39d-a664fee1fb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:01.180360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f7e69-f6c2-414e-b39d-a664fee1fb4d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:01.189434 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5212b68-d9de-4128-9f64-7fdb1fbea4dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:01.190106 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5212b68-d9de-4128-9f64-7fdb1fbea4dd service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:01.190385 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5212b68-d9de-4128-9f64-7fdb1fbea4dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:01.190654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5212b68-d9de-4128-9f64-7fdb1fbea4dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:01.200338 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5212b68-d9de-4128-9f64-7fdb1fbea4dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:01.201798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5212b68-d9de-4128-9f64-7fdb1fbea4dd service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:01.211715 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 917/1810] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:30:01.726103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127806e-4661-4269-98d8-d8ffc86bd5eb None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:01.727584 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3127806e-4661-4269-98d8-d8ffc86bd5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:01.741135 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127806e-4661-4269-98d8-d8ffc86bd5eb None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:01.747522 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:01.748504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:01.748852 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:01.749138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] PATH_INFO: `/v3/projects/2b66eccab4404d42b6291703f3eea606` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:01.750991 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b66eccab4404d42b6291703f3eea606)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:01.757283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:01.856131 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b66eccab4404d42b6291703f3eea606', 'request_id': 'req-92b7c235-2174-4446-90fd-4a276c694000'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:01.905727 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b66eccab4404d42b6291703f3eea606', 'request_id': 'req-92b7c235-2174-4446-90fd-4a276c694000'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:01.924365 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b66eccab4404d42b6291703f3eea606', 'request_id': 'req-92b7c235-2174-4446-90fd-4a276c694000'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:01.932719 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] The token cache is being invalidate because project 2b66eccab4404d42b6291703f3eea606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:01.933090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:01.933703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:01.935606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 894/1811] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:01 2021] DELETE /identity/v3/projects/2b66eccab4404d42b6291703f3eea606 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:01.940210 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5212b68-d9de-4128-9f64-7fdb1fbea4dd service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:01.950297 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5212b68-d9de-4128-9f64-7fdb1fbea4dd service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:02.013245 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430f3c2-f576-4513-8929-2da2db82a3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:02.014108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430f3c2-f576-4513-8929-2da2db82a3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:02.014385 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430f3c2-f576-4513-8929-2da2db82a3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:02.014660 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430f3c2-f576-4513-8929-2da2db82a3d7 admin admin] PATH_INFO: `/v3/users/79d9afc2cd9d4f25abf93cdc62cbce84` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:02.015952 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430f3c2-f576-4513-8929-2da2db82a3d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d9afc2cd9d4f25abf93cdc62cbce84)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:02.018083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430f3c2-f576-4513-8929-2da2db82a3d7 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:02.223251 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-7430f3c2-f576-4513-8929-2da2db82a3d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d9afc2cd9d4f25abf93cdc62cbce84'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:02.224102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-7430f3c2-f576-4513-8929-2da2db82a3d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d9afc2cd9d4f25abf93cdc62cbce84'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:02.238660 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-7430f3c2-f576-4513-8929-2da2db82a3d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d9afc2cd9d4f25abf93cdc62cbce84'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:02.246882 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-7430f3c2-f576-4513-8929-2da2db82a3d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d9afc2cd9d4f25abf93cdc62cbce84'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:02.310987 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-7430f3c2-f576-4513-8929-2da2db82a3d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d9afc2cd9d4f25abf93cdc62cbce84'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:02.317819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 918/1812] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:01 2021] DELETE /identity/v3/users/79d9afc2cd9d4f25abf93cdc62cbce84 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:02.753664 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:02.755271 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:02.769761 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7c235-2174-4446-90fd-4a276c694000 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:02.829421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0a209-2d5a-4d2b-8393-083ccab176c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:02.830308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0a209-2d5a-4d2b-8393-083ccab176c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:02.830587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0a209-2d5a-4d2b-8393-083ccab176c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:02.830858 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0a209-2d5a-4d2b-8393-083ccab176c0 admin admin] PATH_INFO: `/v3/projects/7dd041dc13664f24aea6e13a0b1df995` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:02.832083 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0a209-2d5a-4d2b-8393-083ccab176c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd041dc13664f24aea6e13a0b1df995)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:02.833959 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0a209-2d5a-4d2b-8393-083ccab176c0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:02.934063 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-5ad0a209-2d5a-4d2b-8393-083ccab176c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd041dc13664f24aea6e13a0b1df995', 'request_id': 'req-5ad0a209-2d5a-4d2b-8393-083ccab176c0'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:03.002644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-5ad0a209-2d5a-4d2b-8393-083ccab176c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd041dc13664f24aea6e13a0b1df995', 'request_id': 'req-5ad0a209-2d5a-4d2b-8393-083ccab176c0'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:03.009072 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-5ad0a209-2d5a-4d2b-8393-083ccab176c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd041dc13664f24aea6e13a0b1df995', 'request_id': 'req-5ad0a209-2d5a-4d2b-8393-083ccab176c0'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:03.021830 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-5ad0a209-2d5a-4d2b-8393-083ccab176c0 admin admin] The token cache is being invalidate because project 7dd041dc13664f24aea6e13a0b1df995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:03.022146 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-5ad0a209-2d5a-4d2b-8393-083ccab176c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:03.022800 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-5ad0a209-2d5a-4d2b-8393-083ccab176c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:03.025599 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 895/1813] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:02 2021] DELETE /identity/v3/projects/7dd041dc13664f24aea6e13a0b1df995 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:03.031440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00d74c-02db-44d2-8d1b-4540aeba3981 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:03.032158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00d74c-02db-44d2-8d1b-4540aeba3981 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:03.032158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00d74c-02db-44d2-8d1b-4540aeba3981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:03.050795 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-6f00d74c-02db-44d2-8d1b-4540aeba3981 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:03.052151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6f00d74c-02db-44d2-8d1b-4540aeba3981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:03.109550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 919/1814] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:03.117558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd678992-e36f-4475-85e6-c73694ca0920 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:03.117850 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd678992-e36f-4475-85e6-c73694ca0920 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:03.118132 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd678992-e36f-4475-85e6-c73694ca0920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:03.137578 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-cd678992-e36f-4475-85e6-c73694ca0920 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:03.138948 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-cd678992-e36f-4475-85e6-c73694ca0920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:03.148147 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 896/1815] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:03.152517 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00d74c-02db-44d2-8d1b-4540aeba3981 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:03.162795 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00d74c-02db-44d2-8d1b-4540aeba3981 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:03.167417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4aacb-5068-418c-ba9d-198963d7313c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:03.168110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4aacb-5068-418c-ba9d-198963d7313c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:03.168393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4aacb-5068-418c-ba9d-198963d7313c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:03.168673 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4aacb-5068-418c-ba9d-198963d7313c admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:03.169473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4aacb-5068-418c-ba9d-198963d7313c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:30:03.169785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4aacb-5068-418c-ba9d-198963d7313c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:03.171371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4aacb-5068-418c-ba9d-198963d7313c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:03.183785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 920/1816] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:30:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:30:03.188568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd678992-e36f-4475-85e6-c73694ca0920 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:03.199027 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd678992-e36f-4475-85e6-c73694ca0920 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:03.204461 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418752b2-8862-4bc0-8088-4368441f9f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:03.205219 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418752b2-8862-4bc0-8088-4368441f9f76 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:03.205496 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418752b2-8862-4bc0-8088-4368441f9f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:03.205768 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418752b2-8862-4bc0-8088-4368441f9f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:03.206475 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418752b2-8862-4bc0-8088-4368441f9f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:03.208431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418752b2-8862-4bc0-8088-4368441f9f76 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:03.314813 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 897/1817] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:03 2021] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:03.319896 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4aacb-5068-418c-ba9d-198963d7313c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:03.331239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4aacb-5068-418c-ba9d-198963d7313c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:03.388732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b102f9-b298-4df0-8e2b-f0e236281359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:03.389410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b102f9-b298-4df0-8e2b-f0e236281359 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:03.389696 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b102f9-b298-4df0-8e2b-f0e236281359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:03.390078 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b102f9-b298-4df0-8e2b-f0e236281359 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:03.391769 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b102f9-b298-4df0-8e2b-f0e236281359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:03.393699 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b102f9-b298-4df0-8e2b-f0e236281359 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:03.512741 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 921/1818] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:03 2021] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:03.516059 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418752b2-8862-4bc0-8088-4368441f9f76 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:03.526405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418752b2-8862-4bc0-8088-4368441f9f76 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:03.530935 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3cbcf-afd4-47ee-98ab-0b771242edd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:03.531785 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3cbcf-afd4-47ee-98ab-0b771242edd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:03.532077 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3cbcf-afd4-47ee-98ab-0b771242edd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:03.532337 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3cbcf-afd4-47ee-98ab-0b771242edd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:03.533163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3cbcf-afd4-47ee-98ab-0b771242edd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:03.534755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3cbcf-afd4-47ee-98ab-0b771242edd8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:03.546504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 898/1819] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:03 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:03.551183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b102f9-b298-4df0-8e2b-f0e236281359 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:03.563497 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b102f9-b298-4df0-8e2b-f0e236281359 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:03.568878 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1fc7a-6c53-4db3-877c-b0f6f3beb634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:03.569603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1fc7a-6c53-4db3-877c-b0f6f3beb634 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:03.569887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1fc7a-6c53-4db3-877c-b0f6f3beb634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:03.570173 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1fc7a-6c53-4db3-877c-b0f6f3beb634 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:03.571067 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1fc7a-6c53-4db3-877c-b0f6f3beb634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:03.572816 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1fc7a-6c53-4db3-877c-b0f6f3beb634 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:03.584974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 922/1820] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:03 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:03.589352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3cbcf-afd4-47ee-98ab-0b771242edd8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:03.601176 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3cbcf-afd4-47ee-98ab-0b771242edd8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:03.605985 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f43518-d1b7-4196-9cf0-71343c2aa3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:03.608073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f43518-d1b7-4196-9cf0-71343c2aa3e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:03.608073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f43518-d1b7-4196-9cf0-71343c2aa3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:03.608073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f43518-d1b7-4196-9cf0-71343c2aa3e8 admin admin] PATH_INFO: `/v3/projects/ce7ae18b4bfe440f8db8ccbbc8b3d7f6/users/51231dc6fb2d4c22807ea759a55905bc/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:03.623106 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f43518-d1b7-4196-9cf0-71343c2aa3e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7ae18b4bfe440f8db8ccbbc8b3d7f6, user_id=51231dc6fb2d4c22807ea759a55905bc, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:03.626895 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f43518-d1b7-4196-9cf0-71343c2aa3e8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:03.695275 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 899/1821] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:03 2021] PUT /identity/v3/projects/ce7ae18b4bfe440f8db8ccbbc8b3d7f6/users/51231dc6fb2d4c22807ea759a55905bc/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:03.705828 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a3dd1-a85e-4e8a-ba3b-eb76d98c1022 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:03.706113 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a3dd1-a85e-4e8a-ba3b-eb76d98c1022 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:03.706389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a3dd1-a85e-4e8a-ba3b-eb76d98c1022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:03.733430 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-cb3a3dd1-a85e-4e8a-ba3b-eb76d98c1022 None None] MFA Rules not processed for user `51231dc6fb2d4c22807ea759a55905bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:03.735196 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-cb3a3dd1-a85e-4e8a-ba3b-eb76d98c1022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:03.804825 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 923/1822] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:03 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:03.815277 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f43518-d1b7-4196-9cf0-71343c2aa3e8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:03.817123 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-f5f43518-d1b7-4196-9cf0-71343c2aa3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:03.885545 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f43518-d1b7-4196-9cf0-71343c2aa3e8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:03.889682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e1938-5761-4b36-994e-5b2a0f923c6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:03.890322 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e1938-5761-4b36-994e-5b2a0f923c6d service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:03.890597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e1938-5761-4b36-994e-5b2a0f923c6d service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:03.890899 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e1938-5761-4b36-994e-5b2a0f923c6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:03.900370 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e1938-5761-4b36-994e-5b2a0f923c6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:03.901819 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e1938-5761-4b36-994e-5b2a0f923c6d service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:03.913741 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 900/1823] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:03 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:03.934159 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a3dd1-a85e-4e8a-ba3b-eb76d98c1022 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:04.003649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a3dd1-a85e-4e8a-ba3b-eb76d98c1022 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:04.008624 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d407487-5a14-42a5-83e5-191c292c1a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:04.011966 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d407487-5a14-42a5-83e5-191c292c1a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:04.011966 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d407487-5a14-42a5-83e5-191c292c1a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:04.011966 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d407487-5a14-42a5-83e5-191c292c1a37 admin admin] PATH_INFO: `/v3/users/51231dc6fb2d4c22807ea759a55905bc` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:04.011966 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d407487-5a14-42a5-83e5-191c292c1a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51231dc6fb2d4c22807ea759a55905bc)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:04.013221 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d407487-5a14-42a5-83e5-191c292c1a37 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:04.221798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2d407487-5a14-42a5-83e5-191c292c1a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51231dc6fb2d4c22807ea759a55905bc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:04.222492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2d407487-5a14-42a5-83e5-191c292c1a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51231dc6fb2d4c22807ea759a55905bc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:04.234108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2d407487-5a14-42a5-83e5-191c292c1a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51231dc6fb2d4c22807ea759a55905bc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:04.240857 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2d407487-5a14-42a5-83e5-191c292c1a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51231dc6fb2d4c22807ea759a55905bc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:04.322442 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2d407487-5a14-42a5-83e5-191c292c1a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51231dc6fb2d4c22807ea759a55905bc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:04.329993 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 924/1824] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:03 2021] DELETE /identity/v3/users/51231dc6fb2d4c22807ea759a55905bc => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:04.337251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674629b3-50a7-4607-b0f3-19fc37e8b6a0 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:04.337600 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674629b3-50a7-4607-b0f3-19fc37e8b6a0 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:04.337871 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674629b3-50a7-4607-b0f3-19fc37e8b6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:04.356364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-674629b3-50a7-4607-b0f3-19fc37e8b6a0 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:04.357595 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-674629b3-50a7-4607-b0f3-19fc37e8b6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:04.417387 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 901/1825] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:04.427432 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d407487-5a14-42a5-83e5-191c292c1a37 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:04.428907 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-2d407487-5a14-42a5-83e5-191c292c1a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:04.492332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d407487-5a14-42a5-83e5-191c292c1a37 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:04.496042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c4775-a269-4bbd-982d-14bf9d50abfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:04.496702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c4775-a269-4bbd-982d-14bf9d50abfe service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:04.496985 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c4775-a269-4bbd-982d-14bf9d50abfe service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:04.497258 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c4775-a269-4bbd-982d-14bf9d50abfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:04.509603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c4775-a269-4bbd-982d-14bf9d50abfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:04.509603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c4775-a269-4bbd-982d-14bf9d50abfe service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:04.520488 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 925/1826] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:04.540199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674629b3-50a7-4607-b0f3-19fc37e8b6a0 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:04.541618 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-674629b3-50a7-4607-b0f3-19fc37e8b6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:04.553439 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674629b3-50a7-4607-b0f3-19fc37e8b6a0 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:04.558077 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d53aa-93d4-4dda-88d0-6f1b7b1a3afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:04.559083 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d53aa-93d4-4dda-88d0-6f1b7b1a3afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:04.559368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d53aa-93d4-4dda-88d0-6f1b7b1a3afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:04.559640 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d53aa-93d4-4dda-88d0-6f1b7b1a3afb admin admin] PATH_INFO: `/v3/users/dfe7f677e68a418ab4dd1bbf7a3fc5b3` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:04.560929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d53aa-93d4-4dda-88d0-6f1b7b1a3afb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe7f677e68a418ab4dd1bbf7a3fc5b3)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:04.563354 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d53aa-93d4-4dda-88d0-6f1b7b1a3afb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:04.813947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ed9d53aa-93d4-4dda-88d0-6f1b7b1a3afb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe7f677e68a418ab4dd1bbf7a3fc5b3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:04.822075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ed9d53aa-93d4-4dda-88d0-6f1b7b1a3afb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe7f677e68a418ab4dd1bbf7a3fc5b3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:04.822800 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ed9d53aa-93d4-4dda-88d0-6f1b7b1a3afb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe7f677e68a418ab4dd1bbf7a3fc5b3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:04.837436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ed9d53aa-93d4-4dda-88d0-6f1b7b1a3afb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe7f677e68a418ab4dd1bbf7a3fc5b3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:04.905598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ed9d53aa-93d4-4dda-88d0-6f1b7b1a3afb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe7f677e68a418ab4dd1bbf7a3fc5b3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:04.913077 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 902/1827] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:04 2021] DELETE /identity/v3/users/dfe7f677e68a418ab4dd1bbf7a3fc5b3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:04.917417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c99175-efe5-4041-a438-dedcb3c7e73c None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:04.917706 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c99175-efe5-4041-a438-dedcb3c7e73c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:04.917982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c99175-efe5-4041-a438-dedcb3c7e73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:04.937353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-e9c99175-efe5-4041-a438-dedcb3c7e73c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:04.939167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e9c99175-efe5-4041-a438-dedcb3c7e73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:04.980980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d53aa-93d4-4dda-88d0-6f1b7b1a3afb admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:04.982649 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ed9d53aa-93d4-4dda-88d0-6f1b7b1a3afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:05.013258 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 926/1828] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:05.027794 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c99175-efe5-4041-a438-dedcb3c7e73c None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:05.029626 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e9c99175-efe5-4041-a438-dedcb3c7e73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:05.056472 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d53aa-93d4-4dda-88d0-6f1b7b1a3afb admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:05.061879 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75100d61-0d15-4288-8a74-c2b77b95cdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:05.063490 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75100d61-0d15-4288-8a74-c2b77b95cdfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:05.063977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75100d61-0d15-4288-8a74-c2b77b95cdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:05.064422 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75100d61-0d15-4288-8a74-c2b77b95cdfa admin admin] PATH_INFO: `/v3/projects/ce7ae18b4bfe440f8db8ccbbc8b3d7f6` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:05.065782 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75100d61-0d15-4288-8a74-c2b77b95cdfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7ae18b4bfe440f8db8ccbbc8b3d7f6)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:05.067856 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75100d61-0d15-4288-8a74-c2b77b95cdfa admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:05.091715 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c99175-efe5-4041-a438-dedcb3c7e73c None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:05.104295 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613f6af-c1bd-4942-a3bd-bb96c6384aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:05.105036 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613f6af-c1bd-4942-a3bd-bb96c6384aae service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:05.105380 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613f6af-c1bd-4942-a3bd-bb96c6384aae service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:05.107323 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613f6af-c1bd-4942-a3bd-bb96c6384aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:05.118128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613f6af-c1bd-4942-a3bd-bb96c6384aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:05.122297 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613f6af-c1bd-4942-a3bd-bb96c6384aae service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:05.130231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 927/1829] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:05.204582 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-75100d61-0d15-4288-8a74-c2b77b95cdfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7ae18b4bfe440f8db8ccbbc8b3d7f6', 'request_id': 'req-75100d61-0d15-4288-8a74-c2b77b95cdfa'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:05.284276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-75100d61-0d15-4288-8a74-c2b77b95cdfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7ae18b4bfe440f8db8ccbbc8b3d7f6', 'request_id': 'req-75100d61-0d15-4288-8a74-c2b77b95cdfa'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:05.290496 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-75100d61-0d15-4288-8a74-c2b77b95cdfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7ae18b4bfe440f8db8ccbbc8b3d7f6', 'request_id': 'req-75100d61-0d15-4288-8a74-c2b77b95cdfa'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:05.302241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-75100d61-0d15-4288-8a74-c2b77b95cdfa admin admin] The token cache is being invalidate because project ce7ae18b4bfe440f8db8ccbbc8b3d7f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:05.302527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-75100d61-0d15-4288-8a74-c2b77b95cdfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:05.303218 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-75100d61-0d15-4288-8a74-c2b77b95cdfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:05.308689 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 903/1830] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:04 2021] DELETE /identity/v3/projects/ce7ae18b4bfe440f8db8ccbbc8b3d7f6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:05.317171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932f50-7ab8-42dc-ade0-2a85d20d1eb3 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:05.317920 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932f50-7ab8-42dc-ade0-2a85d20d1eb3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:05.317920 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932f50-7ab8-42dc-ade0-2a85d20d1eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:05.338777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-19932f50-7ab8-42dc-ade0-2a85d20d1eb3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:05.342454 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-19932f50-7ab8-42dc-ade0-2a85d20d1eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:05.435063 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 928/1831] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:05.444252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1c67b-4ca9-472b-ac2a-2856e1069c93 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:05.445666 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1c67b-4ca9-472b-ac2a-2856e1069c93 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:05.445666 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1c67b-4ca9-472b-ac2a-2856e1069c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:05.464504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-f5e1c67b-4ca9-472b-ac2a-2856e1069c93 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:05.465715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-f5e1c67b-4ca9-472b-ac2a-2856e1069c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:05.474282 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 904/1832] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:05.478993 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19932f50-7ab8-42dc-ade0-2a85d20d1eb3 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:05.490185 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19932f50-7ab8-42dc-ade0-2a85d20d1eb3 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:05.497287 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d34e90-9acf-4dd7-b3b8-8e2ecbef314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:05.497287 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d34e90-9acf-4dd7-b3b8-8e2ecbef314a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:05.497627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d34e90-9acf-4dd7-b3b8-8e2ecbef314a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:05.498100 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d34e90-9acf-4dd7-b3b8-8e2ecbef314a admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:05.501632 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d34e90-9acf-4dd7-b3b8-8e2ecbef314a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:30:05.501632 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d34e90-9acf-4dd7-b3b8-8e2ecbef314a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:05.501632 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d34e90-9acf-4dd7-b3b8-8e2ecbef314a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:05.512970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 929/1833] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:30:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:30:05.517846 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1c67b-4ca9-472b-ac2a-2856e1069c93 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:05.527029 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1c67b-4ca9-472b-ac2a-2856e1069c93 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:05.532845 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d728ff-4780-45e0-88bf-d52479894bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:05.533576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d728ff-4780-45e0-88bf-d52479894bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:05.533918 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d728ff-4780-45e0-88bf-d52479894bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:05.534272 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d728ff-4780-45e0-88bf-d52479894bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:05.535053 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d728ff-4780-45e0-88bf-d52479894bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:05.537191 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d728ff-4780-45e0-88bf-d52479894bf0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:05.614123 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d34e90-9acf-4dd7-b3b8-8e2ecbef314a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:05.614123 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-27d34e90-9acf-4dd7-b3b8-8e2ecbef314a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:05.634714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d34e90-9acf-4dd7-b3b8-8e2ecbef314a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:05.642051 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:05.650213 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:05.650498 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:05.650775 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] PATH_INFO: `/v3/projects/cffb2d178ca849a382869f9d22823f9e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:05.655951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cffb2d178ca849a382869f9d22823f9e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:05.658718 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:05.667341 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 905/1834] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:05 2021] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:05.673453 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d728ff-4780-45e0-88bf-d52479894bf0 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:05.741219 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d728ff-4780-45e0-88bf-d52479894bf0 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:05.746775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6268fd-381d-43ad-8d3f-c68e4d781d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:05.750159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6268fd-381d-43ad-8d3f-c68e4d781d3d admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:05.750159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6268fd-381d-43ad-8d3f-c68e4d781d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:05.750159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6268fd-381d-43ad-8d3f-c68e4d781d3d admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:05.750159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6268fd-381d-43ad-8d3f-c68e4d781d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:05.751195 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6268fd-381d-43ad-8d3f-c68e4d781d3d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:05.787332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cffb2d178ca849a382869f9d22823f9e', 'request_id': 'req-901b4e44-64fd-4e6f-8f15-b80c897a2c77'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:05.872047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 906/1835] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:05 2021] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:05.876587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6268fd-381d-43ad-8d3f-c68e4d781d3d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:05.884699 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cffb2d178ca849a382869f9d22823f9e', 'request_id': 'req-901b4e44-64fd-4e6f-8f15-b80c897a2c77'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:05.889245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6268fd-381d-43ad-8d3f-c68e4d781d3d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:05.892236 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cffb2d178ca849a382869f9d22823f9e', 'request_id': 'req-901b4e44-64fd-4e6f-8f15-b80c897a2c77'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:05.905201 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] The token cache is being invalidate because project cffb2d178ca849a382869f9d22823f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:05.905516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:05.906214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:05.907941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 930/1836] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:05 2021] DELETE /identity/v3/projects/cffb2d178ca849a382869f9d22823f9e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:05.911897 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:05.913466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:05.946617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9e276-069f-4e8d-8925-54f7157de185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:05.947294 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9e276-069f-4e8d-8925-54f7157de185 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:05.947579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9e276-069f-4e8d-8925-54f7157de185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:05.947890 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9e276-069f-4e8d-8925-54f7157de185 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:05.948646 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9e276-069f-4e8d-8925-54f7157de185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:05.950584 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9e276-069f-4e8d-8925-54f7157de185 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:05.963771 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 907/1837] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:05 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:30:05.965497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9e276-069f-4e8d-8925-54f7157de185 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:05.968063 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-16c9e276-069f-4e8d-8925-54f7157de185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:05.980026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b4e44-64fd-4e6f-8f15-b80c897a2c77 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:05.980755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9e276-069f-4e8d-8925-54f7157de185 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:05.986508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8c46-c61e-401a-987f-d69b507a421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:05.986760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1916a5-f23d-4062-bd02-60e36dd38a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:05.987404 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1916a5-f23d-4062-bd02-60e36dd38a69 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:05.987570 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8c46-c61e-401a-987f-d69b507a421f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:05.987707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1916a5-f23d-4062-bd02-60e36dd38a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:05.987884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8c46-c61e-401a-987f-d69b507a421f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:05.987977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1916a5-f23d-4062-bd02-60e36dd38a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:05.988161 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8c46-c61e-401a-987f-d69b507a421f admin admin] PATH_INFO: `/v3/users/9f2f4b6aaade425880b878910aba3f63` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:05.988731 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1916a5-f23d-4062-bd02-60e36dd38a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:05.989403 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab8c46-c61e-401a-987f-d69b507a421f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2f4b6aaade425880b878910aba3f63)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:05.990429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1916a5-f23d-4062-bd02-60e36dd38a69 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:05.991471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab8c46-c61e-401a-987f-d69b507a421f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:06.002141 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 908/1838] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:05 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:30:06.006867 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1916a5-f23d-4062-bd02-60e36dd38a69 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:06.020049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1916a5-f23d-4062-bd02-60e36dd38a69 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:06.025161 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cc3f3-8ad8-4d28-be68-6b12b54286d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:06.026152 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cc3f3-8ad8-4d28-be68-6b12b54286d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:06.026512 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cc3f3-8ad8-4d28-be68-6b12b54286d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:06.026855 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cc3f3-8ad8-4d28-be68-6b12b54286d7 admin admin] PATH_INFO: `/v3/projects/26f84303e0eb44a9abfba46538227b9e/users/b99a2ceee68e4cfe83a39a0ec4b6cd66/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:06.048591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cc3f3-8ad8-4d28-be68-6b12b54286d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f84303e0eb44a9abfba46538227b9e, user_id=b99a2ceee68e4cfe83a39a0ec4b6cd66, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:06.051513 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cc3f3-8ad8-4d28-be68-6b12b54286d7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:06.142654 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 909/1839] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:06 2021] PUT /identity/v3/projects/26f84303e0eb44a9abfba46538227b9e/users/b99a2ceee68e4cfe83a39a0ec4b6cd66/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:06.153082 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24889d8-a11e-46b3-ad82-4fd427c7f0f5 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:06.153375 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24889d8-a11e-46b3-ad82-4fd427c7f0f5 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:06.153650 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24889d8-a11e-46b3-ad82-4fd427c7f0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:06.187445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-b24889d8-a11e-46b3-ad82-4fd427c7f0f5 None None] MFA Rules not processed for user `b99a2ceee68e4cfe83a39a0ec4b6cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:06.187445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b24889d8-a11e-46b3-ad82-4fd427c7f0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:06.219851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-feab8c46-c61e-401a-987f-d69b507a421f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2f4b6aaade425880b878910aba3f63'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:06.221111 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-feab8c46-c61e-401a-987f-d69b507a421f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2f4b6aaade425880b878910aba3f63'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:06.241888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-feab8c46-c61e-401a-987f-d69b507a421f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2f4b6aaade425880b878910aba3f63'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:06.252645 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-feab8c46-c61e-401a-987f-d69b507a421f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2f4b6aaade425880b878910aba3f63'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:06.267077 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 910/1840] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:06.271768 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24889d8-a11e-46b3-ad82-4fd427c7f0f5 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:06.273449 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b24889d8-a11e-46b3-ad82-4fd427c7f0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:06.306647 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-feab8c46-c61e-401a-987f-d69b507a421f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2f4b6aaade425880b878910aba3f63'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:06.314453 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 931/1841] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:05 2021] DELETE /identity/v3/users/9f2f4b6aaade425880b878910aba3f63 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:06.349095 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24889d8-a11e-46b3-ad82-4fd427c7f0f5 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:06.432546 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcd323-6cd2-4101-8e31-bb898e94b116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:06.433245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcd323-6cd2-4101-8e31-bb898e94b116 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:06.433521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcd323-6cd2-4101-8e31-bb898e94b116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:06.433794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcd323-6cd2-4101-8e31-bb898e94b116 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:06.434499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcd323-6cd2-4101-8e31-bb898e94b116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:06.436416 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcd323-6cd2-4101-8e31-bb898e94b116 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:06.519490 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 911/1842] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:06 2021] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:06.522895 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8c46-c61e-401a-987f-d69b507a421f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:06.533168 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8c46-c61e-401a-987f-d69b507a421f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:06.594568 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea632470-3734-45ce-a779-9094d06be42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:06.595526 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea632470-3734-45ce-a779-9094d06be42c admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:06.595912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea632470-3734-45ce-a779-9094d06be42c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:06.596262 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea632470-3734-45ce-a779-9094d06be42c admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:06.597053 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea632470-3734-45ce-a779-9094d06be42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:06.599061 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea632470-3734-45ce-a779-9094d06be42c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:06.688713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 932/1843] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:06 2021] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:06.700764 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcd323-6cd2-4101-8e31-bb898e94b116 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:06.711236 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcd323-6cd2-4101-8e31-bb898e94b116 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:06.715856 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98cdf3-2386-40aa-8f3c-fb702bf014d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:06.716508 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98cdf3-2386-40aa-8f3c-fb702bf014d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:06.716782 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98cdf3-2386-40aa-8f3c-fb702bf014d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:06.717047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98cdf3-2386-40aa-8f3c-fb702bf014d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:06.717778 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98cdf3-2386-40aa-8f3c-fb702bf014d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:06.719374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98cdf3-2386-40aa-8f3c-fb702bf014d8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:06.729961 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 912/1844] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:06.734162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea632470-3734-45ce-a779-9094d06be42c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:06.745219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea632470-3734-45ce-a779-9094d06be42c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:06.749955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560d346-981c-4b01-8bd6-b17dbaec7da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:06.751271 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560d346-981c-4b01-8bd6-b17dbaec7da3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:06.751549 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560d346-981c-4b01-8bd6-b17dbaec7da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:06.752215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560d346-981c-4b01-8bd6-b17dbaec7da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:06.753376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560d346-981c-4b01-8bd6-b17dbaec7da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:06.753485 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98cdf3-2386-40aa-8f3c-fb702bf014d8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:06.754714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560d346-981c-4b01-8bd6-b17dbaec7da3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:06.755022 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ff98cdf3-2386-40aa-8f3c-fb702bf014d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:06.768694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 933/1845] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:06 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:06.772660 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98cdf3-2386-40aa-8f3c-fb702bf014d8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:06.773231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560d346-981c-4b01-8bd6-b17dbaec7da3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:06.778128 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b2d30-23cd-4f05-a89f-086f4dfb83b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:06.778850 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2d30-23cd-4f05-a89f-086f4dfb83b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:06.779119 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2d30-23cd-4f05-a89f-086f4dfb83b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:06.779392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2d30-23cd-4f05-a89f-086f4dfb83b7 admin admin] PATH_INFO: `/v3/projects/c0f4dc0a1d454674a6906bc5ad6e82b6` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:06.780915 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b2d30-23cd-4f05-a89f-086f4dfb83b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0f4dc0a1d454674a6906bc5ad6e82b6)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:06.783455 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b2d30-23cd-4f05-a89f-086f4dfb83b7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:06.786740 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560d346-981c-4b01-8bd6-b17dbaec7da3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:06.791575 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840083d-ba16-44c6-b79e-9d37d2950caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:06.792492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840083d-ba16-44c6-b79e-9d37d2950caf admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:06.792774 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840083d-ba16-44c6-b79e-9d37d2950caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:06.793193 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840083d-ba16-44c6-b79e-9d37d2950caf admin admin] PATH_INFO: `/v3/projects/6eaa0f49a23245a28a9042806c587a38/users/8de29ca37abd4addadcecfd51bfe7136/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:06.809128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840083d-ba16-44c6-b79e-9d37d2950caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eaa0f49a23245a28a9042806c587a38, user_id=8de29ca37abd4addadcecfd51bfe7136, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:06.811937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840083d-ba16-44c6-b79e-9d37d2950caf admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:06.883503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 934/1846] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:06 2021] PUT /identity/v3/projects/6eaa0f49a23245a28a9042806c587a38/users/8de29ca37abd4addadcecfd51bfe7136/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:06.885172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-008b2d30-23cd-4f05-a89f-086f4dfb83b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0f4dc0a1d454674a6906bc5ad6e82b6', 'request_id': 'req-008b2d30-23cd-4f05-a89f-086f4dfb83b7'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:06.893592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abc1f1-b465-4688-956a-94c888b4f387 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:06.893930 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abc1f1-b465-4688-956a-94c888b4f387 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:06.894207 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abc1f1-b465-4688-956a-94c888b4f387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:06.920885 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-b0abc1f1-b465-4688-956a-94c888b4f387 None None] MFA Rules not processed for user `8de29ca37abd4addadcecfd51bfe7136`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:06.923155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b0abc1f1-b465-4688-956a-94c888b4f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:06.933964 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-008b2d30-23cd-4f05-a89f-086f4dfb83b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0f4dc0a1d454674a6906bc5ad6e82b6', 'request_id': 'req-008b2d30-23cd-4f05-a89f-086f4dfb83b7'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:06.939622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-008b2d30-23cd-4f05-a89f-086f4dfb83b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0f4dc0a1d454674a6906bc5ad6e82b6', 'request_id': 'req-008b2d30-23cd-4f05-a89f-086f4dfb83b7'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:06.950986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-008b2d30-23cd-4f05-a89f-086f4dfb83b7 admin admin] The token cache is being invalidate because project c0f4dc0a1d454674a6906bc5ad6e82b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:06.951269 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-008b2d30-23cd-4f05-a89f-086f4dfb83b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:06.951964 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-008b2d30-23cd-4f05-a89f-086f4dfb83b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:06.954228 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 913/1847] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:06 2021] DELETE /identity/v3/projects/c0f4dc0a1d454674a6906bc5ad6e82b6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:06.961272 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288356b-61a6-4ff4-94d1-ee0d24ce2e24 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:06.961557 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288356b-61a6-4ff4-94d1-ee0d24ce2e24 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:06.961832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288356b-61a6-4ff4-94d1-ee0d24ce2e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:06.980887 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-1288356b-61a6-4ff4-94d1-ee0d24ce2e24 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:06.982095 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-1288356b-61a6-4ff4-94d1-ee0d24ce2e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:06.988508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 935/1848] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:06.993197 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abc1f1-b465-4688-956a-94c888b4f387 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:06.994560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b0abc1f1-b465-4688-956a-94c888b4f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:07.040598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 914/1849] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:07.049220 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ead70e-34bb-4101-ae45-f10b4ef44bb3 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.049500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ead70e-34bb-4101-ae45-f10b4ef44bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.049771 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ead70e-34bb-4101-ae45-f10b4ef44bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.063880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abc1f1-b465-4688-956a-94c888b4f387 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:07.068172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d9ead70e-34bb-4101-ae45-f10b4ef44bb3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:07.068459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3c0ec-d74c-4582-aca4-857ff1087c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:07.069130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3c0ec-d74c-4582-aca4-857ff1087c2f admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.069405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d9ead70e-34bb-4101-ae45-f10b4ef44bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:07.069521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3c0ec-d74c-4582-aca4-857ff1087c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.069694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3c0ec-d74c-4582-aca4-857ff1087c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.070371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3c0ec-d74c-4582-aca4-857ff1087c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:07.072289 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3c0ec-d74c-4582-aca4-857ff1087c2f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:07.077804 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 915/1850] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:07.082092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ead70e-34bb-4101-ae45-f10b4ef44bb3 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:07.091518 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ead70e-34bb-4101-ae45-f10b4ef44bb3 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:07.096978 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c79e4-a7db-4a2b-8dc4-d338a3080fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:07.097638 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c79e4-a7db-4a2b-8dc4-d338a3080fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.098022 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c79e4-a7db-4a2b-8dc4-d338a3080fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.098301 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c79e4-a7db-4a2b-8dc4-d338a3080fa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.099045 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c79e4-a7db-4a2b-8dc4-d338a3080fa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:30:07.099351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c79e4-a7db-4a2b-8dc4-d338a3080fa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:07.100993 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c79e4-a7db-4a2b-8dc4-d338a3080fa7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:07.113349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 916/1851] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:30:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:30:07.117745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c79e4-a7db-4a2b-8dc4-d338a3080fa7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:07.128214 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c79e4-a7db-4a2b-8dc4-d338a3080fa7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:07.133015 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1b030-13bb-4188-ba09-07eebabbe9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:07.133649 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1b030-13bb-4188-ba09-07eebabbe9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.133927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1b030-13bb-4188-ba09-07eebabbe9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.134197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1b030-13bb-4188-ba09-07eebabbe9c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.138715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1b030-13bb-4188-ba09-07eebabbe9c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:07.138715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1b030-13bb-4188-ba09-07eebabbe9c1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:07.181525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 936/1852] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:06 2021] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:07.185566 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3c0ec-d74c-4582-aca4-857ff1087c2f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:07.233218 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 917/1853] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:07 2021] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:07.237137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1b030-13bb-4188-ba09-07eebabbe9c1 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:07.248227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3c0ec-d74c-4582-aca4-857ff1087c2f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:07.298712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1b030-13bb-4188-ba09-07eebabbe9c1 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:07.303860 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b48bf-cefc-4c37-bd89-c660b4b2accc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:07.304155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc647e8b-487d-4870-9829-8805a9048d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:07.304542 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b48bf-cefc-4c37-bd89-c660b4b2accc admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.304907 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b48bf-cefc-4c37-bd89-c660b4b2accc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.305055 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc647e8b-487d-4870-9829-8805a9048d58 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.305202 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b48bf-cefc-4c37-bd89-c660b4b2accc admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.305335 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc647e8b-487d-4870-9829-8805a9048d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.305592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc647e8b-487d-4870-9829-8805a9048d58 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.305890 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b48bf-cefc-4c37-bd89-c660b4b2accc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:07.306308 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc647e8b-487d-4870-9829-8805a9048d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:07.308138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b48bf-cefc-4c37-bd89-c660b4b2accc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:07.308336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc647e8b-487d-4870-9829-8805a9048d58 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:07.380091 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 918/1854] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:07 2021] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:07.383958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b48bf-cefc-4c37-bd89-c660b4b2accc admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:07.392288 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 937/1855] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:07 2021] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:07.396323 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc647e8b-487d-4870-9829-8805a9048d58 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:07.397240 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b48bf-cefc-4c37-bd89-c660b4b2accc admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:07.401964 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6430-5ff3-4359-ac3a-6fb965af39e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:07.402648 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6430-5ff3-4359-ac3a-6fb965af39e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.408237 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6430-5ff3-4359-ac3a-6fb965af39e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.408237 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6430-5ff3-4359-ac3a-6fb965af39e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.408237 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda6430-5ff3-4359-ac3a-6fb965af39e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:07.408237 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda6430-5ff3-4359-ac3a-6fb965af39e2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:07.408572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc647e8b-487d-4870-9829-8805a9048d58 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:07.412868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d13ffb-8ddc-4fdb-abf3-9da088dab734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:07.415027 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d13ffb-8ddc-4fdb-abf3-9da088dab734 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.415027 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d13ffb-8ddc-4fdb-abf3-9da088dab734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.415027 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d13ffb-8ddc-4fdb-abf3-9da088dab734 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.415027 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d13ffb-8ddc-4fdb-abf3-9da088dab734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:07.416639 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d13ffb-8ddc-4fdb-abf3-9da088dab734 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:07.417672 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 919/1856] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:30:07.421808 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6430-5ff3-4359-ac3a-6fb965af39e2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:07.429511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 938/1857] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:30:07.432209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6430-5ff3-4359-ac3a-6fb965af39e2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:07.434334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d13ffb-8ddc-4fdb-abf3-9da088dab734 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:07.438419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e694a-657d-4847-9f66-dc098f11ac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:07.439632 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e694a-657d-4847-9f66-dc098f11ac33 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.439632 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e694a-657d-4847-9f66-dc098f11ac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.439632 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e694a-657d-4847-9f66-dc098f11ac33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.440452 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e694a-657d-4847-9f66-dc098f11ac33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:07.442447 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e694a-657d-4847-9f66-dc098f11ac33 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:07.445886 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d13ffb-8ddc-4fdb-abf3-9da088dab734 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:07.451277 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac22e9b-a64d-4f56-8269-542bb964991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:07.452231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac22e9b-a64d-4f56-8269-542bb964991e admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.452516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac22e9b-a64d-4f56-8269-542bb964991e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.452793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac22e9b-a64d-4f56-8269-542bb964991e admin admin] PATH_INFO: `/v3/projects/862258d318744fc19ff0e75f242485b9/users/ed25c35d01b04d3b8ef4cf61de5d2a60/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.455847 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 920/1858] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:30:07.458726 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e694a-657d-4847-9f66-dc098f11ac33 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:07.468359 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e694a-657d-4847-9f66-dc098f11ac33 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:07.473974 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3538e7b-74dd-4c57-a7a8-682c36cc2d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:07.474856 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3538e7b-74dd-4c57-a7a8-682c36cc2d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.475369 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3538e7b-74dd-4c57-a7a8-682c36cc2d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.475369 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3538e7b-74dd-4c57-a7a8-682c36cc2d10 admin admin] PATH_INFO: `/v3/projects/131e8f4d098e4d2ba64328c91f63c18c/users/5b2dbc6652b34cd3a4fc39dbabd839bc/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.476132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac22e9b-a64d-4f56-8269-542bb964991e admin admin] RBAC: Authorizing `identity:create_grant(project_id=862258d318744fc19ff0e75f242485b9, user_id=ed25c35d01b04d3b8ef4cf61de5d2a60, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:07.479002 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac22e9b-a64d-4f56-8269-542bb964991e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:07.490404 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3538e7b-74dd-4c57-a7a8-682c36cc2d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=131e8f4d098e4d2ba64328c91f63c18c, user_id=5b2dbc6652b34cd3a4fc39dbabd839bc, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:07.493019 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3538e7b-74dd-4c57-a7a8-682c36cc2d10 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:07.554004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 939/1859] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:07 2021] PUT /identity/v3/projects/862258d318744fc19ff0e75f242485b9/users/ed25c35d01b04d3b8ef4cf61de5d2a60/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:07.557913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac22e9b-a64d-4f56-8269-542bb964991e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:07.582668 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 921/1860] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:07 2021] PUT /identity/v3/projects/131e8f4d098e4d2ba64328c91f63c18c/users/5b2dbc6652b34cd3a4fc39dbabd839bc/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:07.588677 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dc1b0-b054-47c8-9199-9739c9c854d0 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.588961 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dc1b0-b054-47c8-9199-9739c9c854d0 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.589238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dc1b0-b054-47c8-9199-9739c9c854d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.612113 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-7e3dc1b0-b054-47c8-9199-9739c9c854d0 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:07.614017 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-7e3dc1b0-b054-47c8-9199-9739c9c854d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:07.623501 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac22e9b-a64d-4f56-8269-542bb964991e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:07.682796 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 922/1861] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:07.684122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152a7e9-6cc2-4857-abdb-6808ceb57b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:07.684808 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152a7e9-6cc2-4857-abdb-6808ceb57b35 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.685090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152a7e9-6cc2-4857-abdb-6808ceb57b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.685360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152a7e9-6cc2-4857-abdb-6808ceb57b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.686657 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152a7e9-6cc2-4857-abdb-6808ceb57b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:07.688753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152a7e9-6cc2-4857-abdb-6808ceb57b35 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:07.695711 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dc1b0-b054-47c8-9199-9739c9c854d0 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:07.697476 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-7e3dc1b0-b054-47c8-9199-9739c9c854d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:07.704734 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 940/1862] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:30:07.706473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152a7e9-6cc2-4857-abdb-6808ceb57b35 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:07.716996 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152a7e9-6cc2-4857-abdb-6808ceb57b35 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:07.722299 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a1f69-1c34-4101-b918-bf08d1ae100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:07.723194 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a1f69-1c34-4101-b918-bf08d1ae100f admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.723476 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a1f69-1c34-4101-b918-bf08d1ae100f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.723774 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a1f69-1c34-4101-b918-bf08d1ae100f admin admin] PATH_INFO: `/v3/projects/862258d318744fc19ff0e75f242485b9/users/ed25c35d01b04d3b8ef4cf61de5d2a60/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.725798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a1f69-1c34-4101-b918-bf08d1ae100f admin admin] RBAC: Authorizing `identity:create_grant(project_id=862258d318744fc19ff0e75f242485b9, user_id=ed25c35d01b04d3b8ef4cf61de5d2a60, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:07.728467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a1f69-1c34-4101-b918-bf08d1ae100f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:07.740940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 941/1863] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:07 2021] PUT /identity/v3/projects/862258d318744fc19ff0e75f242485b9/users/ed25c35d01b04d3b8ef4cf61de5d2a60/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:07.753191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560ed78-cb7c-4f3b-9054-70c55e4c7954 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.753506 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560ed78-cb7c-4f3b-9054-70c55e4c7954 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.753842 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560ed78-cb7c-4f3b-9054-70c55e4c7954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.768745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dc1b0-b054-47c8-9199-9739c9c854d0 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:07.783499 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-3560ed78-cb7c-4f3b-9054-70c55e4c7954 None None] MFA Rules not processed for user `ed25c35d01b04d3b8ef4cf61de5d2a60`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:07.785506 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3560ed78-cb7c-4f3b-9054-70c55e4c7954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:07.819412 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716dbe9-2322-49b9-8830-f1375dcdf893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:07.820330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716dbe9-2322-49b9-8830-f1375dcdf893 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.820608 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716dbe9-2322-49b9-8830-f1375dcdf893 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.820883 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716dbe9-2322-49b9-8830-f1375dcdf893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.864192 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 942/1864] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:07 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:07.882353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560ed78-cb7c-4f3b-9054-70c55e4c7954 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:07.883782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3560ed78-cb7c-4f3b-9054-70c55e4c7954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:07.885078 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716dbe9-2322-49b9-8830-f1375dcdf893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:07.886552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716dbe9-2322-49b9-8830-f1375dcdf893 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:07.897666 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 923/1865] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:30:07.953936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560ed78-cb7c-4f3b-9054-70c55e4c7954 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:07.958872 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e6f50-673a-4fd7-aed3-7997c243357d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:07.959571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e6f50-673a-4fd7-aed3-7997c243357d service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:07.959883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e6f50-673a-4fd7-aed3-7997c243357d service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:07.960163 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e6f50-673a-4fd7-aed3-7997c243357d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:07.962561 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-fb8e6f50-673a-4fd7-aed3-7997c243357d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:08.027580 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e6f50-673a-4fd7-aed3-7997c243357d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:08.029132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e6f50-673a-4fd7-aed3-7997c243357d service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:08.039916 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 943/1866] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:07 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:09.267123 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1436ae-1a1f-4b3c-9e3f-99b9621325f6 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:09.267653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1436ae-1a1f-4b3c-9e3f-99b9621325f6 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:09.267768 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1436ae-1a1f-4b3c-9e3f-99b9621325f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:09.297597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-eb1436ae-1a1f-4b3c-9e3f-99b9621325f6 None None] MFA Rules not processed for user `5b2dbc6652b34cd3a4fc39dbabd839bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:09.299094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-eb1436ae-1a1f-4b3c-9e3f-99b9621325f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:09.363940 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 924/1867] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:09 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:09.374025 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e6f50-673a-4fd7-aed3-7997c243357d service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:09.375939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-fb8e6f50-673a-4fd7-aed3-7997c243357d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:09.386068 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e6f50-673a-4fd7-aed3-7997c243357d service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:09.389793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ea4a1-b8bf-46af-ae6f-e48bb3430cc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:09.390428 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ea4a1-b8bf-46af-ae6f-e48bb3430cc5 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:09.391222 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ea4a1-b8bf-46af-ae6f-e48bb3430cc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:09.391495 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ea4a1-b8bf-46af-ae6f-e48bb3430cc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:09.399900 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ea4a1-b8bf-46af-ae6f-e48bb3430cc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:09.401303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ea4a1-b8bf-46af-ae6f-e48bb3430cc5 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:09.411302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 944/1868] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:09 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:11.186298 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1436ae-1a1f-4b3c-9e3f-99b9621325f6 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:11.198291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1436ae-1a1f-4b3c-9e3f-99b9621325f6 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:11.202714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8643b6-2a1f-4497-9110-d272c9b02133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:11.204539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8643b6-2a1f-4497-9110-d272c9b02133 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:11.204539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8643b6-2a1f-4497-9110-d272c9b02133 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:11.204787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8643b6-2a1f-4497-9110-d272c9b02133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:11.271278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8643b6-2a1f-4497-9110-d272c9b02133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:11.272914 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8643b6-2a1f-4497-9110-d272c9b02133 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:11.290991 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 925/1869] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:11 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:11.344763 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec9e74-ecc8-48b9-b69c-531f1950960e None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:11.345240 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec9e74-ecc8-48b9-b69c-531f1950960e None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:11.345361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec9e74-ecc8-48b9-b69c-531f1950960e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:11.370955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8eec9e74-ecc8-48b9-b69c-531f1950960e None None] MFA Rules not processed for user `5b2dbc6652b34cd3a4fc39dbabd839bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:11.373693 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8eec9e74-ecc8-48b9-b69c-531f1950960e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:11.389378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 945/1870] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:11 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:12.918248 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8643b6-2a1f-4497-9110-d272c9b02133 service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:12.927952 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8643b6-2a1f-4497-9110-d272c9b02133 service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:12.931694 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f484820-3ffa-4a1a-b94f-3cef1b927c68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:12.932481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f484820-3ffa-4a1a-b94f-3cef1b927c68 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:12.932763 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f484820-3ffa-4a1a-b94f-3cef1b927c68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:12.933041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f484820-3ffa-4a1a-b94f-3cef1b927c68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:12.942821 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f484820-3ffa-4a1a-b94f-3cef1b927c68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:12.944266 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f484820-3ffa-4a1a-b94f-3cef1b927c68 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:12.955478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 926/1871] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:12 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:15.790254 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec9e74-ecc8-48b9-b69c-531f1950960e None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:15.791717 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8eec9e74-ecc8-48b9-b69c-531f1950960e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:15.805971 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec9e74-ecc8-48b9-b69c-531f1950960e None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:15.810434 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37730080-5d15-4a5f-8976-3bf455345eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:15.811294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37730080-5d15-4a5f-8976-3bf455345eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:15.811572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37730080-5d15-4a5f-8976-3bf455345eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:15.811875 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37730080-5d15-4a5f-8976-3bf455345eb9 admin admin] PATH_INFO: `/v3/users/b6830e4efd0e43a489be164906ed9657` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:15.813060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37730080-5d15-4a5f-8976-3bf455345eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6830e4efd0e43a489be164906ed9657)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:15.815294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37730080-5d15-4a5f-8976-3bf455345eb9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:16.078707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-37730080-5d15-4a5f-8976-3bf455345eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6830e4efd0e43a489be164906ed9657'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:16.079658 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-37730080-5d15-4a5f-8976-3bf455345eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6830e4efd0e43a489be164906ed9657'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:16.093035 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-37730080-5d15-4a5f-8976-3bf455345eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6830e4efd0e43a489be164906ed9657'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:16.100796 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-37730080-5d15-4a5f-8976-3bf455345eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6830e4efd0e43a489be164906ed9657'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:16.214333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-37730080-5d15-4a5f-8976-3bf455345eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6830e4efd0e43a489be164906ed9657'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:16.221797 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 946/1872] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:15 2021] DELETE /identity/v3/users/b6830e4efd0e43a489be164906ed9657 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:16.226499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06677-8615-4465-8dd3-4ce0f074b974 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:16.227066 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06677-8615-4465-8dd3-4ce0f074b974 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:16.227066 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06677-8615-4465-8dd3-4ce0f074b974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:16.244783 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-85a06677-8615-4465-8dd3-4ce0f074b974 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:16.245995 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-85a06677-8615-4465-8dd3-4ce0f074b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:16.312999 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 927/1873] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:16.322716 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37730080-5d15-4a5f-8976-3bf455345eb9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:16.325150 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-37730080-5d15-4a5f-8976-3bf455345eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:16.389192 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37730080-5d15-4a5f-8976-3bf455345eb9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:16.394416 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2c11b-4f6b-40db-ae9c-6d5dcb88374f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:16.395074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2c11b-4f6b-40db-ae9c-6d5dcb88374f service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:16.395351 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2c11b-4f6b-40db-ae9c-6d5dcb88374f service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:16.395648 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2c11b-4f6b-40db-ae9c-6d5dcb88374f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:16.405817 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2c11b-4f6b-40db-ae9c-6d5dcb88374f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:16.408039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2c11b-4f6b-40db-ae9c-6d5dcb88374f service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:16.418606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 947/1874] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:16.919840 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a06677-8615-4465-8dd3-4ce0f074b974 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:16.921621 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-85a06677-8615-4465-8dd3-4ce0f074b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:16.943465 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a06677-8615-4465-8dd3-4ce0f074b974 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:16.954686 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:16.956104 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:16.956389 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:16.956664 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] PATH_INFO: `/v3/projects/512f23a55341411c9279737287084f1f` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:16.958021 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=512f23a55341411c9279737287084f1f)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:16.960294 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:17.135270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512f23a55341411c9279737287084f1f', 'request_id': 'req-3c0ac1a5-22e4-4833-a47f-c99133b5b289'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:17.274075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512f23a55341411c9279737287084f1f', 'request_id': 'req-3c0ac1a5-22e4-4833-a47f-c99133b5b289'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:17.286688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512f23a55341411c9279737287084f1f', 'request_id': 'req-3c0ac1a5-22e4-4833-a47f-c99133b5b289'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:17.307180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] The token cache is being invalidate because project 512f23a55341411c9279737287084f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:17.307680 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:17.308797 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:17.311944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 928/1875] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:16 2021] DELETE /identity/v3/projects/512f23a55341411c9279737287084f1f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:17.316187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2c11b-4f6b-40db-ae9c-6d5dcb88374f service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:17.326347 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2c11b-4f6b-40db-ae9c-6d5dcb88374f service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:17.384552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841f5bc-1792-4790-bc89-56c8569b8618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:17.385438 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f5bc-1792-4790-bc89-56c8569b8618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:17.385719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f5bc-1792-4790-bc89-56c8569b8618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:17.386026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f5bc-1792-4790-bc89-56c8569b8618 admin admin] PATH_INFO: `/v3/users/9243dcef502c441a8a1c3be161c6a77a` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:17.387264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841f5bc-1792-4790-bc89-56c8569b8618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9243dcef502c441a8a1c3be161c6a77a)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:17.389421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841f5bc-1792-4790-bc89-56c8569b8618 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:17.587997 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1841f5bc-1792-4790-bc89-56c8569b8618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9243dcef502c441a8a1c3be161c6a77a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:17.588793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1841f5bc-1792-4790-bc89-56c8569b8618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9243dcef502c441a8a1c3be161c6a77a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:17.601560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1841f5bc-1792-4790-bc89-56c8569b8618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9243dcef502c441a8a1c3be161c6a77a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:17.609380 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1841f5bc-1792-4790-bc89-56c8569b8618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9243dcef502c441a8a1c3be161c6a77a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:17.711198 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1841f5bc-1792-4790-bc89-56c8569b8618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9243dcef502c441a8a1c3be161c6a77a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:17.718590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 948/1876] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:17 2021] DELETE /identity/v3/users/9243dcef502c441a8a1c3be161c6a77a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:18.215290 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:18.217766 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:18.240956 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841f5bc-1792-4790-bc89-56c8569b8618 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:18.242518 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1841f5bc-1792-4790-bc89-56c8569b8618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:18.247888 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ac1a5-22e4-4833-a47f-c99133b5b289 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:18.329778 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:18.330699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:18.331152 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:18.331431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112 admin admin] PATH_INFO: `/v3/projects/1355e79fed3c427db546cf4eee2c8036` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:18.332832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1355e79fed3c427db546cf4eee2c8036)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:18.334968 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:18.340721 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841f5bc-1792-4790-bc89-56c8569b8618 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:18.346770 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952a931-8cb6-472b-a4e2-112c49c8e760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:18.348110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952a931-8cb6-472b-a4e2-112c49c8e760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:18.348533 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952a931-8cb6-472b-a4e2-112c49c8e760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:18.348954 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952a931-8cb6-472b-a4e2-112c49c8e760 admin admin] PATH_INFO: `/v3/users/b99a2ceee68e4cfe83a39a0ec4b6cd66` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:18.350576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952a931-8cb6-472b-a4e2-112c49c8e760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99a2ceee68e4cfe83a39a0ec4b6cd66)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:18.352778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952a931-8cb6-472b-a4e2-112c49c8e760 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:18.437952 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1355e79fed3c427db546cf4eee2c8036', 'request_id': 'req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:18.505003 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1355e79fed3c427db546cf4eee2c8036', 'request_id': 'req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:18.511810 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1355e79fed3c427db546cf4eee2c8036', 'request_id': 'req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:18.520505 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3952a931-8cb6-472b-a4e2-112c49c8e760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99a2ceee68e4cfe83a39a0ec4b6cd66'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:18.521179 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3952a931-8cb6-472b-a4e2-112c49c8e760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99a2ceee68e4cfe83a39a0ec4b6cd66'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:18.523972 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112 admin admin] The token cache is being invalidate because project 1355e79fed3c427db546cf4eee2c8036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:18.524324 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:18.524969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a29c5c11-5c48-4a73-8ce9-f7f17e8f8112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:18.526563 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 929/1877] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:18 2021] DELETE /identity/v3/projects/1355e79fed3c427db546cf4eee2c8036 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:18.532191 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b2c8b-bfbf-45aa-b503-c58c12de49f4 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:18.532655 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b2c8b-bfbf-45aa-b503-c58c12de49f4 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:18.533445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b2c8b-bfbf-45aa-b503-c58c12de49f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:18.535155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3952a931-8cb6-472b-a4e2-112c49c8e760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99a2ceee68e4cfe83a39a0ec4b6cd66'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:18.542905 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3952a931-8cb6-472b-a4e2-112c49c8e760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99a2ceee68e4cfe83a39a0ec4b6cd66'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:18.552490 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ff0b2c8b-bfbf-45aa-b503-c58c12de49f4 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:18.553707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ff0b2c8b-bfbf-45aa-b503-c58c12de49f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:18.635343 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 930/1878] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:18.682527 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3952a931-8cb6-472b-a4e2-112c49c8e760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99a2ceee68e4cfe83a39a0ec4b6cd66'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:18.853764 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84df6f-7b07-4849-959b-2ffaf8b95999 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:18.854940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 949/1879] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:18 2021] DELETE /identity/v3/users/b99a2ceee68e4cfe83a39a0ec4b6cd66 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:18.855427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84df6f-7b07-4849-959b-2ffaf8b95999 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:18.855427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84df6f-7b07-4849-959b-2ffaf8b95999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:18.855427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-7f84df6f-7b07-4849-959b-2ffaf8b95999 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:18.855427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-7f84df6f-7b07-4849-959b-2ffaf8b95999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:18.855427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 931/1880] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:18.855851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952a931-8cb6-472b-a4e2-112c49c8e760 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:18.855938 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6cef4-3d3b-4fc3-8338-c6c1c16375b8 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:18.855938 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6cef4-3d3b-4fc3-8338-c6c1c16375b8 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:18.855938 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6cef4-3d3b-4fc3-8338-c6c1c16375b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:18.856165 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3952a931-8cb6-472b-a4e2-112c49c8e760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:18.871473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952a931-8cb6-472b-a4e2-112c49c8e760 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:18.873137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-23b6cef4-3d3b-4fc3-8338-c6c1c16375b8 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:18.874332 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-23b6cef4-3d3b-4fc3-8338-c6c1c16375b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:18.877043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e1c01-c922-4d3e-a2e5-00eca0d97a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:18.877840 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e1c01-c922-4d3e-a2e5-00eca0d97a6f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:18.878243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e1c01-c922-4d3e-a2e5-00eca0d97a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:18.878748 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e1c01-c922-4d3e-a2e5-00eca0d97a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:18.881854 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e1c01-c922-4d3e-a2e5-00eca0d97a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:30:18.882317 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e1c01-c922-4d3e-a2e5-00eca0d97a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:18.883519 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 932/1881] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:18.887399 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e1c01-c922-4d3e-a2e5-00eca0d97a6f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:18.895259 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6cef4-3d3b-4fc3-8338-c6c1c16375b8 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:18.897566 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-23b6cef4-3d3b-4fc3-8338-c6c1c16375b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:18.902825 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 950/1882] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:30:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:30:18.986497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6cef4-3d3b-4fc3-8338-c6c1c16375b8 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:18.986497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d971d09-f170-4cd3-8edd-0856db655878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:18.986497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d971d09-f170-4cd3-8edd-0856db655878 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:18.986497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d971d09-f170-4cd3-8edd-0856db655878 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:18.986868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d971d09-f170-4cd3-8edd-0856db655878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:18.986868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d971d09-f170-4cd3-8edd-0856db655878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:18.986868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d971d09-f170-4cd3-8edd-0856db655878 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:18.986868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 933/1883] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:30:18.989548 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e1c01-c922-4d3e-a2e5-00eca0d97a6f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:18.999667 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e1c01-c922-4d3e-a2e5-00eca0d97a6f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:19.005089 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7108c-c755-4e7e-91ed-0a16639b53ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:19.005747 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7108c-c755-4e7e-91ed-0a16639b53ea admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:19.006024 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7108c-c755-4e7e-91ed-0a16639b53ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:19.006310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7108c-c755-4e7e-91ed-0a16639b53ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:19.007011 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7108c-c755-4e7e-91ed-0a16639b53ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:19.009341 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7108c-c755-4e7e-91ed-0a16639b53ea admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:19.175601 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 951/1884] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:18 2021] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:19.180138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d971d09-f170-4cd3-8edd-0856db655878 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:19.190741 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d971d09-f170-4cd3-8edd-0856db655878 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:19.285223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b6572-8328-4f47-b734-6b3932c33157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:19.285884 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b6572-8328-4f47-b734-6b3932c33157 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:19.286172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b6572-8328-4f47-b734-6b3932c33157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:19.286470 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b6572-8328-4f47-b734-6b3932c33157 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:19.287173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b6572-8328-4f47-b734-6b3932c33157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:19.291068 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b6572-8328-4f47-b734-6b3932c33157 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:19.443397 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 934/1885] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:19 2021] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:19.447529 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7108c-c755-4e7e-91ed-0a16639b53ea admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:19.460873 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7108c-c755-4e7e-91ed-0a16639b53ea admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:19.469485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3956f-b487-4d47-a67d-7373ad9dd0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:19.471245 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3956f-b487-4d47-a67d-7373ad9dd0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:19.471777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3956f-b487-4d47-a67d-7373ad9dd0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:19.472265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3956f-b487-4d47-a67d-7373ad9dd0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:19.473709 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3956f-b487-4d47-a67d-7373ad9dd0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:19.476230 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3956f-b487-4d47-a67d-7373ad9dd0e6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:19.488910 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 952/1886] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:19 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:19.493375 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b6572-8328-4f47-b734-6b3932c33157 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:19.505182 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b6572-8328-4f47-b734-6b3932c33157 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:19.523229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f11b5b-1ce3-4c3a-bc49-f7fbd4facc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:19.523229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11b5b-1ce3-4c3a-bc49-f7fbd4facc72 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:19.523229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11b5b-1ce3-4c3a-bc49-f7fbd4facc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:19.523229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11b5b-1ce3-4c3a-bc49-f7fbd4facc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:19.523618 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f11b5b-1ce3-4c3a-bc49-f7fbd4facc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:19.525266 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f11b5b-1ce3-4c3a-bc49-f7fbd4facc72 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:19.543788 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 935/1887] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:19 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:19.544936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3956f-b487-4d47-a67d-7373ad9dd0e6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:19.565665 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3956f-b487-4d47-a67d-7373ad9dd0e6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:19.571296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7997f-f86b-415e-a527-8a3ab687133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:19.572363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7997f-f86b-415e-a527-8a3ab687133e admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:19.572572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7997f-f86b-415e-a527-8a3ab687133e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:19.572852 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7997f-f86b-415e-a527-8a3ab687133e admin admin] PATH_INFO: `/v3/projects/17479b0427e04e77ad83272738369a54/users/f9e8bb10038b468da1e971df3a8c1429/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:19.605825 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7997f-f86b-415e-a527-8a3ab687133e admin admin] RBAC: Authorizing `identity:create_grant(project_id=17479b0427e04e77ad83272738369a54, user_id=f9e8bb10038b468da1e971df3a8c1429, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:19.609492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7997f-f86b-415e-a527-8a3ab687133e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:19.711552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f11b5b-1ce3-4c3a-bc49-f7fbd4facc72 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:19.712818 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d4f11b5b-1ce3-4c3a-bc49-f7fbd4facc72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:19.728920 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f11b5b-1ce3-4c3a-bc49-f7fbd4facc72 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:19.737485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 953/1888] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:19 2021] PUT /identity/v3/projects/17479b0427e04e77ad83272738369a54/users/f9e8bb10038b468da1e971df3a8c1429/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:19.748704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc59ac-dc2d-496d-bf59-b358332beeac None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:19.749553 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc59ac-dc2d-496d-bf59-b358332beeac None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:19.749837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc59ac-dc2d-496d-bf59-b358332beeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:19.780600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-90fc59ac-dc2d-496d-bf59-b358332beeac None None] MFA Rules not processed for user `f9e8bb10038b468da1e971df3a8c1429`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:19.782677 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-90fc59ac-dc2d-496d-bf59-b358332beeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:19.816568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:19.818983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:19.818983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:19.818983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] PATH_INFO: `/v3/projects/26f84303e0eb44a9abfba46538227b9e` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:19.819450 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f84303e0eb44a9abfba46538227b9e)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:19.821474 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:19.863285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 954/1889] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:19 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:19.868363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc59ac-dc2d-496d-bf59-b358332beeac None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:19.881313 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc59ac-dc2d-496d-bf59-b358332beeac None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:19.886038 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde8410-6ce7-4b9c-94a1-e35bfa52bf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:19.886735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde8410-6ce7-4b9c-94a1-e35bfa52bf10 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:19.887016 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde8410-6ce7-4b9c-94a1-e35bfa52bf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:19.887293 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde8410-6ce7-4b9c-94a1-e35bfa52bf10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:19.888095 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde8410-6ce7-4b9c-94a1-e35bfa52bf10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:19.889981 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde8410-6ce7-4b9c-94a1-e35bfa52bf10 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:19.927922 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f84303e0eb44a9abfba46538227b9e', 'request_id': 'req-2f54e693-07b6-4343-855a-634ee742d5a2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:19.993205 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 955/1890] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:19 2021] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:19.996818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde8410-6ce7-4b9c-94a1-e35bfa52bf10 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:20.013798 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f84303e0eb44a9abfba46538227b9e', 'request_id': 'req-2f54e693-07b6-4343-855a-634ee742d5a2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:20.022662 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f84303e0eb44a9abfba46538227b9e', 'request_id': 'req-2f54e693-07b6-4343-855a-634ee742d5a2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:20.035057 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] The token cache is being invalidate because project 26f84303e0eb44a9abfba46538227b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:20.035289 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:20.035975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:20.037705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 936/1891] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:19 2021] DELETE /identity/v3/projects/26f84303e0eb44a9abfba46538227b9e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:20.041481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:20.042843 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:20.065281 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde8410-6ce7-4b9c-94a1-e35bfa52bf10 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:20.074868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d9cc3-6da8-4886-b702-11b1d595632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:20.076710 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d9cc3-6da8-4886-b702-11b1d595632b admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:20.076710 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d9cc3-6da8-4886-b702-11b1d595632b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:20.076710 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d9cc3-6da8-4886-b702-11b1d595632b admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:20.077230 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d9cc3-6da8-4886-b702-11b1d595632b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:20.079781 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d9cc3-6da8-4886-b702-11b1d595632b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:20.113735 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54e693-07b6-4343-855a-634ee742d5a2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:20.118496 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b025652-d9b6-4b3a-b099-2b9a9938eed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:20.119403 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b025652-d9b6-4b3a-b099-2b9a9938eed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:20.119682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b025652-d9b6-4b3a-b099-2b9a9938eed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:20.119982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b025652-d9b6-4b3a-b099-2b9a9938eed3 admin admin] PATH_INFO: `/v3/users/8de29ca37abd4addadcecfd51bfe7136` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:20.121463 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b025652-d9b6-4b3a-b099-2b9a9938eed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de29ca37abd4addadcecfd51bfe7136)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:20.123457 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b025652-d9b6-4b3a-b099-2b9a9938eed3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:20.152034 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 956/1892] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:19 2021] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:20.155888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d9cc3-6da8-4886-b702-11b1d595632b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:20.158863 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c25d9cc3-6da8-4886-b702-11b1d595632b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:20.171867 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d9cc3-6da8-4886-b702-11b1d595632b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:20.176840 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e04df-a5d3-4370-a3e2-8934ac9982e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:20.177497 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e04df-a5d3-4370-a3e2-8934ac9982e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:20.177773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e04df-a5d3-4370-a3e2-8934ac9982e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:20.178044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e04df-a5d3-4370-a3e2-8934ac9982e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:20.178847 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e04df-a5d3-4370-a3e2-8934ac9982e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:20.180539 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e04df-a5d3-4370-a3e2-8934ac9982e5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:20.190843 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 957/1893] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:20 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:30:20.194929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e04df-a5d3-4370-a3e2-8934ac9982e5 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:20.206913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e04df-a5d3-4370-a3e2-8934ac9982e5 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:20.211467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e5408-2c21-44d6-b46b-e2524d8d6961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:20.212364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e5408-2c21-44d6-b46b-e2524d8d6961 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:20.212642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e5408-2c21-44d6-b46b-e2524d8d6961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:20.212910 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e5408-2c21-44d6-b46b-e2524d8d6961 admin admin] PATH_INFO: `/v3/projects/f90ee19ad8f247aa91ce4466f818bee0/users/c3164c4ec8ef4137afdfdfbe71da3010/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:20.228606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e5408-2c21-44d6-b46b-e2524d8d6961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90ee19ad8f247aa91ce4466f818bee0, user_id=c3164c4ec8ef4137afdfdfbe71da3010, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:20.231416 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e5408-2c21-44d6-b46b-e2524d8d6961 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:20.346160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 958/1894] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:20 2021] PUT /identity/v3/projects/f90ee19ad8f247aa91ce4466f818bee0/users/c3164c4ec8ef4137afdfdfbe71da3010/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:20.349753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e5408-2c21-44d6-b46b-e2524d8d6961 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:20.351403 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6a1e5408-2c21-44d6-b46b-e2524d8d6961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:20.365223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6b025652-d9b6-4b3a-b099-2b9a9938eed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de29ca37abd4addadcecfd51bfe7136'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:20.371966 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6b025652-d9b6-4b3a-b099-2b9a9938eed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de29ca37abd4addadcecfd51bfe7136'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:20.372738 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6b025652-d9b6-4b3a-b099-2b9a9938eed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de29ca37abd4addadcecfd51bfe7136'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:20.386393 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6b025652-d9b6-4b3a-b099-2b9a9938eed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de29ca37abd4addadcecfd51bfe7136'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:20.422428 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e5408-2c21-44d6-b46b-e2524d8d6961 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:20.427196 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8475b-ed83-48ec-92e6-9939c55429df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:20.428092 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8475b-ed83-48ec-92e6-9939c55429df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:20.428376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8475b-ed83-48ec-92e6-9939c55429df admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:20.428654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8475b-ed83-48ec-92e6-9939c55429df admin admin] PATH_INFO: `/v3/users/df16eb9ac1b7472ebe95d3739604e27b` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:20.429936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8475b-ed83-48ec-92e6-9939c55429df admin admin] RBAC: Authorizing `identity:delete_user(user_id=df16eb9ac1b7472ebe95d3739604e27b)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:20.431902 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8475b-ed83-48ec-92e6-9939c55429df admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:20.441815 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6b025652-d9b6-4b3a-b099-2b9a9938eed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de29ca37abd4addadcecfd51bfe7136'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:20.448102 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 937/1895] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:20 2021] DELETE /identity/v3/users/8de29ca37abd4addadcecfd51bfe7136 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:20.448916 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b025652-d9b6-4b3a-b099-2b9a9938eed3 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:20.450586 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6b025652-d9b6-4b3a-b099-2b9a9938eed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:20.518943 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b025652-d9b6-4b3a-b099-2b9a9938eed3 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:20.527360 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5c85a-c213-4591-baeb-0e79e1602ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:20.528097 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c85a-c213-4591-baeb-0e79e1602ceb admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:20.528378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c85a-c213-4591-baeb-0e79e1602ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:20.528718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c85a-c213-4591-baeb-0e79e1602ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:20.529476 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5c85a-c213-4591-baeb-0e79e1602ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:20.531058 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5c85a-c213-4591-baeb-0e79e1602ceb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:20.545559 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 938/1896] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:20 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:20.546582 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5c85a-c213-4591-baeb-0e79e1602ceb admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:20.556779 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5c85a-c213-4591-baeb-0e79e1602ceb admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:20.561582 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2228d6f-1251-413c-bf01-82009fba0af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:20.562398 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2228d6f-1251-413c-bf01-82009fba0af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:20.562678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2228d6f-1251-413c-bf01-82009fba0af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:20.562951 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2228d6f-1251-413c-bf01-82009fba0af9 admin admin] PATH_INFO: `/v3/projects/f90ee19ad8f247aa91ce4466f818bee0/users/c3164c4ec8ef4137afdfdfbe71da3010/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:20.565522 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2228d6f-1251-413c-bf01-82009fba0af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90ee19ad8f247aa91ce4466f818bee0, user_id=c3164c4ec8ef4137afdfdfbe71da3010, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:20.568207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2228d6f-1251-413c-bf01-82009fba0af9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:20.584842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 939/1897] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:20 2021] PUT /identity/v3/projects/f90ee19ad8f247aa91ce4466f818bee0/users/c3164c4ec8ef4137afdfdfbe71da3010/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:20.593650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-79e8475b-ed83-48ec-92e6-9939c55429df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df16eb9ac1b7472ebe95d3739604e27b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:20.594397 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-79e8475b-ed83-48ec-92e6-9939c55429df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df16eb9ac1b7472ebe95d3739604e27b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:20.597279 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6834a-36e0-4c3e-b0fe-f9a95d89aef2 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:20.598079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6834a-36e0-4c3e-b0fe-f9a95d89aef2 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:20.598861 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6834a-36e0-4c3e-b0fe-f9a95d89aef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:20.608492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-79e8475b-ed83-48ec-92e6-9939c55429df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df16eb9ac1b7472ebe95d3739604e27b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:20.617075 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-79e8475b-ed83-48ec-92e6-9939c55429df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df16eb9ac1b7472ebe95d3739604e27b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:20.636309 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-88c6834a-36e0-4c3e-b0fe-f9a95d89aef2 None None] MFA Rules not processed for user `c3164c4ec8ef4137afdfdfbe71da3010`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:20.637601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-88c6834a-36e0-4c3e-b0fe-f9a95d89aef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:20.688162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-79e8475b-ed83-48ec-92e6-9939c55429df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df16eb9ac1b7472ebe95d3739604e27b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:20.695629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 959/1898] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:20 2021] DELETE /identity/v3/users/df16eb9ac1b7472ebe95d3739604e27b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:20.713548 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 940/1899] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:20 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:20.725069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8475b-ed83-48ec-92e6-9939c55429df admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:20.727443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-79e8475b-ed83-48ec-92e6-9939c55429df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:20.796144 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8475b-ed83-48ec-92e6-9939c55429df admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:20.801754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0ba66-1e38-4ed3-8ef1-b2e8e2823005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:20.803107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0ba66-1e38-4ed3-8ef1-b2e8e2823005 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:20.803401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0ba66-1e38-4ed3-8ef1-b2e8e2823005 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:20.803684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0ba66-1e38-4ed3-8ef1-b2e8e2823005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:20.874750 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0ba66-1e38-4ed3-8ef1-b2e8e2823005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:20.876792 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0ba66-1e38-4ed3-8ef1-b2e8e2823005 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:20.887031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 960/1900] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:20 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:20.948944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6834a-36e0-4c3e-b0fe-f9a95d89aef2 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:20.950665 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-88c6834a-36e0-4c3e-b0fe-f9a95d89aef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:21.051900 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6834a-36e0-4c3e-b0fe-f9a95d89aef2 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:21.122537 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9584eaa-2bb4-4e37-96eb-086174a362be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:21.123402 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9584eaa-2bb4-4e37-96eb-086174a362be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:21.123685 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9584eaa-2bb4-4e37-96eb-086174a362be admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:21.125248 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9584eaa-2bb4-4e37-96eb-086174a362be admin admin] PATH_INFO: `/v3/projects/bfb1a96bc2154de787f2d217b2ac27f7` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:21.125248 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9584eaa-2bb4-4e37-96eb-086174a362be admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb1a96bc2154de787f2d217b2ac27f7)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:21.127934 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9584eaa-2bb4-4e37-96eb-086174a362be admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:21.169732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0ba66-1e38-4ed3-8ef1-b2e8e2823005 service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:21.171191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-64b0ba66-1e38-4ed3-8ef1-b2e8e2823005 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:21.191006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0ba66-1e38-4ed3-8ef1-b2e8e2823005 service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:21.193940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:21.196623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:21.196623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:21.196623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] PATH_INFO: `/v3/projects/6eaa0f49a23245a28a9042806c587a38` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:21.197226 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eaa0f49a23245a28a9042806c587a38)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:21.198748 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:21.261123 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e9584eaa-2bb4-4e37-96eb-086174a362be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb1a96bc2154de787f2d217b2ac27f7', 'request_id': 'req-e9584eaa-2bb4-4e37-96eb-086174a362be'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.318086 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eaa0f49a23245a28a9042806c587a38', 'request_id': 'req-15db724c-f243-4944-baf4-6240bf451b8d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.322065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e9584eaa-2bb4-4e37-96eb-086174a362be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb1a96bc2154de787f2d217b2ac27f7', 'request_id': 'req-e9584eaa-2bb4-4e37-96eb-086174a362be'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.330137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e9584eaa-2bb4-4e37-96eb-086174a362be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb1a96bc2154de787f2d217b2ac27f7', 'request_id': 'req-e9584eaa-2bb4-4e37-96eb-086174a362be'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.343392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e9584eaa-2bb4-4e37-96eb-086174a362be admin admin] The token cache is being invalidate because project bfb1a96bc2154de787f2d217b2ac27f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:21.343701 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e9584eaa-2bb4-4e37-96eb-086174a362be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.344432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e9584eaa-2bb4-4e37-96eb-086174a362be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.346332 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 941/1901] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:20 2021] DELETE /identity/v3/projects/bfb1a96bc2154de787f2d217b2ac27f7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:21.352100 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47a50-d153-49f8-89cf-34c473896f12 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:21.352390 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47a50-d153-49f8-89cf-34c473896f12 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:21.352675 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47a50-d153-49f8-89cf-34c473896f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:21.373497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-39b47a50-d153-49f8-89cf-34c473896f12 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:21.378136 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-39b47a50-d153-49f8-89cf-34c473896f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:21.405457 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eaa0f49a23245a28a9042806c587a38', 'request_id': 'req-15db724c-f243-4944-baf4-6240bf451b8d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.420444 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eaa0f49a23245a28a9042806c587a38', 'request_id': 'req-15db724c-f243-4944-baf4-6240bf451b8d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.426622 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] The token cache is being invalidate because project 6eaa0f49a23245a28a9042806c587a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:21.427018 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.427876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.429686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 961/1902] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:21 2021] DELETE /identity/v3/projects/6eaa0f49a23245a28a9042806c587a38 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:21.436131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:21.437617 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:21.450052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 942/1903] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:21.459797 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6657a-64d0-49bc-992c-7aabadef2d8e None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:21.460324 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6657a-64d0-49bc-992c-7aabadef2d8e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:21.460922 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6657a-64d0-49bc-992c-7aabadef2d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:21.484205 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-22d6657a-64d0-49bc-992c-7aabadef2d8e None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:21.487116 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-22d6657a-64d0-49bc-992c-7aabadef2d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:21.497108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 943/1904] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:21.501671 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6657a-64d0-49bc-992c-7aabadef2d8e None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:21.511927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6657a-64d0-49bc-992c-7aabadef2d8e None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:21.517267 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60231617-754d-4743-9a23-2cba40f466d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:21.517980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60231617-754d-4743-9a23-2cba40f466d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:21.518261 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60231617-754d-4743-9a23-2cba40f466d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:21.518541 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60231617-754d-4743-9a23-2cba40f466d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:21.519283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60231617-754d-4743-9a23-2cba40f466d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:30:21.519593 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60231617-754d-4743-9a23-2cba40f466d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:21.521273 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60231617-754d-4743-9a23-2cba40f466d3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:21.526951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db724c-f243-4944-baf4-6240bf451b8d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:21.526951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e82f3-7a9e-4443-a1cb-7fdea52ef94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:21.527567 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e82f3-7a9e-4443-a1cb-7fdea52ef94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:21.527899 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e82f3-7a9e-4443-a1cb-7fdea52ef94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:21.528181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e82f3-7a9e-4443-a1cb-7fdea52ef94e admin admin] PATH_INFO: `/v3/users/ed25c35d01b04d3b8ef4cf61de5d2a60` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:21.529468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e82f3-7a9e-4443-a1cb-7fdea52ef94e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed25c35d01b04d3b8ef4cf61de5d2a60)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:21.531323 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e82f3-7a9e-4443-a1cb-7fdea52ef94e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:21.534326 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 944/1905] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:30:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:30:21.538602 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60231617-754d-4743-9a23-2cba40f466d3 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:21.548492 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60231617-754d-4743-9a23-2cba40f466d3 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:21.553627 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed2970-8c88-45ee-a9d5-a57765a6c448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:21.554271 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed2970-8c88-45ee-a9d5-a57765a6c448 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:21.554733 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed2970-8c88-45ee-a9d5-a57765a6c448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:21.555022 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed2970-8c88-45ee-a9d5-a57765a6c448 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:21.555758 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed2970-8c88-45ee-a9d5-a57765a6c448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:21.557649 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed2970-8c88-45ee-a9d5-a57765a6c448 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:21.689890 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 945/1906] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:21 2021] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:21.690738 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed2970-8c88-45ee-a9d5-a57765a6c448 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:21.692528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-1bed2970-8c88-45ee-a9d5-a57765a6c448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:21.746408 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-4d5e82f3-7a9e-4443-a1cb-7fdea52ef94e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed25c35d01b04d3b8ef4cf61de5d2a60'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.747141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-4d5e82f3-7a9e-4443-a1cb-7fdea52ef94e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed25c35d01b04d3b8ef4cf61de5d2a60'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.755651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed2970-8c88-45ee-a9d5-a57765a6c448 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:21.759896 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-4d5e82f3-7a9e-4443-a1cb-7fdea52ef94e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed25c35d01b04d3b8ef4cf61de5d2a60'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.760645 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8cef9-128d-4978-9e59-f2d5899c5b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:21.761501 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8cef9-128d-4978-9e59-f2d5899c5b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:21.761773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8cef9-128d-4978-9e59-f2d5899c5b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:21.762040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8cef9-128d-4978-9e59-f2d5899c5b25 admin admin] PATH_INFO: `/v3/users/f9e8bb10038b468da1e971df3a8c1429` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:21.763236 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8cef9-128d-4978-9e59-f2d5899c5b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e8bb10038b468da1e971df3a8c1429)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:21.765149 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8cef9-128d-4978-9e59-f2d5899c5b25 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:21.767321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-4d5e82f3-7a9e-4443-a1cb-7fdea52ef94e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed25c35d01b04d3b8ef4cf61de5d2a60'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.870780 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-4d5e82f3-7a9e-4443-a1cb-7fdea52ef94e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed25c35d01b04d3b8ef4cf61de5d2a60'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:21.877927 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 962/1907] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:21 2021] DELETE /identity/v3/users/ed25c35d01b04d3b8ef4cf61de5d2a60 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:21.880347 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e82f3-7a9e-4443-a1cb-7fdea52ef94e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:21.881761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4d5e82f3-7a9e-4443-a1cb-7fdea52ef94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:21.945156 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e82f3-7a9e-4443-a1cb-7fdea52ef94e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:21.950256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cee50-b981-433c-830c-b583a32cb6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:21.951045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cee50-b981-433c-830c-b583a32cb6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:21.951339 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cee50-b981-433c-830c-b583a32cb6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:21.951614 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cee50-b981-433c-830c-b583a32cb6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:21.952357 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cee50-b981-433c-830c-b583a32cb6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:21.955002 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cee50-b981-433c-830c-b583a32cb6b8 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:22.027789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-11b8cef9-128d-4978-9e59-f2d5899c5b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e8bb10038b468da1e971df3a8c1429'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:22.034931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-11b8cef9-128d-4978-9e59-f2d5899c5b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e8bb10038b468da1e971df3a8c1429'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:22.035620 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-11b8cef9-128d-4978-9e59-f2d5899c5b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e8bb10038b468da1e971df3a8c1429'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:22.048517 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-11b8cef9-128d-4978-9e59-f2d5899c5b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e8bb10038b468da1e971df3a8c1429'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:22.054146 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 963/1908] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:21 2021] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:22.056077 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cee50-b981-433c-830c-b583a32cb6b8 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:22.058346 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-584cee50-b981-433c-830c-b583a32cb6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:22.075073 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cee50-b981-433c-830c-b583a32cb6b8 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:22.082600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fda715-0b67-48df-98e1-23eeb33903a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:22.088365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fda715-0b67-48df-98e1-23eeb33903a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:22.088365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fda715-0b67-48df-98e1-23eeb33903a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:22.088365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fda715-0b67-48df-98e1-23eeb33903a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:22.088365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fda715-0b67-48df-98e1-23eeb33903a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:22.088365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fda715-0b67-48df-98e1-23eeb33903a9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:22.102866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 964/1909] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:22 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:22.105032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fda715-0b67-48df-98e1-23eeb33903a9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:22.125049 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fda715-0b67-48df-98e1-23eeb33903a9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:22.132235 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd6b2-f54f-4116-acba-6c115cbf578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:22.133169 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd6b2-f54f-4116-acba-6c115cbf578c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:22.134145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd6b2-f54f-4116-acba-6c115cbf578c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:22.134607 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd6b2-f54f-4116-acba-6c115cbf578c admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:22.135640 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddd6b2-f54f-4116-acba-6c115cbf578c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:22.137952 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddd6b2-f54f-4116-acba-6c115cbf578c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:22.154236 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 965/1910] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:22 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:22.155557 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd6b2-f54f-4116-acba-6c115cbf578c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:22.162630 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-11b8cef9-128d-4978-9e59-f2d5899c5b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e8bb10038b468da1e971df3a8c1429'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:22.169803 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 946/1911] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:21 2021] DELETE /identity/v3/users/f9e8bb10038b468da1e971df3a8c1429 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:22.176235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c306c-0aa3-44e9-9e26-fb0c1ee21be0 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:22.176939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c306c-0aa3-44e9-9e26-fb0c1ee21be0 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:22.177660 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c306c-0aa3-44e9-9e26-fb0c1ee21be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:22.187294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd6b2-f54f-4116-acba-6c115cbf578c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:22.300252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-e97c306c-0aa3-44e9-9e26-fb0c1ee21be0 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:22.300399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e97c306c-0aa3-44e9-9e26-fb0c1ee21be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:22.312106 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43046150-fc55-410d-b2e0-79d11a984dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:22.313149 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046150-fc55-410d-b2e0-79d11a984dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:22.314102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046150-fc55-410d-b2e0-79d11a984dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:22.314445 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046150-fc55-410d-b2e0-79d11a984dbe admin admin] PATH_INFO: `/v3/projects/4b4c333979eb49cda657811b8b5c30ab/users/c84a78058e444a899b2c24ecf59f3adc/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:22.330771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43046150-fc55-410d-b2e0-79d11a984dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4c333979eb49cda657811b8b5c30ab, user_id=c84a78058e444a899b2c24ecf59f3adc, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:22.333581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43046150-fc55-410d-b2e0-79d11a984dbe admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:22.374465 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 947/1912] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:22.398217 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c306c-0aa3-44e9-9e26-fb0c1ee21be0 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:22.400850 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e97c306c-0aa3-44e9-9e26-fb0c1ee21be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:22.432580 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 966/1913] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:22 2021] PUT /identity/v3/projects/4b4c333979eb49cda657811b8b5c30ab/users/c84a78058e444a899b2c24ecf59f3adc/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:22.466487 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c306c-0aa3-44e9-9e26-fb0c1ee21be0 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:22.485374 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dc573-4afd-4ac9-ba6f-908bb1260594 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:22.486409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dc573-4afd-4ac9-ba6f-908bb1260594 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:22.486945 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dc573-4afd-4ac9-ba6f-908bb1260594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:22.515764 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-0f6dc573-4afd-4ac9-ba6f-908bb1260594 None None] MFA Rules not processed for user `c84a78058e444a899b2c24ecf59f3adc`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:22.518613 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0f6dc573-4afd-4ac9-ba6f-908bb1260594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:22.540327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f8de-9e3f-4aee-91f2-1c3ae7b30877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:22.541289 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f8de-9e3f-4aee-91f2-1c3ae7b30877 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:22.541651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f8de-9e3f-4aee-91f2-1c3ae7b30877 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:22.541839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f8de-9e3f-4aee-91f2-1c3ae7b30877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:22.595196 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 967/1914] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:22 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:22.595881 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6dc573-4afd-4ac9-ba6f-908bb1260594 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:22.597209 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0f6dc573-4afd-4ac9-ba6f-908bb1260594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:22.614163 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190f8de-9e3f-4aee-91f2-1c3ae7b30877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:22.621446 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190f8de-9e3f-4aee-91f2-1c3ae7b30877 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:22.626586 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 948/1915] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:22.627313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f8de-9e3f-4aee-91f2-1c3ae7b30877 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:22.637213 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f8de-9e3f-4aee-91f2-1c3ae7b30877 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:22.643417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbd150-9b03-41f1-84a2-95bb45b25fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:22.644381 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbd150-9b03-41f1-84a2-95bb45b25fef admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:22.644661 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbd150-9b03-41f1-84a2-95bb45b25fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:22.644926 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbd150-9b03-41f1-84a2-95bb45b25fef admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:22.645622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbd150-9b03-41f1-84a2-95bb45b25fef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:22.647582 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbd150-9b03-41f1-84a2-95bb45b25fef admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:22.665029 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6dc573-4afd-4ac9-ba6f-908bb1260594 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:22.670223 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69beb5-741d-4513-b77e-28996fff698a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:22.675684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69beb5-741d-4513-b77e-28996fff698a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:22.675684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69beb5-741d-4513-b77e-28996fff698a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:22.675684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69beb5-741d-4513-b77e-28996fff698a admin admin] PATH_INFO: `/v3/projects/862258d318744fc19ff0e75f242485b9` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:22.675684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69beb5-741d-4513-b77e-28996fff698a admin admin] RBAC: Authorizing `identity:delete_project(project_id=862258d318744fc19ff0e75f242485b9)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:22.675684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69beb5-741d-4513-b77e-28996fff698a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:22.758722 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 949/1916] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:22 2021] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:22.762587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbd150-9b03-41f1-84a2-95bb45b25fef admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:22.790552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3a69beb5-741d-4513-b77e-28996fff698a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '862258d318744fc19ff0e75f242485b9', 'request_id': 'req-3a69beb5-741d-4513-b77e-28996fff698a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:22.822282 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbd150-9b03-41f1-84a2-95bb45b25fef admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:22.854202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3a69beb5-741d-4513-b77e-28996fff698a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '862258d318744fc19ff0e75f242485b9', 'request_id': 'req-3a69beb5-741d-4513-b77e-28996fff698a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:22.861898 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3a69beb5-741d-4513-b77e-28996fff698a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '862258d318744fc19ff0e75f242485b9', 'request_id': 'req-3a69beb5-741d-4513-b77e-28996fff698a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:22.881813 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23278a96-c960-4965-ac54-f3bfd0595bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:22.882499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23278a96-c960-4965-ac54-f3bfd0595bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:22.882781 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23278a96-c960-4965-ac54-f3bfd0595bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:22.883054 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23278a96-c960-4965-ac54-f3bfd0595bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:22.883789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23278a96-c960-4965-ac54-f3bfd0595bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:22.885695 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23278a96-c960-4965-ac54-f3bfd0595bb5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:22.886918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3a69beb5-741d-4513-b77e-28996fff698a admin admin] The token cache is being invalidate because project 862258d318744fc19ff0e75f242485b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:22.887375 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3a69beb5-741d-4513-b77e-28996fff698a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:22.888358 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3a69beb5-741d-4513-b77e-28996fff698a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:22.891452 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 968/1917] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:22 2021] DELETE /identity/v3/projects/862258d318744fc19ff0e75f242485b9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:22.897732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685e867-2a3d-423a-8617-b725804596f3 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:22.898346 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685e867-2a3d-423a-8617-b725804596f3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:22.898914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685e867-2a3d-423a-8617-b725804596f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:22.925178 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-2685e867-2a3d-423a-8617-b725804596f3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:22.926567 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-2685e867-2a3d-423a-8617-b725804596f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:22.934796 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 969/1918] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:22.943296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6795c-e539-4d05-a9a9-8e75e979a93f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:22.943760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6795c-e539-4d05-a9a9-8e75e979a93f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:22.944710 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6795c-e539-4d05-a9a9-8e75e979a93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:22.963453 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d8f6795c-e539-4d05-a9a9-8e75e979a93f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:22.964834 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d8f6795c-e539-4d05-a9a9-8e75e979a93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:22.974225 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 970/1919] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:22.978296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 950/1920] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:22 2021] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:22.980852 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6795c-e539-4d05-a9a9-8e75e979a93f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:22.980979 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23278a96-c960-4965-ac54-f3bfd0595bb5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:22.981246 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-23278a96-c960-4965-ac54-f3bfd0595bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:22.988570 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6795c-e539-4d05-a9a9-8e75e979a93f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:22.993320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71fe07-6fe8-4875-80ac-f7a85ebe7a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:22.993982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71fe07-6fe8-4875-80ac-f7a85ebe7a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:22.994230 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23278a96-c960-4965-ac54-f3bfd0595bb5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:22.994395 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71fe07-6fe8-4875-80ac-f7a85ebe7a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:22.994686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71fe07-6fe8-4875-80ac-f7a85ebe7a35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:22.996328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71fe07-6fe8-4875-80ac-f7a85ebe7a35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:30:22.996640 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71fe07-6fe8-4875-80ac-f7a85ebe7a35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:22.998235 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71fe07-6fe8-4875-80ac-f7a85ebe7a35 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:23.001501 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dbd87-a670-4ba9-8426-5190276af8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:23.001972 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dbd87-a670-4ba9-8426-5190276af8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:23.002249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dbd87-a670-4ba9-8426-5190276af8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:23.002517 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dbd87-a670-4ba9-8426-5190276af8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:23.003253 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dbd87-a670-4ba9-8426-5190276af8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:23.004852 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dbd87-a670-4ba9-8426-5190276af8b7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:23.011444 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 971/1921] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:30:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:30:23.015520 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71fe07-6fe8-4875-80ac-f7a85ebe7a35 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:23.018953 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 951/1922] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:22 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:23.020021 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dbd87-a670-4ba9-8426-5190276af8b7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:23.026173 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71fe07-6fe8-4875-80ac-f7a85ebe7a35 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:23.029803 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dbd87-a670-4ba9-8426-5190276af8b7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:23.031376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9e36f-7c4a-4b5d-b52b-58c450119d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:23.032101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9e36f-7c4a-4b5d-b52b-58c450119d28 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:23.032385 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9e36f-7c4a-4b5d-b52b-58c450119d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:23.032764 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9e36f-7c4a-4b5d-b52b-58c450119d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:23.033569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9e36f-7c4a-4b5d-b52b-58c450119d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:23.035331 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ff15d-5996-40ae-8f71-06d47694057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:23.035663 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9e36f-7c4a-4b5d-b52b-58c450119d28 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:23.035996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ff15d-5996-40ae-8f71-06d47694057d admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:23.036343 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ff15d-5996-40ae-8f71-06d47694057d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:23.036679 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ff15d-5996-40ae-8f71-06d47694057d admin admin] PATH_INFO: `/v3/projects/1b5421545ddb49628cb6a780ccd05de0/users/3a54938187484eff97c0f5de0964b73c/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:23.052020 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ff15d-5996-40ae-8f71-06d47694057d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5421545ddb49628cb6a780ccd05de0, user_id=3a54938187484eff97c0f5de0964b73c, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:23.055589 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ff15d-5996-40ae-8f71-06d47694057d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:23.141127 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 972/1923] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:23 2021] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:23.142154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9e36f-7c4a-4b5d-b52b-58c450119d28 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:23.143606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-01d9e36f-7c4a-4b5d-b52b-58c450119d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:23.206363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9e36f-7c4a-4b5d-b52b-58c450119d28 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:23.211223 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:23.212165 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:23.212437 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:23.212702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] PATH_INFO: `/v3/projects/17479b0427e04e77ad83272738369a54` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:23.213901 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=17479b0427e04e77ad83272738369a54)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:23.215846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:23.231196 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 952/1924] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:23 2021] PUT /identity/v3/projects/1b5421545ddb49628cb6a780ccd05de0/users/3a54938187484eff97c0f5de0964b73c/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:23.231815 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ff15d-5996-40ae-8f71-06d47694057d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:23.295047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ff15d-5996-40ae-8f71-06d47694057d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:23.300628 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4716c-67a4-437c-8bf5-37101386c9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:23.301292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4716c-67a4-437c-8bf5-37101386c9df admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:23.301565 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4716c-67a4-437c-8bf5-37101386c9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:23.301832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4716c-67a4-437c-8bf5-37101386c9df admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:23.302530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4716c-67a4-437c-8bf5-37101386c9df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:23.304531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4716c-67a4-437c-8bf5-37101386c9df admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:23.363782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17479b0427e04e77ad83272738369a54', 'request_id': 'req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:23.445478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 953/1925] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:23 2021] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:23.445478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4716c-67a4-437c-8bf5-37101386c9df admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:23.453915 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4716c-67a4-437c-8bf5-37101386c9df admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:23.519429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189b3cc-e59b-4ce9-9393-3b6d0da51b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:23.521583 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189b3cc-e59b-4ce9-9393-3b6d0da51b1d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:23.522417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189b3cc-e59b-4ce9-9393-3b6d0da51b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:23.522636 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17479b0427e04e77ad83272738369a54', 'request_id': 'req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:23.522996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189b3cc-e59b-4ce9-9393-3b6d0da51b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:23.523930 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189b3cc-e59b-4ce9-9393-3b6d0da51b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:23.528072 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189b3cc-e59b-4ce9-9393-3b6d0da51b1d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:23.529665 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17479b0427e04e77ad83272738369a54', 'request_id': 'req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:23.547311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] The token cache is being invalidate because project 17479b0427e04e77ad83272738369a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:23.548546 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:23.550835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 954/1926] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:23 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:23.551014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:23.551115 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189b3cc-e59b-4ce9-9393-3b6d0da51b1d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:23.552599 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 973/1927] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:23 2021] DELETE /identity/v3/projects/17479b0427e04e77ad83272738369a54 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:23.556434 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:23.562222 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2189b3cc-e59b-4ce9-9393-3b6d0da51b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:23.562357 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:23.574832 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd4b42-a2e1-4945-a483-2d0500cea7bf admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:23.575063 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189b3cc-e59b-4ce9-9393-3b6d0da51b1d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:23.580906 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf57bd-725c-49b8-af3d-34fb3d5439f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:23.581505 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896fe54-f908-4863-8f4d-cf1a4607c476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:23.581667 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf57bd-725c-49b8-af3d-34fb3d5439f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:23.581893 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf57bd-725c-49b8-af3d-34fb3d5439f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:23.582161 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf57bd-725c-49b8-af3d-34fb3d5439f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:23.582400 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896fe54-f908-4863-8f4d-cf1a4607c476 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:23.582679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896fe54-f908-4863-8f4d-cf1a4607c476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:23.582948 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896fe54-f908-4863-8f4d-cf1a4607c476 admin admin] PATH_INFO: `/v3/projects/1b5421545ddb49628cb6a780ccd05de0/users/3a54938187484eff97c0f5de0964b73c/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:23.583055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf57bd-725c-49b8-af3d-34fb3d5439f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:23.584689 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf57bd-725c-49b8-af3d-34fb3d5439f0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:23.585024 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896fe54-f908-4863-8f4d-cf1a4607c476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5421545ddb49628cb6a780ccd05de0, user_id=3a54938187484eff97c0f5de0964b73c, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:23.588711 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896fe54-f908-4863-8f4d-cf1a4607c476 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:23.600930 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 974/1928] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:23 2021] PUT /identity/v3/projects/1b5421545ddb49628cb6a780ccd05de0/users/3a54938187484eff97c0f5de0964b73c/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:23.602004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896fe54-f908-4863-8f4d-cf1a4607c476 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:23.605101 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 955/1929] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:23 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:23.610396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf57bd-725c-49b8-af3d-34fb3d5439f0 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:23.611682 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-5896fe54-f908-4863-8f4d-cf1a4607c476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:23.636410 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf57bd-725c-49b8-af3d-34fb3d5439f0 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:23.711445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5b109-3b90-433c-9072-5e2bab29066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:23.712390 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5b109-3b90-433c-9072-5e2bab29066a admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:23.712670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5b109-3b90-433c-9072-5e2bab29066a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:23.712941 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5b109-3b90-433c-9072-5e2bab29066a admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:23.713709 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5b109-3b90-433c-9072-5e2bab29066a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:23.715553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5b109-3b90-433c-9072-5e2bab29066a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:23.718276 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896fe54-f908-4863-8f4d-cf1a4607c476 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:23.725927 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a41e1-9e18-4726-9a94-66c533d1b33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:23.726938 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 956/1930] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:23 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:23.727623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a41e1-9e18-4726-9a94-66c533d1b33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:23.728155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a41e1-9e18-4726-9a94-66c533d1b33e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:23.728378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269e10-843b-41b5-9afb-6433f0faeb41 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:23.728666 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269e10-843b-41b5-9afb-6433f0faeb41 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:23.728937 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269e10-843b-41b5-9afb-6433f0faeb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:23.729444 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a41e1-9e18-4726-9a94-66c533d1b33e admin admin] PATH_INFO: `/v3/users/c3164c4ec8ef4137afdfdfbe71da3010` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:23.731497 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a41e1-9e18-4726-9a94-66c533d1b33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3164c4ec8ef4137afdfdfbe71da3010)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:23.733733 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a41e1-9e18-4726-9a94-66c533d1b33e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:23.762935 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d9269e10-843b-41b5-9afb-6433f0faeb41 None None] MFA Rules not processed for user `3a54938187484eff97c0f5de0964b73c`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:23.764197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d9269e10-843b-41b5-9afb-6433f0faeb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:23.839747 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 957/1931] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:23 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:23.841376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9269e10-843b-41b5-9afb-6433f0faeb41 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:23.854065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9269e10-843b-41b5-9afb-6433f0faeb41 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:23.859418 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613feafa-05c6-497d-8f19-4407e95c248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:23.860532 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613feafa-05c6-497d-8f19-4407e95c248d admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:23.860963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613feafa-05c6-497d-8f19-4407e95c248d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:23.861243 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613feafa-05c6-497d-8f19-4407e95c248d admin admin] PATH_INFO: `/v3/projects/74788b1739ab4f55a8f166e0748d7eef/users/cc3eb7f733d94a68b7eb6c0ea7aaeb45/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:23.882671 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613feafa-05c6-497d-8f19-4407e95c248d admin admin] RBAC: Authorizing `identity:create_grant(project_id=74788b1739ab4f55a8f166e0748d7eef, user_id=cc3eb7f733d94a68b7eb6c0ea7aaeb45, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:23.885351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613feafa-05c6-497d-8f19-4407e95c248d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:23.953577 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-324a41e1-9e18-4726-9a94-66c533d1b33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3164c4ec8ef4137afdfdfbe71da3010'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:23.954787 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-324a41e1-9e18-4726-9a94-66c533d1b33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3164c4ec8ef4137afdfdfbe71da3010'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:23.972669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-324a41e1-9e18-4726-9a94-66c533d1b33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3164c4ec8ef4137afdfdfbe71da3010'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:23.979541 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-324a41e1-9e18-4726-9a94-66c533d1b33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3164c4ec8ef4137afdfdfbe71da3010'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:23.990893 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 958/1932] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:23 2021] PUT /identity/v3/projects/74788b1739ab4f55a8f166e0748d7eef/users/cc3eb7f733d94a68b7eb6c0ea7aaeb45/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:23.991715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613feafa-05c6-497d-8f19-4407e95c248d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:23.993334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-613feafa-05c6-497d-8f19-4407e95c248d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:24.049705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613feafa-05c6-497d-8f19-4407e95c248d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:24.053382 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994d7e7-80ab-4509-be1e-c1383d5d4e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:24.054021 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994d7e7-80ab-4509-be1e-c1383d5d4e2a service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:24.054293 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994d7e7-80ab-4509-be1e-c1383d5d4e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:24.054561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994d7e7-80ab-4509-be1e-c1383d5d4e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:24.056326 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c994d7e7-80ab-4509-be1e-c1383d5d4e2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:24.110446 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-324a41e1-9e18-4726-9a94-66c533d1b33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3164c4ec8ef4137afdfdfbe71da3010'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:24.116735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 975/1933] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:23 2021] DELETE /identity/v3/users/c3164c4ec8ef4137afdfdfbe71da3010 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:24.118093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552fb8-15df-4aaa-bcae-a3c19def3602 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:24.118215 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994d7e7-80ab-4509-be1e-c1383d5d4e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:24.118390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552fb8-15df-4aaa-bcae-a3c19def3602 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:24.118657 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552fb8-15df-4aaa-bcae-a3c19def3602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:24.119536 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994d7e7-80ab-4509-be1e-c1383d5d4e2a service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:24.131423 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 959/1934] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:23 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:24.149186 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-13552fb8-15df-4aaa-bcae-a3c19def3602 None None] MFA Rules not processed for user `cc3eb7f733d94a68b7eb6c0ea7aaeb45`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:24.150409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-13552fb8-15df-4aaa-bcae-a3c19def3602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:24.217446 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 976/1935] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:24 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:24.229373 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994d7e7-80ab-4509-be1e-c1383d5d4e2a service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:24.230850 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c994d7e7-80ab-4509-be1e-c1383d5d4e2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:24.287900 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994d7e7-80ab-4509-be1e-c1383d5d4e2a service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:24.338091 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8d0f0-8b89-4f2d-b3e5-e8758c2e2027 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0998dd32ba8648cfb7f43797a9266d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:24.346306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8d0f0-8b89-4f2d-b3e5-e8758c2e2027 service glance] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:24.346306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8d0f0-8b89-4f2d-b3e5-e8758c2e2027 service glance] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:24.346306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8d0f0-8b89-4f2d-b3e5-e8758c2e2027 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:24.348049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8d0f0-8b89-4f2d-b3e5-e8758c2e2027 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:24.349515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8d0f0-8b89-4f2d-b3e5-e8758c2e2027 service glance] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:24.359432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 960/1936] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:24 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:24.623104 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13552fb8-15df-4aaa-bcae-a3c19def3602 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:24.623104 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-13552fb8-15df-4aaa-bcae-a3c19def3602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:24.693839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8d0f0-8b89-4f2d-b3e5-e8758c2e2027 service glance] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:24.699780 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-46a8d0f0-8b89-4f2d-b3e5-e8758c2e2027 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:24.750037 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13552fb8-15df-4aaa-bcae-a3c19def3602 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:24.759117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a85ff-9e00-4183-81ea-9d8f020b9d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:24.760277 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a85ff-9e00-4183-81ea-9d8f020b9d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:24.760845 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a85ff-9e00-4183-81ea-9d8f020b9d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:24.761159 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a85ff-9e00-4183-81ea-9d8f020b9d7b admin admin] PATH_INFO: `/v3/users/c84a78058e444a899b2c24ecf59f3adc` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:24.762860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a85ff-9e00-4183-81ea-9d8f020b9d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84a78058e444a899b2c24ecf59f3adc)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:24.765536 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a85ff-9e00-4183-81ea-9d8f020b9d7b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:24.817486 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8d0f0-8b89-4f2d-b3e5-e8758c2e2027 service glance] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:24.822961 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1ba79-8147-49b0-8dd7-fbfa54277151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:24.823916 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ba79-8147-49b0-8dd7-fbfa54277151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:24.824198 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ba79-8147-49b0-8dd7-fbfa54277151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:24.824473 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ba79-8147-49b0-8dd7-fbfa54277151 admin admin] PATH_INFO: `/v3/projects/f90ee19ad8f247aa91ce4466f818bee0` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:24.825928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1ba79-8147-49b0-8dd7-fbfa54277151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90ee19ad8f247aa91ce4466f818bee0)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:24.827874 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1ba79-8147-49b0-8dd7-fbfa54277151 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:25.007499 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-097a85ff-9e00-4183-81ea-9d8f020b9d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84a78058e444a899b2c24ecf59f3adc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:25.008110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-097a85ff-9e00-4183-81ea-9d8f020b9d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84a78058e444a899b2c24ecf59f3adc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:25.010154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e2c1ba79-8147-49b0-8dd7-fbfa54277151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90ee19ad8f247aa91ce4466f818bee0', 'request_id': 'req-e2c1ba79-8147-49b0-8dd7-fbfa54277151'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:25.021328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-097a85ff-9e00-4183-81ea-9d8f020b9d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84a78058e444a899b2c24ecf59f3adc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:25.028232 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-097a85ff-9e00-4183-81ea-9d8f020b9d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84a78058e444a899b2c24ecf59f3adc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:25.082443 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e2c1ba79-8147-49b0-8dd7-fbfa54277151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90ee19ad8f247aa91ce4466f818bee0', 'request_id': 'req-e2c1ba79-8147-49b0-8dd7-fbfa54277151'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:25.088369 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e2c1ba79-8147-49b0-8dd7-fbfa54277151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90ee19ad8f247aa91ce4466f818bee0', 'request_id': 'req-e2c1ba79-8147-49b0-8dd7-fbfa54277151'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:25.101720 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e2c1ba79-8147-49b0-8dd7-fbfa54277151 admin admin] The token cache is being invalidate because project f90ee19ad8f247aa91ce4466f818bee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:25.101943 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e2c1ba79-8147-49b0-8dd7-fbfa54277151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:25.102533 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e2c1ba79-8147-49b0-8dd7-fbfa54277151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:25.105281 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 961/1937] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:24 2021] DELETE /identity/v3/projects/f90ee19ad8f247aa91ce4466f818bee0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:25.112018 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e120fe5-afe2-463f-925a-1c34ccfaf685 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:25.112300 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e120fe5-afe2-463f-925a-1c34ccfaf685 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:25.112575 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e120fe5-afe2-463f-925a-1c34ccfaf685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:25.132001 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-1e120fe5-afe2-463f-925a-1c34ccfaf685 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:25.133223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-1e120fe5-afe2-463f-925a-1c34ccfaf685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:25.168170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-097a85ff-9e00-4183-81ea-9d8f020b9d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84a78058e444a899b2c24ecf59f3adc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:25.179997 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 977/1938] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:24 2021] DELETE /identity/v3/users/c84a78058e444a899b2c24ecf59f3adc => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:25.181737 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ff9f-8e03-4a9e-be8b-031b7cbf8a91 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:25.182299 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ff9f-8e03-4a9e-be8b-031b7cbf8a91 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:25.182671 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ff9f-8e03-4a9e-be8b-031b7cbf8a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:25.200243 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 962/1939] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:25.202199 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-c688ff9f-8e03-4a9e-be8b-031b7cbf8a91 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:25.203521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c688ff9f-8e03-4a9e-be8b-031b7cbf8a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:25.210853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cdb94-3e82-4d04-973e-dbb669865244 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:25.211139 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cdb94-3e82-4d04-973e-dbb669865244 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:25.211446 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cdb94-3e82-4d04-973e-dbb669865244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:25.231490 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-a65cdb94-3e82-4d04-973e-dbb669865244 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:25.233231 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a65cdb94-3e82-4d04-973e-dbb669865244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:25.270593 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 978/1940] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:25.281007 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688ff9f-8e03-4a9e-be8b-031b7cbf8a91 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:25.282930 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c688ff9f-8e03-4a9e-be8b-031b7cbf8a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:25.305002 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 963/1941] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:25.306385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cdb94-3e82-4d04-973e-dbb669865244 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:25.323038 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cdb94-3e82-4d04-973e-dbb669865244 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:25.331891 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2c1ef-bfe7-4e0f-8a79-823541b31682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:25.332823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2c1ef-bfe7-4e0f-8a79-823541b31682 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:25.333098 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2c1ef-bfe7-4e0f-8a79-823541b31682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:25.333364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2c1ef-bfe7-4e0f-8a79-823541b31682 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:25.334138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2c1ef-bfe7-4e0f-8a79-823541b31682 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:30:25.334441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2c1ef-bfe7-4e0f-8a79-823541b31682 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:25.336107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2c1ef-bfe7-4e0f-8a79-823541b31682 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:25.358800 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 964/1942] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:30:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:30:25.358800 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2c1ef-bfe7-4e0f-8a79-823541b31682 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:25.373413 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2c1ef-bfe7-4e0f-8a79-823541b31682 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:25.379944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dc4ba-dcb4-44b4-b937-6b1d9cf6f0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:25.380606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dc4ba-dcb4-44b4-b937-6b1d9cf6f0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:25.380983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dc4ba-dcb4-44b4-b937-6b1d9cf6f0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:25.381174 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dc4ba-dcb4-44b4-b937-6b1d9cf6f0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:25.381374 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688ff9f-8e03-4a9e-be8b-031b7cbf8a91 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:25.382027 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dc4ba-dcb4-44b4-b937-6b1d9cf6f0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:25.383967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dc4ba-dcb4-44b4-b937-6b1d9cf6f0f2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:25.385491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb08b1-fa0e-4a8b-9e1f-214bc33dbb2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:25.386141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb08b1-fa0e-4a8b-9e1f-214bc33dbb2c service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:25.388251 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb08b1-fa0e-4a8b-9e1f-214bc33dbb2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:25.388251 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb08b1-fa0e-4a8b-9e1f-214bc33dbb2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:25.397486 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb08b1-fa0e-4a8b-9e1f-214bc33dbb2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:25.398929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb08b1-fa0e-4a8b-9e1f-214bc33dbb2c service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:25.409016 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 979/1943] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:30:25.558093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 965/1944] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:25 2021] POST /identity/v3/projects => generated 367 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:25.562360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb08b1-fa0e-4a8b-9e1f-214bc33dbb2c service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:25.572455 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb08b1-fa0e-4a8b-9e1f-214bc33dbb2c service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:25.632851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07005582-60b7-4809-b36b-5f17aeccc2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:25.633525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07005582-60b7-4809-b36b-5f17aeccc2dd admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:25.633910 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07005582-60b7-4809-b36b-5f17aeccc2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:25.634214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07005582-60b7-4809-b36b-5f17aeccc2dd admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:25.634955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07005582-60b7-4809-b36b-5f17aeccc2dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:25.636891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07005582-60b7-4809-b36b-5f17aeccc2dd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:25.771708 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 980/1945] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:25 2021] POST /identity/v3/users => generated 284 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:25.775080 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dc4ba-dcb4-44b4-b937-6b1d9cf6f0f2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:25.785541 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dc4ba-dcb4-44b4-b937-6b1d9cf6f0f2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:25.790193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df5d6f-6352-4343-8774-4fd501790530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:25.790852 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df5d6f-6352-4343-8774-4fd501790530 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:25.791155 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df5d6f-6352-4343-8774-4fd501790530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:25.791448 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df5d6f-6352-4343-8774-4fd501790530 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:25.792207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df5d6f-6352-4343-8774-4fd501790530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:25.793776 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df5d6f-6352-4343-8774-4fd501790530 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:25.804047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 966/1946] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:25.816930 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07005582-60b7-4809-b36b-5f17aeccc2dd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:25.832893 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07005582-60b7-4809-b36b-5f17aeccc2dd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:25.834196 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df5d6f-6352-4343-8774-4fd501790530 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:25.837345 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a8df5d6f-6352-4343-8774-4fd501790530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:25.843435 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb76a75-7bb1-4a4a-abb5-e2bf1562bbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:25.843435 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb76a75-7bb1-4a4a-abb5-e2bf1562bbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:25.843435 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb76a75-7bb1-4a4a-abb5-e2bf1562bbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:25.843435 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb76a75-7bb1-4a4a-abb5-e2bf1562bbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:25.844131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb76a75-7bb1-4a4a-abb5-e2bf1562bbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:25.844131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb76a75-7bb1-4a4a-abb5-e2bf1562bbd9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:25.862377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 981/1947] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:25 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:25.862481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df5d6f-6352-4343-8774-4fd501790530 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:25.866475 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb76a75-7bb1-4a4a-abb5-e2bf1562bbd9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:25.876254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:25.880960 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb76a75-7bb1-4a4a-abb5-e2bf1562bbd9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:25.884545 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:25.884837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:25.885122 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] PATH_INFO: `/v3/projects/4b4c333979eb49cda657811b8b5c30ab` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:25.886627 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b4c333979eb49cda657811b8b5c30ab)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:25.888613 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:25.894819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a29034-1318-4d5e-a105-33f67be3b464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:25.896630 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a29034-1318-4d5e-a105-33f67be3b464 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:25.897437 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a29034-1318-4d5e-a105-33f67be3b464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:25.899463 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a29034-1318-4d5e-a105-33f67be3b464 admin admin] PATH_INFO: `/v3/projects/7d965da403bd4831a7a60e8e9b09e183/users/f818b20f666e4bbfbf1329e03ea88d65/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:25.917045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a29034-1318-4d5e-a105-33f67be3b464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d965da403bd4831a7a60e8e9b09e183, user_id=f818b20f666e4bbfbf1329e03ea88d65, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:25.920300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a29034-1318-4d5e-a105-33f67be3b464 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:26.051101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 982/1948] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:25 2021] PUT /identity/v3/projects/7d965da403bd4831a7a60e8e9b09e183/users/f818b20f666e4bbfbf1329e03ea88d65/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:26.053160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc64e-6184-44bd-9af8-c608c3d5a7a8 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:26.053283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4c333979eb49cda657811b8b5c30ab', 'request_id': 'req-2ad4c4dc-547c-4c03-93b6-90f8281997d5'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:26.053587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc64e-6184-44bd-9af8-c608c3d5a7a8 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:26.053929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc64e-6184-44bd-9af8-c608c3d5a7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:26.090337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-e3cdc64e-6184-44bd-9af8-c608c3d5a7a8 None None] MFA Rules not processed for user `f818b20f666e4bbfbf1329e03ea88d65`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:26.091602 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e3cdc64e-6184-44bd-9af8-c608c3d5a7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:26.162268 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4c333979eb49cda657811b8b5c30ab', 'request_id': 'req-2ad4c4dc-547c-4c03-93b6-90f8281997d5'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:26.171315 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4c333979eb49cda657811b8b5c30ab', 'request_id': 'req-2ad4c4dc-547c-4c03-93b6-90f8281997d5'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:26.195696 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] The token cache is being invalidate because project 4b4c333979eb49cda657811b8b5c30ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:26.196092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:26.198189 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:26.201969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 967/1949] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:25 2021] DELETE /identity/v3/projects/4b4c333979eb49cda657811b8b5c30ab => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:26.206630 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:26.209770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:26.232997 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 983/1950] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:26 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:26.238323 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdc64e-6184-44bd-9af8-c608c3d5a7a8 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:26.309810 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4c4dc-547c-4c03-93b6-90f8281997d5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:26.314737 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd8fab-8d65-4847-a2ba-c0019b4ce8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:26.315604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd8fab-8d65-4847-a2ba-c0019b4ce8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:26.315931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd8fab-8d65-4847-a2ba-c0019b4ce8be admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:26.316207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd8fab-8d65-4847-a2ba-c0019b4ce8be admin admin] PATH_INFO: `/v3/users/3a54938187484eff97c0f5de0964b73c` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:26.317427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd8fab-8d65-4847-a2ba-c0019b4ce8be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a54938187484eff97c0f5de0964b73c)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:26.319289 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdc64e-6184-44bd-9af8-c608c3d5a7a8 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:26.319458 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd8fab-8d65-4847-a2ba-c0019b4ce8be admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:26.324124 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c3883-3e33-4aaf-aa6c-f282fa92452f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:26.325044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c3883-3e33-4aaf-aa6c-f282fa92452f admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:26.325305 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c3883-3e33-4aaf-aa6c-f282fa92452f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:26.325571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c3883-3e33-4aaf-aa6c-f282fa92452f admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:26.326350 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c3883-3e33-4aaf-aa6c-f282fa92452f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:26.328243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c3883-3e33-4aaf-aa6c-f282fa92452f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:26.460666 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 984/1951] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:26 2021] POST /identity/v3/projects => generated 367 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:26.464613 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c3883-3e33-4aaf-aa6c-f282fa92452f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:26.466218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-f78c3883-3e33-4aaf-aa6c-f282fa92452f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:26.529914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c3883-3e33-4aaf-aa6c-f282fa92452f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:26.535279 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9121ca-f243-40bc-bb17-40f586a79c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:26.535979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9121ca-f243-40bc-bb17-40f586a79c20 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:26.536262 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9121ca-f243-40bc-bb17-40f586a79c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:26.536562 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9121ca-f243-40bc-bb17-40f586a79c20 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:26.537258 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9121ca-f243-40bc-bb17-40f586a79c20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:26.539250 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9121ca-f243-40bc-bb17-40f586a79c20 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:26.656028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e3dd8fab-8d65-4847-a2ba-c0019b4ce8be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a54938187484eff97c0f5de0964b73c'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:26.663898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e3dd8fab-8d65-4847-a2ba-c0019b4ce8be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a54938187484eff97c0f5de0964b73c'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:26.664568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e3dd8fab-8d65-4847-a2ba-c0019b4ce8be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a54938187484eff97c0f5de0964b73c'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:26.674124 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 985/1952] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:26 2021] POST /identity/v3/users => generated 290 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:26.675272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9121ca-f243-40bc-bb17-40f586a79c20 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:26.676944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-5e9121ca-f243-40bc-bb17-40f586a79c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:26.677285 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e3dd8fab-8d65-4847-a2ba-c0019b4ce8be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a54938187484eff97c0f5de0964b73c'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:26.690266 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9121ca-f243-40bc-bb17-40f586a79c20 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:26.697656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115804d0-c959-4ea8-9ec5-e0f53aafe9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:26.698344 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115804d0-c959-4ea8-9ec5-e0f53aafe9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:26.698627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115804d0-c959-4ea8-9ec5-e0f53aafe9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:26.698903 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115804d0-c959-4ea8-9ec5-e0f53aafe9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:26.699947 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115804d0-c959-4ea8-9ec5-e0f53aafe9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:26.701661 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115804d0-c959-4ea8-9ec5-e0f53aafe9e1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:26.713200 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 986/1953] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:26 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:26.717590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115804d0-c959-4ea8-9ec5-e0f53aafe9e1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:26.728737 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115804d0-c959-4ea8-9ec5-e0f53aafe9e1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:26.733384 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af564b0e-2ed9-482c-8f43-7055659f0171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:26.734247 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af564b0e-2ed9-482c-8f43-7055659f0171 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:26.734529 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af564b0e-2ed9-482c-8f43-7055659f0171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:26.734805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af564b0e-2ed9-482c-8f43-7055659f0171 admin admin] PATH_INFO: `/v3/projects/e8aba60d1c054a79b859db3e782d31c4/users/40e03a43192643f4b23185d417ab4156/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:26.738876 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e3dd8fab-8d65-4847-a2ba-c0019b4ce8be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a54938187484eff97c0f5de0964b73c'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:26.745282 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 968/1954] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:26 2021] DELETE /identity/v3/users/3a54938187484eff97c0f5de0964b73c => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:26.750848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af564b0e-2ed9-482c-8f43-7055659f0171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8aba60d1c054a79b859db3e782d31c4, user_id=40e03a43192643f4b23185d417ab4156, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:26.753749 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af564b0e-2ed9-482c-8f43-7055659f0171 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:26.836960 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 987/1955] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:26 2021] PUT /identity/v3/projects/e8aba60d1c054a79b859db3e782d31c4/users/40e03a43192643f4b23185d417ab4156/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:26.841024 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd8fab-8d65-4847-a2ba-c0019b4ce8be admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:26.904051 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd8fab-8d65-4847-a2ba-c0019b4ce8be admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:26.965739 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976e8e5-cae3-46e1-9cb4-1b735372db7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:26.966945 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976e8e5-cae3-46e1-9cb4-1b735372db7f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:26.967415 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976e8e5-cae3-46e1-9cb4-1b735372db7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:26.967948 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976e8e5-cae3-46e1-9cb4-1b735372db7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:26.970724 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976e8e5-cae3-46e1-9cb4-1b735372db7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:26.974482 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976e8e5-cae3-46e1-9cb4-1b735372db7f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:26.994055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 969/1956] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:26 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:26.995576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af564b0e-2ed9-482c-8f43-7055659f0171 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:27.007721 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af564b0e-2ed9-482c-8f43-7055659f0171 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:27.019745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e24f2-51ce-42a8-8167-1d9e4a3cc243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:27.021582 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e24f2-51ce-42a8-8167-1d9e4a3cc243 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:27.021867 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e24f2-51ce-42a8-8167-1d9e4a3cc243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:27.022194 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e24f2-51ce-42a8-8167-1d9e4a3cc243 admin admin] PATH_INFO: `/v3/projects/e8aba60d1c054a79b859db3e782d31c4/users/40e03a43192643f4b23185d417ab4156/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:27.027025 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e24f2-51ce-42a8-8167-1d9e4a3cc243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8aba60d1c054a79b859db3e782d31c4, user_id=40e03a43192643f4b23185d417ab4156, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:27.033764 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e24f2-51ce-42a8-8167-1d9e4a3cc243 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:27.052662 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 988/1957] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:26 2021] PUT /identity/v3/projects/e8aba60d1c054a79b859db3e782d31c4/users/40e03a43192643f4b23185d417ab4156/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:27.064909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d768794-ed81-4ced-9412-1fe8dbe37084 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:27.067588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d768794-ed81-4ced-9412-1fe8dbe37084 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:27.067588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d768794-ed81-4ced-9412-1fe8dbe37084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:27.097286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-4d768794-ed81-4ced-9412-1fe8dbe37084 None None] MFA Rules not processed for user `40e03a43192643f4b23185d417ab4156`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:27.097286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4d768794-ed81-4ced-9412-1fe8dbe37084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:27.173702 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 970/1958] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:27 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:27.183868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e24f2-51ce-42a8-8167-1d9e4a3cc243 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:27.185612 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-053e24f2-51ce-42a8-8167-1d9e4a3cc243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:27.263203 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e24f2-51ce-42a8-8167-1d9e4a3cc243 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:27.263348 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d768794-ed81-4ced-9412-1fe8dbe37084 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:27.264342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4d768794-ed81-4ced-9412-1fe8dbe37084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:27.277078 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21b573-660d-40ae-a3a2-de24affcf9b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:27.277387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21b573-660d-40ae-a3a2-de24affcf9b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:27.277680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21b573-660d-40ae-a3a2-de24affcf9b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:27.277960 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21b573-660d-40ae-a3a2-de24affcf9b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:27.310191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21b573-660d-40ae-a3a2-de24affcf9b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:27.312471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21b573-660d-40ae-a3a2-de24affcf9b0 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:27.329067 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 989/1959] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:27 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:27.364430 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d768794-ed81-4ced-9412-1fe8dbe37084 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:27.370057 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:27.370956 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:27.371238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:27.371516 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] PATH_INFO: `/v3/projects/1b5421545ddb49628cb6a780ccd05de0` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:27.372812 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5421545ddb49628cb6a780ccd05de0)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:27.374703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:27.535471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5421545ddb49628cb6a780ccd05de0', 'request_id': 'req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:27.636104 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5421545ddb49628cb6a780ccd05de0', 'request_id': 'req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:27.643484 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5421545ddb49628cb6a780ccd05de0', 'request_id': 'req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:27.654988 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] The token cache is being invalidate because project 1b5421545ddb49628cb6a780ccd05de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:27.655275 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:27.655963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:27.658811 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 971/1960] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:27 2021] DELETE /identity/v3/projects/1b5421545ddb49628cb6a780ccd05de0 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:27.664922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc68ea6-3740-4220-8cce-8fa27f968124 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:27.665208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc68ea6-3740-4220-8cce-8fa27f968124 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:27.665480 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc68ea6-3740-4220-8cce-8fa27f968124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:27.689371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-fdc68ea6-3740-4220-8cce-8fa27f968124 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:27.690339 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-fdc68ea6-3740-4220-8cce-8fa27f968124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:27.698154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:27.699855 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:27.762772 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 990/1961] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:27.764785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea862-4c4b-493f-8c58-7e092681b88e None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:27.765148 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea862-4c4b-493f-8c58-7e092681b88e None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:27.765493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea862-4c4b-493f-8c58-7e092681b88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:27.772155 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c3bb2-3843-4fe5-ab7e-ac21ef12d5e5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:27.778081 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66b73b-f8cf-4157-8979-a334ce8f498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:27.780795 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66b73b-f8cf-4157-8979-a334ce8f498a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:27.781090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66b73b-f8cf-4157-8979-a334ce8f498a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:27.781374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66b73b-f8cf-4157-8979-a334ce8f498a admin admin] PATH_INFO: `/v3/users/f6fadb62d7ad4e96bf9b6a93072096ff` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:27.783371 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66b73b-f8cf-4157-8979-a334ce8f498a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6fadb62d7ad4e96bf9b6a93072096ff)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:27.785442 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66b73b-f8cf-4157-8979-a334ce8f498a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:27.792355 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-66dea862-4c4b-493f-8c58-7e092681b88e None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:27.793705 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-66dea862-4c4b-493f-8c58-7e092681b88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:27.803891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 991/1962] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:27.808043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dea862-4c4b-493f-8c58-7e092681b88e None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:27.818588 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dea862-4c4b-493f-8c58-7e092681b88e None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:27.823750 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d1100-bfc7-450b-83e7-cefa13b204bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:27.824401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d1100-bfc7-450b-83e7-cefa13b204bb admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:27.824933 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d1100-bfc7-450b-83e7-cefa13b204bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:27.825221 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d1100-bfc7-450b-83e7-cefa13b204bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:27.825945 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d1100-bfc7-450b-83e7-cefa13b204bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:30:27.826263 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d1100-bfc7-450b-83e7-cefa13b204bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:27.827915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d1100-bfc7-450b-83e7-cefa13b204bb admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:27.839631 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 992/1963] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:30:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:30:27.844074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d1100-bfc7-450b-83e7-cefa13b204bb admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:27.854818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d1100-bfc7-450b-83e7-cefa13b204bb admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:27.859581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20d687-65d5-4d8f-a079-b5040417a574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:27.860883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20d687-65d5-4d8f-a079-b5040417a574 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:27.861167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20d687-65d5-4d8f-a079-b5040417a574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:27.861442 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20d687-65d5-4d8f-a079-b5040417a574 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:27.862134 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20d687-65d5-4d8f-a079-b5040417a574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:27.864091 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20d687-65d5-4d8f-a079-b5040417a574 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:27.975805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 993/1964] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:27 2021] POST /identity/v3/projects => generated 355 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:27.979947 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20d687-65d5-4d8f-a079-b5040417a574 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:28.015563 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-9c66b73b-f8cf-4157-8979-a334ce8f498a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6fadb62d7ad4e96bf9b6a93072096ff'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:28.022592 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-9c66b73b-f8cf-4157-8979-a334ce8f498a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6fadb62d7ad4e96bf9b6a93072096ff'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:28.023366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-9c66b73b-f8cf-4157-8979-a334ce8f498a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6fadb62d7ad4e96bf9b6a93072096ff'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:28.036246 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-9c66b73b-f8cf-4157-8979-a334ce8f498a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6fadb62d7ad4e96bf9b6a93072096ff'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:28.041100 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20d687-65d5-4d8f-a079-b5040417a574 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:28.045738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117c973-1cc7-401c-b39f-370247f840a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:28.046405 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117c973-1cc7-401c-b39f-370247f840a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:28.046679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117c973-1cc7-401c-b39f-370247f840a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:28.046951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117c973-1cc7-401c-b39f-370247f840a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:28.048371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117c973-1cc7-401c-b39f-370247f840a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:28.050319 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117c973-1cc7-401c-b39f-370247f840a3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:28.156437 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-9c66b73b-f8cf-4157-8979-a334ce8f498a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6fadb62d7ad4e96bf9b6a93072096ff'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:28.164220 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 972/1965] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:27 2021] DELETE /identity/v3/users/f6fadb62d7ad4e96bf9b6a93072096ff => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:28.168724 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319bdbe-1a30-4491-9492-7de34059aa52 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:28.169113 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319bdbe-1a30-4491-9492-7de34059aa52 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:28.169487 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319bdbe-1a30-4491-9492-7de34059aa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:28.185195 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 994/1966] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:27 2021] POST /identity/v3/users => generated 278 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:28.186750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-9319bdbe-1a30-4491-9492-7de34059aa52 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:28.188244 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9319bdbe-1a30-4491-9492-7de34059aa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:28.189777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117c973-1cc7-401c-b39f-370247f840a3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:28.191364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d117c973-1cc7-401c-b39f-370247f840a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:28.204109 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117c973-1cc7-401c-b39f-370247f840a3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:28.251837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 973/1967] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:28.264526 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319bdbe-1a30-4491-9492-7de34059aa52 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:28.267837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9319bdbe-1a30-4491-9492-7de34059aa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:28.276863 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5751c2-3137-46f4-ad32-a1cc1e51228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:28.277741 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5751c2-3137-46f4-ad32-a1cc1e51228b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:28.278023 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5751c2-3137-46f4-ad32-a1cc1e51228b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:28.278295 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5751c2-3137-46f4-ad32-a1cc1e51228b admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:28.279073 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5751c2-3137-46f4-ad32-a1cc1e51228b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:28.280947 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5751c2-3137-46f4-ad32-a1cc1e51228b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:28.292710 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 995/1968] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:28 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:30:28.297116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5751c2-3137-46f4-ad32-a1cc1e51228b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:28.308312 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5751c2-3137-46f4-ad32-a1cc1e51228b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:28.315278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e91c1-c0fe-4997-9049-cf43fd0f7850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:28.316210 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e91c1-c0fe-4997-9049-cf43fd0f7850 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:28.316333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e91c1-c0fe-4997-9049-cf43fd0f7850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:28.316599 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e91c1-c0fe-4997-9049-cf43fd0f7850 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:28.317343 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e91c1-c0fe-4997-9049-cf43fd0f7850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:28.318944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e91c1-c0fe-4997-9049-cf43fd0f7850 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:28.330472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 996/1969] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:28 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:28.332166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319bdbe-1a30-4491-9492-7de34059aa52 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:28.334649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e91c1-c0fe-4997-9049-cf43fd0f7850 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:28.335966 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e336540-2edc-4f18-8842-eb37ed52e8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:28.336682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336540-2edc-4f18-8842-eb37ed52e8ea service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:28.337026 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336540-2edc-4f18-8842-eb37ed52e8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:28.337540 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336540-2edc-4f18-8842-eb37ed52e8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:28.344840 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e91c1-c0fe-4997-9049-cf43fd0f7850 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:28.349585 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9f69c-7079-431f-b856-17be03d6b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:28.350453 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9f69c-7079-431f-b856-17be03d6b4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:28.350732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9f69c-7079-431f-b856-17be03d6b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:28.351004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9f69c-7079-431f-b856-17be03d6b4a4 admin admin] PATH_INFO: `/v3/projects/9a7997fee37f485da64866bc2db4f08c/users/de0d3f1b3edb4f40ba2c4d9253f33d9f/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:28.351682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e336540-2edc-4f18-8842-eb37ed52e8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:28.353169 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e336540-2edc-4f18-8842-eb37ed52e8ea service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:28.364198 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 974/1970] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:30:28.367432 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9f69c-7079-431f-b856-17be03d6b4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a7997fee37f485da64866bc2db4f08c, user_id=de0d3f1b3edb4f40ba2c4d9253f33d9f, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:28.370146 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9f69c-7079-431f-b856-17be03d6b4a4 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:28.450576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 997/1971] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:28 2021] PUT /identity/v3/projects/9a7997fee37f485da64866bc2db4f08c/users/de0d3f1b3edb4f40ba2c4d9253f33d9f/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:28.463053 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7250ec-9f90-4148-9ae7-e172c09a8f50 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:28.463337 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7250ec-9f90-4148-9ae7-e172c09a8f50 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:28.463840 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7250ec-9f90-4148-9ae7-e172c09a8f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:28.496193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-1c7250ec-9f90-4148-9ae7-e172c09a8f50 None None] MFA Rules not processed for user `de0d3f1b3edb4f40ba2c4d9253f33d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:28.497412 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-1c7250ec-9f90-4148-9ae7-e172c09a8f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:28.589826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 975/1972] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:28 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:28.599266 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9f69c-7079-431f-b856-17be03d6b4a4 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:28.699808 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9f69c-7079-431f-b856-17be03d6b4a4 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:28.707197 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a65bc1-7913-43c1-a126-af0bf9b0e294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:28.708704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65bc1-7913-43c1-a126-af0bf9b0e294 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:28.708999 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65bc1-7913-43c1-a126-af0bf9b0e294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:28.709280 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65bc1-7913-43c1-a126-af0bf9b0e294 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:28.710030 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a65bc1-7913-43c1-a126-af0bf9b0e294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:28.714603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a65bc1-7913-43c1-a126-af0bf9b0e294 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:28.856235 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 998/1973] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:28 2021] POST /identity/v3/projects => generated 357 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:28.864260 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7250ec-9f90-4148-9ae7-e172c09a8f50 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:28.876603 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7250ec-9f90-4148-9ae7-e172c09a8f50 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:28.896992 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a65bc1-7913-43c1-a126-af0bf9b0e294 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:28.898712 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d2a65bc1-7913-43c1-a126-af0bf9b0e294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:28.952180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cdf3b-b68f-4eda-b8aa-fe763ddcfd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:28.953234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cdf3b-b68f-4eda-b8aa-fe763ddcfd1b admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:28.954252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cdf3b-b68f-4eda-b8aa-fe763ddcfd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:28.954890 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cdf3b-b68f-4eda-b8aa-fe763ddcfd1b admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:28.955713 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cdf3b-b68f-4eda-b8aa-fe763ddcfd1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:28.958180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cdf3b-b68f-4eda-b8aa-fe763ddcfd1b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:28.994890 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a65bc1-7913-43c1-a126-af0bf9b0e294 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:28.999976 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413ab08-9493-464f-a39a-c37b01669918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:29.002028 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413ab08-9493-464f-a39a-c37b01669918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.002328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413ab08-9493-464f-a39a-c37b01669918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.002584 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413ab08-9493-464f-a39a-c37b01669918 admin admin] PATH_INFO: `/v3/projects/e28a94be4c564fad8486abdd6cba47dd` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:29.004196 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413ab08-9493-464f-a39a-c37b01669918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28a94be4c564fad8486abdd6cba47dd)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:29.006295 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413ab08-9493-464f-a39a-c37b01669918 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:29.077431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 976/1974] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:28 2021] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:29.082190 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cdf3b-b68f-4eda-b8aa-fe763ddcfd1b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:29.092411 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cdf3b-b68f-4eda-b8aa-fe763ddcfd1b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:29.098686 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db8060-5d00-4aa1-a0d7-5eab604bdc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:29.098686 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db8060-5d00-4aa1-a0d7-5eab604bdc1f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.098686 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db8060-5d00-4aa1-a0d7-5eab604bdc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.098999 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db8060-5d00-4aa1-a0d7-5eab604bdc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:29.099794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db8060-5d00-4aa1-a0d7-5eab604bdc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:29.101322 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db8060-5d00-4aa1-a0d7-5eab604bdc1f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:29.111839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 977/1975] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:30:29.116639 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db8060-5d00-4aa1-a0d7-5eab604bdc1f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:29.128349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db8060-5d00-4aa1-a0d7-5eab604bdc1f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:29.133280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10e052-3e85-41e5-b18a-4d9872eb6699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:29.134158 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10e052-3e85-41e5-b18a-4d9872eb6699 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.134439 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10e052-3e85-41e5-b18a-4d9872eb6699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.134805 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10e052-3e85-41e5-b18a-4d9872eb6699 admin admin] PATH_INFO: `/v3/projects/f9fe319fb80942398e3f7b935beb7262/users/9b64442da80f43f185879277c6e1398e/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:29.151653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10e052-3e85-41e5-b18a-4d9872eb6699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9fe319fb80942398e3f7b935beb7262, user_id=9b64442da80f43f185879277c6e1398e, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:29.154507 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10e052-3e85-41e5-b18a-4d9872eb6699 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:29.172005 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2413ab08-9493-464f-a39a-c37b01669918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28a94be4c564fad8486abdd6cba47dd', 'request_id': 'req-2413ab08-9493-464f-a39a-c37b01669918'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:29.243307 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 978/1976] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:29 2021] PUT /identity/v3/projects/f9fe319fb80942398e3f7b935beb7262/users/9b64442da80f43f185879277c6e1398e/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:29.247194 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10e052-3e85-41e5-b18a-4d9872eb6699 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:29.265120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2413ab08-9493-464f-a39a-c37b01669918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28a94be4c564fad8486abdd6cba47dd', 'request_id': 'req-2413ab08-9493-464f-a39a-c37b01669918'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:29.274268 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2413ab08-9493-464f-a39a-c37b01669918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28a94be4c564fad8486abdd6cba47dd', 'request_id': 'req-2413ab08-9493-464f-a39a-c37b01669918'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:29.289049 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2413ab08-9493-464f-a39a-c37b01669918 admin admin] The token cache is being invalidate because project e28a94be4c564fad8486abdd6cba47dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:29.291576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2413ab08-9493-464f-a39a-c37b01669918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:29.291576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2413ab08-9493-464f-a39a-c37b01669918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:29.292933 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 999/1977] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:28 2021] DELETE /identity/v3/projects/e28a94be4c564fad8486abdd6cba47dd => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:29.300068 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afee04f-d4b6-46d3-9a24-744f84e7d2eb None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.300432 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afee04f-d4b6-46d3-9a24-744f84e7d2eb None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.300788 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afee04f-d4b6-46d3-9a24-744f84e7d2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:29.314990 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10e052-3e85-41e5-b18a-4d9872eb6699 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:29.319649 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3efd4-ea58-4dff-b82d-d2ebeedbe657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:29.320371 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3efd4-ea58-4dff-b82d-d2ebeedbe657 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.320625 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3efd4-ea58-4dff-b82d-d2ebeedbe657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.320897 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3efd4-ea58-4dff-b82d-d2ebeedbe657 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:29.321626 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3efd4-ea58-4dff-b82d-d2ebeedbe657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:29.322147 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-2afee04f-d4b6-46d3-9a24-744f84e7d2eb None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:29.323181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3efd4-ea58-4dff-b82d-d2ebeedbe657 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:29.323347 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-2afee04f-d4b6-46d3-9a24-744f84e7d2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:29.332776 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1000/1978] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:29.335826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 979/1979] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:29 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:29.341010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483083c2-aeee-4205-87b2-2b5c5b7fa6dc None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.341727 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483083c2-aeee-4205-87b2-2b5c5b7fa6dc None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.342252 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483083c2-aeee-4205-87b2-2b5c5b7fa6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:29.345587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3efd4-ea58-4dff-b82d-d2ebeedbe657 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:29.347643 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-edd3efd4-ea58-4dff-b82d-d2ebeedbe657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:29.363204 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-483083c2-aeee-4205-87b2-2b5c5b7fa6dc None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:29.364508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-483083c2-aeee-4205-87b2-2b5c5b7fa6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:29.364823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3efd4-ea58-4dff-b82d-d2ebeedbe657 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:29.370861 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ff8f9-36ab-4143-967b-5e4de2e20be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:29.371762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff8f9-36ab-4143-967b-5e4de2e20be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.372053 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff8f9-36ab-4143-967b-5e4de2e20be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.372411 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff8f9-36ab-4143-967b-5e4de2e20be4 admin admin] PATH_INFO: `/v3/projects/f9fe319fb80942398e3f7b935beb7262/users/9b64442da80f43f185879277c6e1398e/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:29.373412 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1001/1980] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:29.375067 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ff8f9-36ab-4143-967b-5e4de2e20be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9fe319fb80942398e3f7b935beb7262, user_id=9b64442da80f43f185879277c6e1398e, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:29.377693 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483083c2-aeee-4205-87b2-2b5c5b7fa6dc None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:29.377905 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ff8f9-36ab-4143-967b-5e4de2e20be4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:29.387026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483083c2-aeee-4205-87b2-2b5c5b7fa6dc None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:29.393158 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 980/1981] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:29 2021] PUT /identity/v3/projects/f9fe319fb80942398e3f7b935beb7262/users/9b64442da80f43f185879277c6e1398e/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:29.403084 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0c66e-9f4f-490b-8d06-9410420038c2 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.403660 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0c66e-9f4f-490b-8d06-9410420038c2 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.404172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0c66e-9f4f-490b-8d06-9410420038c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:29.432004 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-afb0c66e-9f4f-490b-8d06-9410420038c2 None None] MFA Rules not processed for user `9b64442da80f43f185879277c6e1398e`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:29.433143 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-afb0c66e-9f4f-490b-8d06-9410420038c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:29.447783 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1a941-5ccb-4183-8e6d-5f9ddb141a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:29.448019 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a941-5ccb-4183-8e6d-5f9ddb141a34 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.448220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a941-5ccb-4183-8e6d-5f9ddb141a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.451685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a941-5ccb-4183-8e6d-5f9ddb141a34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:29.451685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1a941-5ccb-4183-8e6d-5f9ddb141a34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:30:29.451685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1a941-5ccb-4183-8e6d-5f9ddb141a34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:29.452033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1a941-5ccb-4183-8e6d-5f9ddb141a34 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:29.464472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1002/1982] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:30:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:30:29.468840 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1a941-5ccb-4183-8e6d-5f9ddb141a34 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:29.479139 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1a941-5ccb-4183-8e6d-5f9ddb141a34 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:29.488877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a22b1-2e40-4c5a-b976-7a1ddfa42653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:29.488877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a22b1-2e40-4c5a-b976-7a1ddfa42653 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.488877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a22b1-2e40-4c5a-b976-7a1ddfa42653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.488877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a22b1-2e40-4c5a-b976-7a1ddfa42653 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:29.489213 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a22b1-2e40-4c5a-b976-7a1ddfa42653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:29.489946 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a22b1-2e40-4c5a-b976-7a1ddfa42653 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:29.506966 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 981/1983] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:29 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:29.518097 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0c66e-9f4f-490b-8d06-9410420038c2 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:29.519750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-afb0c66e-9f4f-490b-8d06-9410420038c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:29.577882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0c66e-9f4f-490b-8d06-9410420038c2 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:29.581785 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ceb580-34b0-422d-bf9f-9756fad4668b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:29.582436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ceb580-34b0-422d-bf9f-9756fad4668b service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.582712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ceb580-34b0-422d-bf9f-9756fad4668b service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.582980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ceb580-34b0-422d-bf9f-9756fad4668b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:29.592223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ceb580-34b0-422d-bf9f-9756fad4668b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:29.593618 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ceb580-34b0-422d-bf9f-9756fad4668b service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:29.603616 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 982/1984] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:29 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:30:29.616096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1003/1985] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:29 2021] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:29.619241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ceb580-34b0-422d-bf9f-9756fad4668b service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:29.629646 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ceb580-34b0-422d-bf9f-9756fad4668b service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:29.691930 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457caa92-8133-449b-b060-0641dc6b545c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:29.692581 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457caa92-8133-449b-b060-0641dc6b545c admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.692833 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457caa92-8133-449b-b060-0641dc6b545c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.693161 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457caa92-8133-449b-b060-0641dc6b545c admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:29.693841 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457caa92-8133-449b-b060-0641dc6b545c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:29.695847 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457caa92-8133-449b-b060-0641dc6b545c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:29.799767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 983/1986] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:29 2021] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:29.806889 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a22b1-2e40-4c5a-b976-7a1ddfa42653 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:29.820404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a22b1-2e40-4c5a-b976-7a1ddfa42653 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:29.827687 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe8d92-de2f-4eed-a3b2-5b5ff6adc8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:29.828430 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8d92-de2f-4eed-a3b2-5b5ff6adc8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.829876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8d92-de2f-4eed-a3b2-5b5ff6adc8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.829876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8d92-de2f-4eed-a3b2-5b5ff6adc8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:29.830415 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe8d92-de2f-4eed-a3b2-5b5ff6adc8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:29.832122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe8d92-de2f-4eed-a3b2-5b5ff6adc8d5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:29.852729 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457caa92-8133-449b-b060-0641dc6b545c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:29.853628 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1004/1987] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:29 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:29.859473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe8d92-de2f-4eed-a3b2-5b5ff6adc8d5 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:29.877230 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe8d92-de2f-4eed-a3b2-5b5ff6adc8d5 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:29.884718 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef11c1-c4d5-4799-8112-299cb0ea3bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:29.885643 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef11c1-c4d5-4799-8112-299cb0ea3bdd admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.887081 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef11c1-c4d5-4799-8112-299cb0ea3bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.887364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef11c1-c4d5-4799-8112-299cb0ea3bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:29.889474 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef11c1-c4d5-4799-8112-299cb0ea3bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:29.891617 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef11c1-c4d5-4799-8112-299cb0ea3bdd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:29.918401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1005/1988] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:29 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:29.922847 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef11c1-c4d5-4799-8112-299cb0ea3bdd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:29.948106 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef11c1-c4d5-4799-8112-299cb0ea3bdd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:29.974653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858f418-735f-4c7e-84aa-daccf0ee530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:29.978900 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858f418-735f-4c7e-84aa-daccf0ee530c admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:29.979972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858f418-735f-4c7e-84aa-daccf0ee530c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:29.981137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858f418-735f-4c7e-84aa-daccf0ee530c admin admin] PATH_INFO: `/v3/projects/140de47c19b545518c3ef312dfa94c6e/users/32c873eaec46424fb12514fa07b37643/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:30.003399 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858f418-735f-4c7e-84aa-daccf0ee530c admin admin] RBAC: Authorizing `identity:create_grant(project_id=140de47c19b545518c3ef312dfa94c6e, user_id=32c873eaec46424fb12514fa07b37643, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:30.004898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457caa92-8133-449b-b060-0641dc6b545c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:30.006116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858f418-735f-4c7e-84aa-daccf0ee530c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:30.009981 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae056fc0-74e3-4975-9577-5dc99f205df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:30.010752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae056fc0-74e3-4975-9577-5dc99f205df2 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:30.011102 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae056fc0-74e3-4975-9577-5dc99f205df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:30.011564 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae056fc0-74e3-4975-9577-5dc99f205df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:30.013625 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ae056fc0-74e3-4975-9577-5dc99f205df2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:30.146028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae056fc0-74e3-4975-9577-5dc99f205df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:30.146028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae056fc0-74e3-4975-9577-5dc99f205df2 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:30.168436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1006/1989] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:29 2021] PUT /identity/v3/projects/140de47c19b545518c3ef312dfa94c6e/users/32c873eaec46424fb12514fa07b37643/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:30.192899 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 984/1990] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:29 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:30.196354 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73d3ef-1ce7-47f1-9846-898db199c5fe None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:30.198297 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73d3ef-1ce7-47f1-9846-898db199c5fe None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:30.199047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73d3ef-1ce7-47f1-9846-898db199c5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:30.249371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-fd73d3ef-1ce7-47f1-9846-898db199c5fe None None] MFA Rules not processed for user `32c873eaec46424fb12514fa07b37643`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:30.251093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-fd73d3ef-1ce7-47f1-9846-898db199c5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:30.390239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1007/1991] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:30 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:30.399826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae056fc0-74e3-4975-9577-5dc99f205df2 service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:30.402241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ae056fc0-74e3-4975-9577-5dc99f205df2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:30.414928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae056fc0-74e3-4975-9577-5dc99f205df2 service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:30.489695 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69201b36-e74c-4126-b630-0d052de76c28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:30.490574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69201b36-e74c-4126-b630-0d052de76c28 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:30.490678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69201b36-e74c-4126-b630-0d052de76c28 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:30.490940 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69201b36-e74c-4126-b630-0d052de76c28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:30.501094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69201b36-e74c-4126-b630-0d052de76c28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:30.502546 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69201b36-e74c-4126-b630-0d052de76c28 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:30.513917 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 985/1992] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:30 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:31.216900 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73d3ef-1ce7-47f1-9846-898db199c5fe None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:31.220057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-fd73d3ef-1ce7-47f1-9846-898db199c5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:31.295044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73d3ef-1ce7-47f1-9846-898db199c5fe None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:31.299869 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f675a1e-1b82-4499-83fd-3351fcfcd123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:31.300721 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f675a1e-1b82-4499-83fd-3351fcfcd123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:31.300995 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f675a1e-1b82-4499-83fd-3351fcfcd123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:31.301264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f675a1e-1b82-4499-83fd-3351fcfcd123 admin admin] PATH_INFO: `/v3/users/f818b20f666e4bbfbf1329e03ea88d65` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:31.302491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f675a1e-1b82-4499-83fd-3351fcfcd123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f818b20f666e4bbfbf1329e03ea88d65)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:31.304536 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f675a1e-1b82-4499-83fd-3351fcfcd123 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:31.584471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9f675a1e-1b82-4499-83fd-3351fcfcd123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f818b20f666e4bbfbf1329e03ea88d65'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:31.585537 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9f675a1e-1b82-4499-83fd-3351fcfcd123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f818b20f666e4bbfbf1329e03ea88d65'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:31.621552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9f675a1e-1b82-4499-83fd-3351fcfcd123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f818b20f666e4bbfbf1329e03ea88d65'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:31.639898 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9f675a1e-1b82-4499-83fd-3351fcfcd123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f818b20f666e4bbfbf1329e03ea88d65'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:31.739808 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9f675a1e-1b82-4499-83fd-3351fcfcd123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f818b20f666e4bbfbf1329e03ea88d65'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:31.746597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1008/1993] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:31 2021] DELETE /identity/v3/users/f818b20f666e4bbfbf1329e03ea88d65 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:31.751395 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486165ed-d9da-40b0-9228-84553842a108 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:31.751927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486165ed-d9da-40b0-9228-84553842a108 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:31.752374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486165ed-d9da-40b0-9228-84553842a108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:31.770515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-486165ed-d9da-40b0-9228-84553842a108 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:31.771720 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-486165ed-d9da-40b0-9228-84553842a108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:31.883241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 986/1994] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:31.902212 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f675a1e-1b82-4499-83fd-3351fcfcd123 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:31.903959 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-9f675a1e-1b82-4499-83fd-3351fcfcd123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:31.996633 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f675a1e-1b82-4499-83fd-3351fcfcd123 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:32.001066 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2492e9c-a39c-4277-911f-b656e1bd7114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:32.001855 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2492e9c-a39c-4277-911f-b656e1bd7114 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:32.002137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2492e9c-a39c-4277-911f-b656e1bd7114 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:32.002404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2492e9c-a39c-4277-911f-b656e1bd7114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:32.013236 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2492e9c-a39c-4277-911f-b656e1bd7114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:32.014693 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2492e9c-a39c-4277-911f-b656e1bd7114 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:32.029364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1009/1995] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:32.495602 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486165ed-d9da-40b0-9228-84553842a108 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:32.497350 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-486165ed-d9da-40b0-9228-84553842a108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:32.510857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486165ed-d9da-40b0-9228-84553842a108 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:32.515666 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:32.516704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:32.516978 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:32.517296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] PATH_INFO: `/v3/projects/7d965da403bd4831a7a60e8e9b09e183` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:32.519172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d965da403bd4831a7a60e8e9b09e183)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:32.521092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:32.654652 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d965da403bd4831a7a60e8e9b09e183', 'request_id': 'req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:32.756206 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d965da403bd4831a7a60e8e9b09e183', 'request_id': 'req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:32.762106 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d965da403bd4831a7a60e8e9b09e183', 'request_id': 'req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:32.775157 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] The token cache is being invalidate because project 7d965da403bd4831a7a60e8e9b09e183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:32.775441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:32.776113 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:32.777978 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 987/1996] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:32 2021] DELETE /identity/v3/projects/7d965da403bd4831a7a60e8e9b09e183 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:32.782309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2492e9c-a39c-4277-911f-b656e1bd7114 service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:32.793088 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2492e9c-a39c-4277-911f-b656e1bd7114 service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:32.854088 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa5056-b308-483f-b352-4ae6fc79092f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:32.854942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5056-b308-483f-b352-4ae6fc79092f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:32.855215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5056-b308-483f-b352-4ae6fc79092f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:32.855606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5056-b308-483f-b352-4ae6fc79092f admin admin] PATH_INFO: `/v3/users/40e03a43192643f4b23185d417ab4156` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:32.856708 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa5056-b308-483f-b352-4ae6fc79092f admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e03a43192643f4b23185d417ab4156)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:32.858671 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa5056-b308-483f-b352-4ae6fc79092f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:33.080220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-05fa5056-b308-483f-b352-4ae6fc79092f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e03a43192643f4b23185d417ab4156'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:33.080792 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-05fa5056-b308-483f-b352-4ae6fc79092f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e03a43192643f4b23185d417ab4156'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:33.093140 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-05fa5056-b308-483f-b352-4ae6fc79092f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e03a43192643f4b23185d417ab4156'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:33.100619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-05fa5056-b308-483f-b352-4ae6fc79092f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e03a43192643f4b23185d417ab4156'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:33.214335 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-05fa5056-b308-483f-b352-4ae6fc79092f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e03a43192643f4b23185d417ab4156'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:33.223372 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1010/1997] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:32 2021] DELETE /identity/v3/users/40e03a43192643f4b23185d417ab4156 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:33.791902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:33.794416 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:33.809832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cb098-81e7-4f5a-b3d5-d88e58e0ccfa admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:33.894030 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:33.894921 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:33.895200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:33.895472 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70 admin admin] PATH_INFO: `/v3/projects/e8aba60d1c054a79b859db3e782d31c4` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:33.896753 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8aba60d1c054a79b859db3e782d31c4)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:33.898835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:33.995005 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1d1c8-368d-408c-86e2-801bccf748ac None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:33.995473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1d1c8-368d-408c-86e2-801bccf748ac None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:33.995550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1d1c8-368d-408c-86e2-801bccf748ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:34.015602 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-e6e1d1c8-368d-408c-86e2-801bccf748ac None None] MFA Rules not processed for user `5b2dbc6652b34cd3a4fc39dbabd839bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:34.016939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e6e1d1c8-368d-408c-86e2-801bccf748ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:34.052602 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8aba60d1c054a79b859db3e782d31c4', 'request_id': 'req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:34.076771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1011/1998] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:33 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:34.134130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8aba60d1c054a79b859db3e782d31c4', 'request_id': 'req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:34.143573 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8aba60d1c054a79b859db3e782d31c4', 'request_id': 'req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:34.160044 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70 admin admin] The token cache is being invalidate because project e8aba60d1c054a79b859db3e782d31c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:34.160454 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:34.161113 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-de85274a-d0b2-4d6e-aaba-cf6ad323fa70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:34.162674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 988/1999] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:33 2021] DELETE /identity/v3/projects/e8aba60d1c054a79b859db3e782d31c4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:34.168397 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a45b4-b307-4fba-9d7f-22352f4b3042 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:34.168890 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a45b4-b307-4fba-9d7f-22352f4b3042 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:34.169242 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a45b4-b307-4fba-9d7f-22352f4b3042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:34.187521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-6a1a45b4-b307-4fba-9d7f-22352f4b3042 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:34.189244 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6a1a45b4-b307-4fba-9d7f-22352f4b3042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:34.253471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1012/2000] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:34.261760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539cf98-b58c-4d6d-b0e4-d95512f26c07 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:34.262055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539cf98-b58c-4d6d-b0e4-d95512f26c07 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:34.262323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539cf98-b58c-4d6d-b0e4-d95512f26c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:34.281010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-c539cf98-b58c-4d6d-b0e4-d95512f26c07 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:34.282238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c539cf98-b58c-4d6d-b0e4-d95512f26c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:34.290403 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 989/2001] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:34.294692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a45b4-b307-4fba-9d7f-22352f4b3042 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:34.305112 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a45b4-b307-4fba-9d7f-22352f4b3042 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:34.309860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb983347-49a3-44ee-a608-b8f0a2843776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:34.310520 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb983347-49a3-44ee-a608-b8f0a2843776 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:34.310793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb983347-49a3-44ee-a608-b8f0a2843776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:34.311062 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb983347-49a3-44ee-a608-b8f0a2843776 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:34.311868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb983347-49a3-44ee-a608-b8f0a2843776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:30:34.312174 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb983347-49a3-44ee-a608-b8f0a2843776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:34.314289 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb983347-49a3-44ee-a608-b8f0a2843776 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:34.327054 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1013/2002] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:30:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:30:34.332984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539cf98-b58c-4d6d-b0e4-d95512f26c07 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:34.343153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539cf98-b58c-4d6d-b0e4-d95512f26c07 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:34.348308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848da9d8-972a-44ba-9393-c7e248477788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:34.348966 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848da9d8-972a-44ba-9393-c7e248477788 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:34.349239 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848da9d8-972a-44ba-9393-c7e248477788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:34.349505 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848da9d8-972a-44ba-9393-c7e248477788 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:34.350204 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848da9d8-972a-44ba-9393-c7e248477788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:34.352317 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848da9d8-972a-44ba-9393-c7e248477788 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:34.466212 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 990/2003] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:34 2021] POST /identity/v3/projects => generated 401 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:34.471278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb983347-49a3-44ee-a608-b8f0a2843776 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:34.481591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb983347-49a3-44ee-a608-b8f0a2843776 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:34.543099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac4f17-3faa-4256-813c-ee627278b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:34.543801 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac4f17-3faa-4256-813c-ee627278b873 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:34.544113 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac4f17-3faa-4256-813c-ee627278b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:34.544391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac4f17-3faa-4256-813c-ee627278b873 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:34.545099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac4f17-3faa-4256-813c-ee627278b873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:34.547013 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac4f17-3faa-4256-813c-ee627278b873 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:34.669982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1014/2004] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:34 2021] POST /identity/v3/users => generated 301 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:34.671094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848da9d8-972a-44ba-9393-c7e248477788 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:34.687815 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848da9d8-972a-44ba-9393-c7e248477788 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:34.692184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6f126-4626-4cba-8803-7750cfb1b430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:34.692902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6f126-4626-4cba-8803-7750cfb1b430 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:34.693188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6f126-4626-4cba-8803-7750cfb1b430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:34.693456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6f126-4626-4cba-8803-7750cfb1b430 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:34.694194 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6f126-4626-4cba-8803-7750cfb1b430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:34.695907 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6f126-4626-4cba-8803-7750cfb1b430 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:34.709489 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 991/2005] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:34 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:30:34.710740 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac4f17-3faa-4256-813c-ee627278b873 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:34.722321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac4f17-3faa-4256-813c-ee627278b873 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:34.740095 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e071fc-682f-4189-b62f-e2a6ebb69eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:34.740772 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e071fc-682f-4189-b62f-e2a6ebb69eaa admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:34.741053 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e071fc-682f-4189-b62f-e2a6ebb69eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:34.741323 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e071fc-682f-4189-b62f-e2a6ebb69eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:34.742069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e071fc-682f-4189-b62f-e2a6ebb69eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:34.743964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e071fc-682f-4189-b62f-e2a6ebb69eaa admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:34.795885 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1015/2006] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:34 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:34.800981 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6f126-4626-4cba-8803-7750cfb1b430 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:34.811137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6f126-4626-4cba-8803-7750cfb1b430 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:34.819820 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c099866-d728-4a15-b03c-812482291824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:34.820939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c099866-d728-4a15-b03c-812482291824 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:34.821594 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c099866-d728-4a15-b03c-812482291824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:34.822141 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c099866-d728-4a15-b03c-812482291824 admin admin] PATH_INFO: `/v3/projects/cf296814ec5c485e808414173d27f5ee/users/e9a153ddb2114f7db3dab3d079b8f44c/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:34.853662 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c099866-d728-4a15-b03c-812482291824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf296814ec5c485e808414173d27f5ee, user_id=e9a153ddb2114f7db3dab3d079b8f44c, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:34.856765 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c099866-d728-4a15-b03c-812482291824 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:34.932667 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 992/2007] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:34 2021] PUT /identity/v3/projects/cf296814ec5c485e808414173d27f5ee/users/e9a153ddb2114f7db3dab3d079b8f44c/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:34.942929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2931d-dcf9-4154-9683-c57eed3ba046 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:34.943223 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2931d-dcf9-4154-9683-c57eed3ba046 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:34.943517 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2931d-dcf9-4154-9683-c57eed3ba046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:34.980124 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-7ca2931d-dcf9-4154-9683-c57eed3ba046 None None] MFA Rules not processed for user `e9a153ddb2114f7db3dab3d079b8f44c`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:34.982471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7ca2931d-dcf9-4154-9683-c57eed3ba046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:35.073261 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1016/2008] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:34 2021] POST /identity/v3/auth/tokens => generated 3421 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:35.077904 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c099866-d728-4a15-b03c-812482291824 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:35.167837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c099866-d728-4a15-b03c-812482291824 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:35.173500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6ef6e-be5d-4b1d-bf95-632dc2e9671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:35.174505 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6ef6e-be5d-4b1d-bf95-632dc2e9671d admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:35.174845 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6ef6e-be5d-4b1d-bf95-632dc2e9671d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:35.175172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6ef6e-be5d-4b1d-bf95-632dc2e9671d admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:35.179908 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6ef6e-be5d-4b1d-bf95-632dc2e9671d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:35.179908 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6ef6e-be5d-4b1d-bf95-632dc2e9671d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:35.229818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2931d-dcf9-4154-9683-c57eed3ba046 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:35.231461 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7ca2931d-dcf9-4154-9683-c57eed3ba046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:35.257517 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2931d-dcf9-4154-9683-c57eed3ba046 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:35.262223 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc51a24-fa74-4a18-9dca-8bf7d5a03525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:35.269285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc51a24-fa74-4a18-9dca-8bf7d5a03525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:35.269285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc51a24-fa74-4a18-9dca-8bf7d5a03525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:35.269285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc51a24-fa74-4a18-9dca-8bf7d5a03525 admin admin] PATH_INFO: `/v3/users/32c873eaec46424fb12514fa07b37643` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:35.269285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc51a24-fa74-4a18-9dca-8bf7d5a03525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c873eaec46424fb12514fa07b37643)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:35.269285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc51a24-fa74-4a18-9dca-8bf7d5a03525 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:35.299608 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 993/2009] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:35 2021] POST /identity/v3/projects => generated 401 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:35.300461 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6ef6e-be5d-4b1d-bf95-632dc2e9671d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:35.397482 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6ef6e-be5d-4b1d-bf95-632dc2e9671d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:35.402225 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3199a-7ee5-4931-93a4-c47eec4315e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:35.402921 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3199a-7ee5-4931-93a4-c47eec4315e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:35.403177 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3199a-7ee5-4931-93a4-c47eec4315e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:35.403511 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3199a-7ee5-4931-93a4-c47eec4315e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:35.404249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3199a-7ee5-4931-93a4-c47eec4315e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:35.406454 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3199a-7ee5-4931-93a4-c47eec4315e1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:35.501361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6fc51a24-fa74-4a18-9dca-8bf7d5a03525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c873eaec46424fb12514fa07b37643'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:35.501866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6fc51a24-fa74-4a18-9dca-8bf7d5a03525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c873eaec46424fb12514fa07b37643'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:35.513596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6fc51a24-fa74-4a18-9dca-8bf7d5a03525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c873eaec46424fb12514fa07b37643'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:35.524075 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6fc51a24-fa74-4a18-9dca-8bf7d5a03525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c873eaec46424fb12514fa07b37643'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:35.527284 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 994/2010] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:35 2021] POST /identity/v3/users => generated 307 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:35.528303 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3199a-7ee5-4931-93a4-c47eec4315e1 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:35.529986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3fd3199a-7ee5-4931-93a4-c47eec4315e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:35.541785 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3199a-7ee5-4931-93a4-c47eec4315e1 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:35.546395 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4a282-fbad-4cf8-a4e5-d99239c9fb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:35.547121 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4a282-fbad-4cf8-a4e5-d99239c9fb70 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:35.547441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4a282-fbad-4cf8-a4e5-d99239c9fb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:35.547715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4a282-fbad-4cf8-a4e5-d99239c9fb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:35.548499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4a282-fbad-4cf8-a4e5-d99239c9fb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:35.550085 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4a282-fbad-4cf8-a4e5-d99239c9fb70 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:35.560452 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 995/2011] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:35.565116 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4a282-fbad-4cf8-a4e5-d99239c9fb70 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:35.574745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4a282-fbad-4cf8-a4e5-d99239c9fb70 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:35.580025 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d1783-3940-4392-ae55-4b7b4c940eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:35.580853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d1783-3940-4392-ae55-4b7b4c940eec admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:35.581126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d1783-3940-4392-ae55-4b7b4c940eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:35.581393 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d1783-3940-4392-ae55-4b7b4c940eec admin admin] PATH_INFO: `/v3/projects/8d69e45999354a4793c9d7c47d5ef644/users/12000cae065b4346a7a5e2705c23dab7/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:35.597987 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d1783-3940-4392-ae55-4b7b4c940eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d69e45999354a4793c9d7c47d5ef644, user_id=12000cae065b4346a7a5e2705c23dab7, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:35.600707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d1783-3940-4392-ae55-4b7b4c940eec admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:35.618855 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6fc51a24-fa74-4a18-9dca-8bf7d5a03525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c873eaec46424fb12514fa07b37643'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:35.626456 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1017/2012] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:35 2021] DELETE /identity/v3/users/32c873eaec46424fb12514fa07b37643 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:35.631336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e0737-2a97-4e77-9fbb-bde07fab5dc8 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:35.631654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e0737-2a97-4e77-9fbb-bde07fab5dc8 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:35.631971 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e0737-2a97-4e77-9fbb-bde07fab5dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:35.651352 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-4d3e0737-2a97-4e77-9fbb-bde07fab5dc8 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:35.652607 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4d3e0737-2a97-4e77-9fbb-bde07fab5dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:35.709424 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1018/2013] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:35.719182 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e0737-2a97-4e77-9fbb-bde07fab5dc8 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:35.720578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4d3e0737-2a97-4e77-9fbb-bde07fab5dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:35.775364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 996/2014] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:35 2021] PUT /identity/v3/projects/8d69e45999354a4793c9d7c47d5ef644/users/12000cae065b4346a7a5e2705c23dab7/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:35.780205 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d1783-3940-4392-ae55-4b7b4c940eec admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:35.780384 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e0737-2a97-4e77-9fbb-bde07fab5dc8 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:35.842363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf745d-56f8-4a72-aad3-f7ffa98670c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:35.843471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf745d-56f8-4a72-aad3-f7ffa98670c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:35.844154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf745d-56f8-4a72-aad3-f7ffa98670c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:35.845163 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf745d-56f8-4a72-aad3-f7ffa98670c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:35.850007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d1783-3940-4392-ae55-4b7b4c940eec admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:35.855195 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838427c-2b6f-44c6-9dc7-819a96f482c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:35.856069 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838427c-2b6f-44c6-9dc7-819a96f482c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:35.856340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838427c-2b6f-44c6-9dc7-819a96f482c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:35.856613 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838427c-2b6f-44c6-9dc7-819a96f482c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:35.857386 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838427c-2b6f-44c6-9dc7-819a96f482c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:35.857693 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf745d-56f8-4a72-aad3-f7ffa98670c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:35.858997 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838427c-2b6f-44c6-9dc7-819a96f482c5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:35.859111 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf745d-56f8-4a72-aad3-f7ffa98670c5 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:35.870813 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 997/2015] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:35 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:35.873249 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1019/2016] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:30:35.882327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838427c-2b6f-44c6-9dc7-819a96f482c5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:35.907547 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838427c-2b6f-44c6-9dc7-819a96f482c5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:35.920965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59973d3-6d53-4b5a-aa77-90d38ce95613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:35.922924 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59973d3-6d53-4b5a-aa77-90d38ce95613 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:35.923427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59973d3-6d53-4b5a-aa77-90d38ce95613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:35.923932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59973d3-6d53-4b5a-aa77-90d38ce95613 admin admin] PATH_INFO: `/v3/projects/8d69e45999354a4793c9d7c47d5ef644/users/12000cae065b4346a7a5e2705c23dab7/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:35.926164 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59973d3-6d53-4b5a-aa77-90d38ce95613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d69e45999354a4793c9d7c47d5ef644, user_id=12000cae065b4346a7a5e2705c23dab7, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:35.929009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59973d3-6d53-4b5a-aa77-90d38ce95613 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:35.940947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 998/2017] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:35 2021] PUT /identity/v3/projects/8d69e45999354a4793c9d7c47d5ef644/users/12000cae065b4346a7a5e2705c23dab7/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:35.952286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aedd3a-0915-4c11-9b1c-21d2b54434fe None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:35.952582 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aedd3a-0915-4c11-9b1c-21d2b54434fe None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:35.952847 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aedd3a-0915-4c11-9b1c-21d2b54434fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:35.988401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-38aedd3a-0915-4c11-9b1c-21d2b54434fe None None] MFA Rules not processed for user `12000cae065b4346a7a5e2705c23dab7`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:35.989736 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-38aedd3a-0915-4c11-9b1c-21d2b54434fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:36.098236 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1020/2018] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:35 2021] POST /identity/v3/auth/tokens => generated 3488 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:36.107887 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59973d3-6d53-4b5a-aa77-90d38ce95613 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:36.110605 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c59973d3-6d53-4b5a-aa77-90d38ce95613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:36.197815 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59973d3-6d53-4b5a-aa77-90d38ce95613 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:36.201885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39e477-0bd6-41c8-8e5b-0655fb1f004f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:36.202574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e477-0bd6-41c8-8e5b-0655fb1f004f service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:36.202854 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e477-0bd6-41c8-8e5b-0655fb1f004f service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:36.203126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e477-0bd6-41c8-8e5b-0655fb1f004f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:36.213580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39e477-0bd6-41c8-8e5b-0655fb1f004f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:36.215001 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39e477-0bd6-41c8-8e5b-0655fb1f004f service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:36.224937 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 999/2019] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:36 2021] GET /identity/v3/auth/tokens => generated 3488 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:36.415011 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aedd3a-0915-4c11-9b1c-21d2b54434fe None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:36.416620 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-38aedd3a-0915-4c11-9b1c-21d2b54434fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:36.486979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aedd3a-0915-4c11-9b1c-21d2b54434fe None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:36.491516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:36.492411 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:36.497239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:36.497239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0 admin admin] PATH_INFO: `/v3/projects/140de47c19b545518c3ef312dfa94c6e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:36.497239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=140de47c19b545518c3ef312dfa94c6e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:36.497239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:36.543113 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39e477-0bd6-41c8-8e5b-0655fb1f004f service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:36.553109 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39e477-0bd6-41c8-8e5b-0655fb1f004f service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:36.556851 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7b4d5-c4f4-4158-a0a8-69b605c553f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:36.557476 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7b4d5-c4f4-4158-a0a8-69b605c553f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:36.557778 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7b4d5-c4f4-4158-a0a8-69b605c553f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:36.558046 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7b4d5-c4f4-4158-a0a8-69b605c553f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:36.559864 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6ec7b4d5-c4f4-4158-a0a8-69b605c553f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:36.621941 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7b4d5-c4f4-4158-a0a8-69b605c553f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:36.623380 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7b4d5-c4f4-4158-a0a8-69b605c553f3 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:36.632652 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1000/2020] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:36 2021] GET /identity/v3/auth/tokens => generated 3421 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:30:36.654286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140de47c19b545518c3ef312dfa94c6e', 'request_id': 'req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:36.727544 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140de47c19b545518c3ef312dfa94c6e', 'request_id': 'req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:36.733595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140de47c19b545518c3ef312dfa94c6e', 'request_id': 'req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:36.745263 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0 admin admin] The token cache is being invalidate because project 140de47c19b545518c3ef312dfa94c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:36.745551 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:36.746244 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-0a6bdaa6-0d48-4ecd-bd56-23e7f02796f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:36.747792 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1021/2021] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:36 2021] DELETE /identity/v3/projects/140de47c19b545518c3ef312dfa94c6e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:36.755821 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254091e3-e1f1-47d9-abda-ef1f556fa9d0 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:36.763039 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254091e3-e1f1-47d9-abda-ef1f556fa9d0 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:36.763039 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254091e3-e1f1-47d9-abda-ef1f556fa9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:36.774834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-254091e3-e1f1-47d9-abda-ef1f556fa9d0 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:36.776070 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-254091e3-e1f1-47d9-abda-ef1f556fa9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:36.838606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1001/2022] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:36.847043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492ce98-2aa3-47bc-bff0-fe2a9bba8516 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:36.847312 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492ce98-2aa3-47bc-bff0-fe2a9bba8516 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:36.847656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492ce98-2aa3-47bc-bff0-fe2a9bba8516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:36.867629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-4492ce98-2aa3-47bc-bff0-fe2a9bba8516 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:36.869007 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4492ce98-2aa3-47bc-bff0-fe2a9bba8516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:37.176617 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1022/2023] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:37.179173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254091e3-e1f1-47d9-abda-ef1f556fa9d0 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:37.179173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254091e3-e1f1-47d9-abda-ef1f556fa9d0 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:37.179173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235345b-04c7-4c76-9035-ab152141d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:37.179173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235345b-04c7-4c76-9035-ab152141d29b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:37.181233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235345b-04c7-4c76-9035-ab152141d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:37.181233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235345b-04c7-4c76-9035-ab152141d29b admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:37.181233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235345b-04c7-4c76-9035-ab152141d29b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:30:37.181233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235345b-04c7-4c76-9035-ab152141d29b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:37.181233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235345b-04c7-4c76-9035-ab152141d29b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:37.181233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1002/2024] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:30:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:30:37.182472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492ce98-2aa3-47bc-bff0-fe2a9bba8516 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:37.182472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492ce98-2aa3-47bc-bff0-fe2a9bba8516 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:37.182472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcca36-37b6-40a3-82e0-f9b69b549ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:37.182472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcca36-37b6-40a3-82e0-f9b69b549ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:37.183327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcca36-37b6-40a3-82e0-f9b69b549ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:37.183327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcca36-37b6-40a3-82e0-f9b69b549ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:37.183327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcca36-37b6-40a3-82e0-f9b69b549ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:37.183327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcca36-37b6-40a3-82e0-f9b69b549ca4 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:37.249331 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1023/2025] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:36 2021] POST /identity/v3/projects => generated 381 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:37.255812 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235345b-04c7-4c76-9035-ab152141d29b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:37.268138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235345b-04c7-4c76-9035-ab152141d29b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:37.368841 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1440495-e2f3-4f0f-9230-e019d6dec1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:37.369540 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1440495-e2f3-4f0f-9230-e019d6dec1bf admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:37.370005 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1440495-e2f3-4f0f-9230-e019d6dec1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:37.370437 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1440495-e2f3-4f0f-9230-e019d6dec1bf admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:37.371359 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1440495-e2f3-4f0f-9230-e019d6dec1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:37.374299 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1440495-e2f3-4f0f-9230-e019d6dec1bf admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:37.506832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1003/2026] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:37 2021] POST /identity/v3/users => generated 291 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:37.510825 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcca36-37b6-40a3-82e0-f9b69b549ca4 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:37.521942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcca36-37b6-40a3-82e0-f9b69b549ca4 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:37.527208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ffff5-cd0b-48a2-8463-071590d44eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:37.527933 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ffff5-cd0b-48a2-8463-071590d44eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:37.528221 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ffff5-cd0b-48a2-8463-071590d44eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:37.528490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ffff5-cd0b-48a2-8463-071590d44eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:37.529245 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ffff5-cd0b-48a2-8463-071590d44eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:37.530824 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ffff5-cd0b-48a2-8463-071590d44eb8 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:37.542883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1024/2027] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:37 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:37.550824 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1440495-e2f3-4f0f-9230-e019d6dec1bf admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:37.561433 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1440495-e2f3-4f0f-9230-e019d6dec1bf admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:37.566738 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40b6f8-012f-468b-9430-0950d6650576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:37.567417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b6f8-012f-468b-9430-0950d6650576 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:37.567700 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b6f8-012f-468b-9430-0950d6650576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:37.568086 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b6f8-012f-468b-9430-0950d6650576 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:37.568832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40b6f8-012f-468b-9430-0950d6650576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:37.570407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40b6f8-012f-468b-9430-0950d6650576 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:37.582807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1004/2028] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:37 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:37.586066 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ffff5-cd0b-48a2-8463-071590d44eb8 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:37.597615 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ffff5-cd0b-48a2-8463-071590d44eb8 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:37.604686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04dfe1-8f7d-4eca-ad50-bff19c80f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:37.605859 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04dfe1-8f7d-4eca-ad50-bff19c80f81d admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:37.606275 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04dfe1-8f7d-4eca-ad50-bff19c80f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:37.606644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04dfe1-8f7d-4eca-ad50-bff19c80f81d admin admin] PATH_INFO: `/v3/projects/7aa66fedc6704473996d04ffbf8135e0/users/34ad077fd0164d3c8b4db14262186901/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:37.637832 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04dfe1-8f7d-4eca-ad50-bff19c80f81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa66fedc6704473996d04ffbf8135e0, user_id=34ad077fd0164d3c8b4db14262186901, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:37.663491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04dfe1-8f7d-4eca-ad50-bff19c80f81d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:37.803206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1025/2029] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:37 2021] PUT /identity/v3/projects/7aa66fedc6704473996d04ffbf8135e0/users/34ad077fd0164d3c8b4db14262186901/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:37.808311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced7c83-038e-4049-af65-a2f6435eff43 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:37.813204 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced7c83-038e-4049-af65-a2f6435eff43 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:37.813204 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced7c83-038e-4049-af65-a2f6435eff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:37.830108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-bced7c83-038e-4049-af65-a2f6435eff43 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:37.831644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-bced7c83-038e-4049-af65-a2f6435eff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:37.897996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1005/2030] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:37.911572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04dfe1-8f7d-4eca-ad50-bff19c80f81d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:37.913378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0b04dfe1-8f7d-4eca-ad50-bff19c80f81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:37.990674 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04dfe1-8f7d-4eca-ad50-bff19c80f81d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:37.994844 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9aa5f-cca3-47e3-896a-b64282ef1d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:37.995506 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9aa5f-cca3-47e3-896a-b64282ef1d8d service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:37.995821 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9aa5f-cca3-47e3-896a-b64282ef1d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:37.996100 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9aa5f-cca3-47e3-896a-b64282ef1d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:38.006469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9aa5f-cca3-47e3-896a-b64282ef1d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:38.007943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9aa5f-cca3-47e3-896a-b64282ef1d8d service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:38.019264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1026/2031] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:39.741687 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff2adf-67b4-44f7-b52b-f7762befdac0 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:39.742286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff2adf-67b4-44f7-b52b-f7762befdac0 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:39.742286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff2adf-67b4-44f7-b52b-f7762befdac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:39.777334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-09ff2adf-67b4-44f7-b52b-f7762befdac0 None None] MFA Rules not processed for user `34ad077fd0164d3c8b4db14262186901`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:39.778576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-09ff2adf-67b4-44f7-b52b-f7762befdac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:39.854672 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1006/2032] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:39 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:39.870101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9aa5f-cca3-47e3-896a-b64282ef1d8d service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:39.870101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-75a9aa5f-cca3-47e3-896a-b64282ef1d8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:39.930887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9aa5f-cca3-47e3-896a-b64282ef1d8d service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:39.934609 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b5df9-ffd8-443c-a084-1a7beaf6f549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:39.935257 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b5df9-ffd8-443c-a084-1a7beaf6f549 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:39.935536 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b5df9-ffd8-443c-a084-1a7beaf6f549 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:39.935847 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b5df9-ffd8-443c-a084-1a7beaf6f549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:39.946141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b5df9-ffd8-443c-a084-1a7beaf6f549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:39.947561 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b5df9-ffd8-443c-a084-1a7beaf6f549 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:39.957511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1027/2033] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:39 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:41.967875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb8bf0-e274-43b9-b1d4-06bbde8806ba None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:41.975306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb8bf0-e274-43b9-b1d4-06bbde8806ba None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:41.975306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb8bf0-e274-43b9-b1d4-06bbde8806ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:41.988263 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-8fbb8bf0-e274-43b9-b1d4-06bbde8806ba None None] MFA Rules not processed for user `34ad077fd0164d3c8b4db14262186901`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:41.989986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8fbb8bf0-e274-43b9-b1d4-06bbde8806ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:41.998225 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1007/2034] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:41 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:42.640412 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b5df9-ffd8-443c-a084-1a7beaf6f549 service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:42.641882 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-503b5df9-ffd8-443c-a084-1a7beaf6f549 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:42.657259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b5df9-ffd8-443c-a084-1a7beaf6f549 service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:42.667703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b945b-7fa7-4691-9645-76d55524e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:42.668625 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b945b-7fa7-4691-9645-76d55524e853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:42.668939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b945b-7fa7-4691-9645-76d55524e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:42.671482 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b945b-7fa7-4691-9645-76d55524e853 admin admin] PATH_INFO: `/v3/users/e9a153ddb2114f7db3dab3d079b8f44c` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:42.673732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b945b-7fa7-4691-9645-76d55524e853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a153ddb2114f7db3dab3d079b8f44c)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:42.675796 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b945b-7fa7-4691-9645-76d55524e853 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:42.892560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cf7b945b-7fa7-4691-9645-76d55524e853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a153ddb2114f7db3dab3d079b8f44c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:42.893237 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cf7b945b-7fa7-4691-9645-76d55524e853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a153ddb2114f7db3dab3d079b8f44c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:42.906796 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cf7b945b-7fa7-4691-9645-76d55524e853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a153ddb2114f7db3dab3d079b8f44c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:42.913811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cf7b945b-7fa7-4691-9645-76d55524e853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a153ddb2114f7db3dab3d079b8f44c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:43.024778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cf7b945b-7fa7-4691-9645-76d55524e853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a153ddb2114f7db3dab3d079b8f44c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:43.032374 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1028/2035] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:42 2021] DELETE /identity/v3/users/e9a153ddb2114f7db3dab3d079b8f44c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:43.038251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6adf9-d303-4df5-ae0c-a4ed736cb4a3 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:43.038251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6adf9-d303-4df5-ae0c-a4ed736cb4a3 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:43.038251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6adf9-d303-4df5-ae0c-a4ed736cb4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:43.056388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-e4f6adf9-d303-4df5-ae0c-a4ed736cb4a3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:43.057640 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e4f6adf9-d303-4df5-ae0c-a4ed736cb4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:43.127338 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1008/2036] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:43.139221 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b945b-7fa7-4691-9645-76d55524e853 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:43.143949 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-cf7b945b-7fa7-4691-9645-76d55524e853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:43.210462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b945b-7fa7-4691-9645-76d55524e853 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:43.214431 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302b085-4a0b-4028-97b1-f7a4f2d9b6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:43.215096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302b085-4a0b-4028-97b1-f7a4f2d9b6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:43.215378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302b085-4a0b-4028-97b1-f7a4f2d9b6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:43.215650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302b085-4a0b-4028-97b1-f7a4f2d9b6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:43.227132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302b085-4a0b-4028-97b1-f7a4f2d9b6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:43.228664 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302b085-4a0b-4028-97b1-f7a4f2d9b6f9 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:43.239093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1029/2037] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:43.683075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6adf9-d303-4df5-ae0c-a4ed736cb4a3 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:43.684538 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e4f6adf9-d303-4df5-ae0c-a4ed736cb4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:43.698010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6adf9-d303-4df5-ae0c-a4ed736cb4a3 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:43.703883 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:43.704738 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:43.705080 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:43.705411 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] PATH_INFO: `/v3/projects/cf296814ec5c485e808414173d27f5ee` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:43.707395 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf296814ec5c485e808414173d27f5ee)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:43.709613 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:43.851072 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf296814ec5c485e808414173d27f5ee', 'request_id': 'req-afbbb8dc-de35-4089-ae99-50852fb3c639'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:43.925929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf296814ec5c485e808414173d27f5ee', 'request_id': 'req-afbbb8dc-de35-4089-ae99-50852fb3c639'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:43.944253 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf296814ec5c485e808414173d27f5ee', 'request_id': 'req-afbbb8dc-de35-4089-ae99-50852fb3c639'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:43.958872 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] The token cache is being invalidate because project cf296814ec5c485e808414173d27f5ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:43.960846 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:43.970010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:43.970010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1009/2038] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:43 2021] DELETE /identity/v3/projects/cf296814ec5c485e808414173d27f5ee => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:43.970219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302b085-4a0b-4028-97b1-f7a4f2d9b6f9 service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:43.980583 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302b085-4a0b-4028-97b1-f7a4f2d9b6f9 service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:44.057187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86def522-7b7e-407e-bdb9-569f2cf21768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:44.057187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def522-7b7e-407e-bdb9-569f2cf21768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:44.057187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def522-7b7e-407e-bdb9-569f2cf21768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:44.057187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def522-7b7e-407e-bdb9-569f2cf21768 admin admin] PATH_INFO: `/v3/users/12000cae065b4346a7a5e2705c23dab7` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:44.057691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86def522-7b7e-407e-bdb9-569f2cf21768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12000cae065b4346a7a5e2705c23dab7)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:44.059377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86def522-7b7e-407e-bdb9-569f2cf21768 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:44.283370 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-86def522-7b7e-407e-bdb9-569f2cf21768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12000cae065b4346a7a5e2705c23dab7'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:44.284084 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-86def522-7b7e-407e-bdb9-569f2cf21768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12000cae065b4346a7a5e2705c23dab7'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:44.304021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-86def522-7b7e-407e-bdb9-569f2cf21768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12000cae065b4346a7a5e2705c23dab7'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:44.314224 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-86def522-7b7e-407e-bdb9-569f2cf21768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12000cae065b4346a7a5e2705c23dab7'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:44.361840 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-86def522-7b7e-407e-bdb9-569f2cf21768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12000cae065b4346a7a5e2705c23dab7'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:44.369511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1030/2039] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:43 2021] DELETE /identity/v3/users/12000cae065b4346a7a5e2705c23dab7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:44.775918 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:44.776796 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:44.792776 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbb8dc-de35-4089-ae99-50852fb3c639 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:44.856401 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872665b4-a1cc-4eab-9e5b-cf3b96249de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:44.857189 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872665b4-a1cc-4eab-9e5b-cf3b96249de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:44.857457 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872665b4-a1cc-4eab-9e5b-cf3b96249de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:44.857734 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872665b4-a1cc-4eab-9e5b-cf3b96249de0 admin admin] PATH_INFO: `/v3/projects/8d69e45999354a4793c9d7c47d5ef644` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:44.858972 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872665b4-a1cc-4eab-9e5b-cf3b96249de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d69e45999354a4793c9d7c47d5ef644)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:44.861393 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872665b4-a1cc-4eab-9e5b-cf3b96249de0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:45.131016 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-872665b4-a1cc-4eab-9e5b-cf3b96249de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d69e45999354a4793c9d7c47d5ef644', 'request_id': 'req-872665b4-a1cc-4eab-9e5b-cf3b96249de0'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:45.242141 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-872665b4-a1cc-4eab-9e5b-cf3b96249de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d69e45999354a4793c9d7c47d5ef644', 'request_id': 'req-872665b4-a1cc-4eab-9e5b-cf3b96249de0'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:45.248412 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-872665b4-a1cc-4eab-9e5b-cf3b96249de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d69e45999354a4793c9d7c47d5ef644', 'request_id': 'req-872665b4-a1cc-4eab-9e5b-cf3b96249de0'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:45.260391 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-872665b4-a1cc-4eab-9e5b-cf3b96249de0 admin admin] The token cache is being invalidate because project 8d69e45999354a4793c9d7c47d5ef644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:45.260667 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-872665b4-a1cc-4eab-9e5b-cf3b96249de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:45.261350 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-872665b4-a1cc-4eab-9e5b-cf3b96249de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:45.262881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1010/2040] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:44 2021] DELETE /identity/v3/projects/8d69e45999354a4793c9d7c47d5ef644 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:45.269131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d5c16-ff99-484a-b5d4-6df91f5096b3 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:45.269640 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d5c16-ff99-484a-b5d4-6df91f5096b3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:45.269719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d5c16-ff99-484a-b5d4-6df91f5096b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:45.289419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-443d5c16-ff99-484a-b5d4-6df91f5096b3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:45.290630 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-443d5c16-ff99-484a-b5d4-6df91f5096b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:45.373549 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1031/2041] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:45.375330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831443b-cee4-4265-a3f0-7f9374862aeb None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:45.375800 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831443b-cee4-4265-a3f0-7f9374862aeb None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:45.376133 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831443b-cee4-4265-a3f0-7f9374862aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:45.396356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-4831443b-cee4-4265-a3f0-7f9374862aeb None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:45.397628 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4831443b-cee4-4265-a3f0-7f9374862aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:45.407272 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1011/2042] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:45.412535 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d5c16-ff99-484a-b5d4-6df91f5096b3 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:45.425197 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d5c16-ff99-484a-b5d4-6df91f5096b3 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:45.432713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a9a9a-b100-4cfe-8f8c-7e1ca91d440e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:45.433697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a9a9a-b100-4cfe-8f8c-7e1ca91d440e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:45.434167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a9a9a-b100-4cfe-8f8c-7e1ca91d440e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:45.434761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a9a9a-b100-4cfe-8f8c-7e1ca91d440e admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:45.435773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a9a9a-b100-4cfe-8f8c-7e1ca91d440e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:30:45.436240 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a9a9a-b100-4cfe-8f8c-7e1ca91d440e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:45.438584 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a9a9a-b100-4cfe-8f8c-7e1ca91d440e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:45.461504 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1032/2043] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:30:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:30:45.465660 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831443b-cee4-4265-a3f0-7f9374862aeb None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:45.478000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831443b-cee4-4265-a3f0-7f9374862aeb None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:45.500553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a686c-3e1f-4aef-9818-51031e514e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:45.501453 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a686c-3e1f-4aef-9818-51031e514e28 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:45.502657 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a686c-3e1f-4aef-9818-51031e514e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:45.503166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a686c-3e1f-4aef-9818-51031e514e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:45.503951 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a686c-3e1f-4aef-9818-51031e514e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:45.506341 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a686c-3e1f-4aef-9818-51031e514e28 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:45.654308 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a9a9a-b100-4cfe-8f8c-7e1ca91d440e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:45.664318 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1012/2044] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:45 2021] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:45.671039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a9a9a-b100-4cfe-8f8c-7e1ca91d440e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:45.792510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422efc12-e08b-4c49-90f0-0c716acc6a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:45.793208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422efc12-e08b-4c49-90f0-0c716acc6a2e admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:45.823413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422efc12-e08b-4c49-90f0-0c716acc6a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:45.823413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422efc12-e08b-4c49-90f0-0c716acc6a2e admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:45.823413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422efc12-e08b-4c49-90f0-0c716acc6a2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:45.823413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422efc12-e08b-4c49-90f0-0c716acc6a2e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:45.923946 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1033/2045] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:45 2021] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:45.929885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a686c-3e1f-4aef-9818-51031e514e28 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:45.939012 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a686c-3e1f-4aef-9818-51031e514e28 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:45.945313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7dd3cb-2c37-4495-bc5e-b155fd8c2400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:45.945995 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dd3cb-2c37-4495-bc5e-b155fd8c2400 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:45.946272 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dd3cb-2c37-4495-bc5e-b155fd8c2400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:45.946547 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dd3cb-2c37-4495-bc5e-b155fd8c2400 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:45.947295 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7dd3cb-2c37-4495-bc5e-b155fd8c2400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:45.948901 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7dd3cb-2c37-4495-bc5e-b155fd8c2400 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:45.960620 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1013/2046] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:45 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:45.964978 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422efc12-e08b-4c49-90f0-0c716acc6a2e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:45.993299 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422efc12-e08b-4c49-90f0-0c716acc6a2e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:46.002247 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a5f71-0406-44b5-bab7-02ba9bcc72f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:46.002994 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a5f71-0406-44b5-bab7-02ba9bcc72f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:46.007802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a5f71-0406-44b5-bab7-02ba9bcc72f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:46.007802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a5f71-0406-44b5-bab7-02ba9bcc72f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:46.007802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a5f71-0406-44b5-bab7-02ba9bcc72f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:46.007802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a5f71-0406-44b5-bab7-02ba9bcc72f1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:46.032456 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1034/2047] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:45 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:46.033445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7dd3cb-2c37-4495-bc5e-b155fd8c2400 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:46.052598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7dd3cb-2c37-4495-bc5e-b155fd8c2400 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:46.052598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93195b3f-ba3c-4c03-b8e8-c2f375180455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:46.053295 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93195b3f-ba3c-4c03-b8e8-c2f375180455 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:46.053375 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93195b3f-ba3c-4c03-b8e8-c2f375180455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:46.053620 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93195b3f-ba3c-4c03-b8e8-c2f375180455 admin admin] PATH_INFO: `/v3/projects/7b80361ca0f346139d3a619681eb9e1e/users/effb0fa414a444b1baa680e052c52c9c/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:46.081214 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93195b3f-ba3c-4c03-b8e8-c2f375180455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b80361ca0f346139d3a619681eb9e1e, user_id=effb0fa414a444b1baa680e052c52c9c, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:46.084096 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93195b3f-ba3c-4c03-b8e8-c2f375180455 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:46.252266 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1014/2048] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:46 2021] PUT /identity/v3/projects/7b80361ca0f346139d3a619681eb9e1e/users/effb0fa414a444b1baa680e052c52c9c/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:46.263072 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e916f8-6f29-4106-ac0e-15b4b56cd56b None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:46.263366 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e916f8-6f29-4106-ac0e-15b4b56cd56b None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:46.264750 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e916f8-6f29-4106-ac0e-15b4b56cd56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:46.294349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-b3e916f8-6f29-4106-ac0e-15b4b56cd56b None None] MFA Rules not processed for user `effb0fa414a444b1baa680e052c52c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:46.299025 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b3e916f8-6f29-4106-ac0e-15b4b56cd56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:46.381091 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1035/2049] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:46 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:46.385541 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93195b3f-ba3c-4c03-b8e8-c2f375180455 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:46.477091 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93195b3f-ba3c-4c03-b8e8-c2f375180455 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:46.482793 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a8804-6cca-4f67-9978-61177afbcc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:46.487950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a8804-6cca-4f67-9978-61177afbcc38 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:46.487950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a8804-6cca-4f67-9978-61177afbcc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:46.487950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a8804-6cca-4f67-9978-61177afbcc38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:46.487950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a8804-6cca-4f67-9978-61177afbcc38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:46.487950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a8804-6cca-4f67-9978-61177afbcc38 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:46.573031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1015/2050] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:46 2021] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:46.574889 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e916f8-6f29-4106-ac0e-15b4b56cd56b None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:46.614098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e916f8-6f29-4106-ac0e-15b4b56cd56b None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:46.702834 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7e2a3-54fc-4492-bb54-635f779eaaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:46.704261 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7e2a3-54fc-4492-bb54-635f779eaaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:46.704701 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7e2a3-54fc-4492-bb54-635f779eaaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:46.705058 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7e2a3-54fc-4492-bb54-635f779eaaf0 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:46.706329 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7e2a3-54fc-4492-bb54-635f779eaaf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:46.709182 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7e2a3-54fc-4492-bb54-635f779eaaf0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:46.827621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1036/2051] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:46 2021] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:46.832049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a8804-6cca-4f67-9978-61177afbcc38 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:46.850836 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a8804-6cca-4f67-9978-61177afbcc38 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:46.857847 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac56f0b-ae2b-4a33-8a07-c6a90c208310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:46.858688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac56f0b-ae2b-4a33-8a07-c6a90c208310 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:46.859132 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac56f0b-ae2b-4a33-8a07-c6a90c208310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:46.860071 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac56f0b-ae2b-4a33-8a07-c6a90c208310 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:46.860928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac56f0b-ae2b-4a33-8a07-c6a90c208310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:46.862776 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac56f0b-ae2b-4a33-8a07-c6a90c208310 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:46.878252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1016/2052] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:46 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:46.879950 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7e2a3-54fc-4492-bb54-635f779eaaf0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:46.898175 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7e2a3-54fc-4492-bb54-635f779eaaf0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:46.904025 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee51fb-7577-4428-8fd9-ee3f5c916184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:46.905246 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee51fb-7577-4428-8fd9-ee3f5c916184 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:46.905668 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee51fb-7577-4428-8fd9-ee3f5c916184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:46.906669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee51fb-7577-4428-8fd9-ee3f5c916184 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:46.908141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee51fb-7577-4428-8fd9-ee3f5c916184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:46.910026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee51fb-7577-4428-8fd9-ee3f5c916184 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:46.921777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1037/2053] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:46 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:46.927439 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac56f0b-ae2b-4a33-8a07-c6a90c208310 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:46.940101 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac56f0b-ae2b-4a33-8a07-c6a90c208310 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:46.950668 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723a9d0-8063-4773-a6e7-fc36a93e75f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:46.953527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723a9d0-8063-4773-a6e7-fc36a93e75f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:46.953527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723a9d0-8063-4773-a6e7-fc36a93e75f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:46.953527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723a9d0-8063-4773-a6e7-fc36a93e75f0 admin admin] PATH_INFO: `/v3/projects/14806da60008444ba3d0e535c2ce329e/users/f759bdf767ac430bb771d91f1b777b97/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:46.986845 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723a9d0-8063-4773-a6e7-fc36a93e75f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14806da60008444ba3d0e535c2ce329e, user_id=f759bdf767ac430bb771d91f1b777b97, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:46.990191 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723a9d0-8063-4773-a6e7-fc36a93e75f0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:47.088829 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1017/2054] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:46 2021] PUT /identity/v3/projects/14806da60008444ba3d0e535c2ce329e/users/f759bdf767ac430bb771d91f1b777b97/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:47.106375 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e592932-f881-45ea-9472-6fb40b05a6f0 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:47.106659 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e592932-f881-45ea-9472-6fb40b05a6f0 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:47.106934 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e592932-f881-45ea-9472-6fb40b05a6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:47.162675 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8e592932-f881-45ea-9472-6fb40b05a6f0 None None] MFA Rules not processed for user `f759bdf767ac430bb771d91f1b777b97`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:47.163542 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8e592932-f881-45ea-9472-6fb40b05a6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:47.254214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1038/2055] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:47 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:47.259312 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723a9d0-8063-4773-a6e7-fc36a93e75f0 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:47.348251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723a9d0-8063-4773-a6e7-fc36a93e75f0 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:47.350161 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25340ef3-a0b5-4fcc-a3f8-c1ebbb331461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:47.350933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25340ef3-a0b5-4fcc-a3f8-c1ebbb331461 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:47.351212 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25340ef3-a0b5-4fcc-a3f8-c1ebbb331461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:47.351483 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25340ef3-a0b5-4fcc-a3f8-c1ebbb331461 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:47.352248 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25340ef3-a0b5-4fcc-a3f8-c1ebbb331461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:47.354152 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25340ef3-a0b5-4fcc-a3f8-c1ebbb331461 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:47.513997 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1018/2056] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:47 2021] POST /identity/v3/projects => generated 379 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:47.518638 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e592932-f881-45ea-9472-6fb40b05a6f0 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:47.539689 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e592932-f881-45ea-9472-6fb40b05a6f0 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:47.639667 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9b198-748f-4166-b834-e1c2d1f1c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:47.641722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9b198-748f-4166-b834-e1c2d1f1c2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:47.642110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9b198-748f-4166-b834-e1c2d1f1c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:47.642490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9b198-748f-4166-b834-e1c2d1f1c2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:47.644179 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9b198-748f-4166-b834-e1c2d1f1c2f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:47.646171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9b198-748f-4166-b834-e1c2d1f1c2f3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:47.775702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1039/2057] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:47 2021] POST /identity/v3/users => generated 296 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:47.779446 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25340ef3-a0b5-4fcc-a3f8-c1ebbb331461 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:47.791313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25340ef3-a0b5-4fcc-a3f8-c1ebbb331461 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:47.804567 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4d087-e5b0-4273-9d13-18724e48190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:47.807464 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4d087-e5b0-4273-9d13-18724e48190e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:47.807464 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4d087-e5b0-4273-9d13-18724e48190e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:47.807464 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4d087-e5b0-4273-9d13-18724e48190e admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:47.807464 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4d087-e5b0-4273-9d13-18724e48190e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:47.815650 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4d087-e5b0-4273-9d13-18724e48190e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:47.835098 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1019/2058] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:47 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:30:47.841867 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9b198-748f-4166-b834-e1c2d1f1c2f3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:47.859076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9b198-748f-4166-b834-e1c2d1f1c2f3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:47.865227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f9f2d-0b9a-4e06-bb62-b1bcd551978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:47.866377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f9f2d-0b9a-4e06-bb62-b1bcd551978b admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:47.866824 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f9f2d-0b9a-4e06-bb62-b1bcd551978b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:47.867242 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f9f2d-0b9a-4e06-bb62-b1bcd551978b admin admin] PATH_INFO: `/v3/projects/c90b3ed70f2044b8890acd411860354f/users/a0345212622b4a83880ba397e902d69e/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:48.020369 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f9f2d-0b9a-4e06-bb62-b1bcd551978b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c90b3ed70f2044b8890acd411860354f, user_id=a0345212622b4a83880ba397e902d69e, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:48.022983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f9f2d-0b9a-4e06-bb62-b1bcd551978b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:48.150748 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1040/2059] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:47 2021] PUT /identity/v3/projects/c90b3ed70f2044b8890acd411860354f/users/a0345212622b4a83880ba397e902d69e/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:48.154722 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4d087-e5b0-4273-9d13-18724e48190e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:48.170061 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4d087-e5b0-4273-9d13-18724e48190e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:48.265063 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa349c47-2918-4745-ba97-74c7f23f1126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:48.266212 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa349c47-2918-4745-ba97-74c7f23f1126 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:48.269743 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa349c47-2918-4745-ba97-74c7f23f1126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:48.269743 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa349c47-2918-4745-ba97-74c7f23f1126 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:48.269743 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa349c47-2918-4745-ba97-74c7f23f1126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:48.269743 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa349c47-2918-4745-ba97-74c7f23f1126 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:48.283258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1020/2060] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:48 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:48.288944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f9f2d-0b9a-4e06-bb62-b1bcd551978b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:48.310573 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f9f2d-0b9a-4e06-bb62-b1bcd551978b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:48.318785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229757d-d699-4407-abdd-b78980859f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:48.320202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229757d-d699-4407-abdd-b78980859f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:48.320630 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229757d-d699-4407-abdd-b78980859f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:48.321040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229757d-d699-4407-abdd-b78980859f57 admin admin] PATH_INFO: `/v3/projects/c90b3ed70f2044b8890acd411860354f/users/a0345212622b4a83880ba397e902d69e/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:48.324043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229757d-d699-4407-abdd-b78980859f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c90b3ed70f2044b8890acd411860354f, user_id=a0345212622b4a83880ba397e902d69e, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:48.332843 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229757d-d699-4407-abdd-b78980859f57 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:48.377429 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1041/2061] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:48 2021] PUT /identity/v3/projects/c90b3ed70f2044b8890acd411860354f/users/a0345212622b4a83880ba397e902d69e/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:48.377995 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5d500-2923-4ed7-a9e8-8dbce2d0cb6f None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:48.377995 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5d500-2923-4ed7-a9e8-8dbce2d0cb6f None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:48.377995 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5d500-2923-4ed7-a9e8-8dbce2d0cb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:48.419338 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-85f5d500-2923-4ed7-a9e8-8dbce2d0cb6f None None] MFA Rules not processed for user `a0345212622b4a83880ba397e902d69e`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:48.421175 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-85f5d500-2923-4ed7-a9e8-8dbce2d0cb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:48.536591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1021/2062] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:48 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:48.545618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229757d-d699-4407-abdd-b78980859f57 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:48.549403 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0229757d-d699-4407-abdd-b78980859f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:48.646382 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229757d-d699-4407-abdd-b78980859f57 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:48.650340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc036643-8de5-4a9c-a4c8-4ca255d1745c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:48.651007 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc036643-8de5-4a9c-a4c8-4ca255d1745c service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:48.651535 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc036643-8de5-4a9c-a4c8-4ca255d1745c service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:48.652026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc036643-8de5-4a9c-a4c8-4ca255d1745c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:48.663134 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc036643-8de5-4a9c-a4c8-4ca255d1745c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:48.664542 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc036643-8de5-4a9c-a4c8-4ca255d1745c service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:48.679479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1042/2063] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:48 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:48.795682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5d500-2923-4ed7-a9e8-8dbce2d0cb6f None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:48.807187 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5d500-2923-4ed7-a9e8-8dbce2d0cb6f None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:48.811852 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27489fc4-553a-4644-9307-f4a7b172970e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:48.812688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27489fc4-553a-4644-9307-f4a7b172970e service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:48.813068 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27489fc4-553a-4644-9307-f4a7b172970e service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:48.813601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27489fc4-553a-4644-9307-f4a7b172970e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:48.884729 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27489fc4-553a-4644-9307-f4a7b172970e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:48.886261 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27489fc4-553a-4644-9307-f4a7b172970e service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:48.905769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1022/2064] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:48 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:52.703803 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc036643-8de5-4a9c-a4c8-4ca255d1745c service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:52.708735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-fc036643-8de5-4a9c-a4c8-4ca255d1745c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:52.797401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc036643-8de5-4a9c-a4c8-4ca255d1745c service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:52.804608 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d46266-c51f-4aae-82ed-4d3d9b4a595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:52.805633 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d46266-c51f-4aae-82ed-4d3d9b4a595f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:52.805975 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d46266-c51f-4aae-82ed-4d3d9b4a595f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:52.806322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d46266-c51f-4aae-82ed-4d3d9b4a595f admin admin] PATH_INFO: `/v3/users/de0d3f1b3edb4f40ba2c4d9253f33d9f` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:52.807593 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d46266-c51f-4aae-82ed-4d3d9b4a595f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0d3f1b3edb4f40ba2c4d9253f33d9f)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:52.810314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d46266-c51f-4aae-82ed-4d3d9b4a595f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:53.193299 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-41d46266-c51f-4aae-82ed-4d3d9b4a595f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0d3f1b3edb4f40ba2c4d9253f33d9f'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:53.193949 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-41d46266-c51f-4aae-82ed-4d3d9b4a595f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0d3f1b3edb4f40ba2c4d9253f33d9f'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:53.206369 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-41d46266-c51f-4aae-82ed-4d3d9b4a595f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0d3f1b3edb4f40ba2c4d9253f33d9f'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:53.213918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-41d46266-c51f-4aae-82ed-4d3d9b4a595f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0d3f1b3edb4f40ba2c4d9253f33d9f'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:53.327031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-41d46266-c51f-4aae-82ed-4d3d9b4a595f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0d3f1b3edb4f40ba2c4d9253f33d9f'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:53.334008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1043/2065] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:52 2021] DELETE /identity/v3/users/de0d3f1b3edb4f40ba2c4d9253f33d9f => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:53.348180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168bfd-090d-446f-bb09-99d8b26e08b1 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:53.348739 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168bfd-090d-446f-bb09-99d8b26e08b1 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:53.349230 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168bfd-090d-446f-bb09-99d8b26e08b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:53.369697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d2168bfd-090d-446f-bb09-99d8b26e08b1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:53.370941 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d2168bfd-090d-446f-bb09-99d8b26e08b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:53.438683 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1023/2066] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:53.445598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d46266-c51f-4aae-82ed-4d3d9b4a595f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:53.447390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-41d46266-c51f-4aae-82ed-4d3d9b4a595f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:53.534698 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d46266-c51f-4aae-82ed-4d3d9b4a595f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:53.542320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0aa72e-3fc9-4a3f-9a06-4aad0bb7aaac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:53.542320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0aa72e-3fc9-4a3f-9a06-4aad0bb7aaac service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:53.542320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0aa72e-3fc9-4a3f-9a06-4aad0bb7aaac service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:53.542320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0aa72e-3fc9-4a3f-9a06-4aad0bb7aaac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:53.557530 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0aa72e-3fc9-4a3f-9a06-4aad0bb7aaac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:53.559316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0aa72e-3fc9-4a3f-9a06-4aad0bb7aaac service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:53.570693 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1044/2067] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:30:54.211041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2168bfd-090d-446f-bb09-99d8b26e08b1 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:54.212677 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d2168bfd-090d-446f-bb09-99d8b26e08b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:54.226607 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2168bfd-090d-446f-bb09-99d8b26e08b1 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:54.241818 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:54.243074 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:54.243794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:54.244257 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] PATH_INFO: `/v3/projects/9a7997fee37f485da64866bc2db4f08c` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:54.246540 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a7997fee37f485da64866bc2db4f08c)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:54.251886 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:54.409806 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a7997fee37f485da64866bc2db4f08c', 'request_id': 'req-6b6e93fd-0081-467e-b5c7-caad31dfb26d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:54.505150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a7997fee37f485da64866bc2db4f08c', 'request_id': 'req-6b6e93fd-0081-467e-b5c7-caad31dfb26d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:54.512696 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a7997fee37f485da64866bc2db4f08c', 'request_id': 'req-6b6e93fd-0081-467e-b5c7-caad31dfb26d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:54.527376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] The token cache is being invalidate because project 9a7997fee37f485da64866bc2db4f08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:54.527561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:54.528223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:54.530433 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1024/2068] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:54 2021] DELETE /identity/v3/projects/9a7997fee37f485da64866bc2db4f08c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:54.534516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0aa72e-3fc9-4a3f-9a06-4aad0bb7aaac service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:54.557004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0aa72e-3fc9-4a3f-9a06-4aad0bb7aaac service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:54.630321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f35383-e053-4f51-91a6-6ceeda14a509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:54.630321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f35383-e053-4f51-91a6-6ceeda14a509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:54.630321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f35383-e053-4f51-91a6-6ceeda14a509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:54.630321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f35383-e053-4f51-91a6-6ceeda14a509 admin admin] PATH_INFO: `/v3/users/9b64442da80f43f185879277c6e1398e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:54.630622 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f35383-e053-4f51-91a6-6ceeda14a509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b64442da80f43f185879277c6e1398e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:54.631856 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f35383-e053-4f51-91a6-6ceeda14a509 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:54.889723 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c5f35383-e053-4f51-91a6-6ceeda14a509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b64442da80f43f185879277c6e1398e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:54.890966 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c5f35383-e053-4f51-91a6-6ceeda14a509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b64442da80f43f185879277c6e1398e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:54.903070 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c5f35383-e053-4f51-91a6-6ceeda14a509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b64442da80f43f185879277c6e1398e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:54.910617 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c5f35383-e053-4f51-91a6-6ceeda14a509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b64442da80f43f185879277c6e1398e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:54.984476 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c5f35383-e053-4f51-91a6-6ceeda14a509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b64442da80f43f185879277c6e1398e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:55.000213 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1045/2069] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:54 2021] DELETE /identity/v3/users/9b64442da80f43f185879277c6e1398e => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:55.261317 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:55.263088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:55.285755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e93fd-0081-467e-b5c7-caad31dfb26d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:55.374838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31230c-532d-42e9-8edf-2e571edc9555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:55.376587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31230c-532d-42e9-8edf-2e571edc9555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:55.379552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31230c-532d-42e9-8edf-2e571edc9555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:55.379552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31230c-532d-42e9-8edf-2e571edc9555 admin admin] PATH_INFO: `/v3/users/effb0fa414a444b1baa680e052c52c9c` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:55.379552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31230c-532d-42e9-8edf-2e571edc9555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=effb0fa414a444b1baa680e052c52c9c)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:55.382040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31230c-532d-42e9-8edf-2e571edc9555 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:55.579354 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8a31230c-532d-42e9-8edf-2e571edc9555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'effb0fa414a444b1baa680e052c52c9c'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:55.587925 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8a31230c-532d-42e9-8edf-2e571edc9555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'effb0fa414a444b1baa680e052c52c9c'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:55.588789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8a31230c-532d-42e9-8edf-2e571edc9555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'effb0fa414a444b1baa680e052c52c9c'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:55.598665 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f35383-e053-4f51-91a6-6ceeda14a509 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:55.601464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c5f35383-e053-4f51-91a6-6ceeda14a509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:55.611320 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8a31230c-532d-42e9-8edf-2e571edc9555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'effb0fa414a444b1baa680e052c52c9c'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:55.632170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f35383-e053-4f51-91a6-6ceeda14a509 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:55.637497 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:55.638359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:55.638669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:55.638952 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1 admin admin] PATH_INFO: `/v3/projects/f9fe319fb80942398e3f7b935beb7262` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:55.640256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9fe319fb80942398e3f7b935beb7262)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:55.643141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:55.675915 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8a31230c-532d-42e9-8edf-2e571edc9555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'effb0fa414a444b1baa680e052c52c9c'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:55.683469 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1025/2070] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:55 2021] DELETE /identity/v3/users/effb0fa414a444b1baa680e052c52c9c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:55.688562 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efe839-5e1b-4621-b479-755aa5be8df0 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:55.689135 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efe839-5e1b-4621-b479-755aa5be8df0 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:55.689516 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efe839-5e1b-4621-b479-755aa5be8df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:55.709714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-25efe839-5e1b-4621-b479-755aa5be8df0 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:55.711334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-25efe839-5e1b-4621-b479-755aa5be8df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:55.799881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1026/2071] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:55.806599 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9fe319fb80942398e3f7b935beb7262', 'request_id': 'req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:55.817398 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efe839-5e1b-4621-b479-755aa5be8df0 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:55.820206 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-25efe839-5e1b-4621-b479-755aa5be8df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:55.898569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9fe319fb80942398e3f7b935beb7262', 'request_id': 'req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:55.913075 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9fe319fb80942398e3f7b935beb7262', 'request_id': 'req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:55.942664 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1 admin admin] The token cache is being invalidate because project f9fe319fb80942398e3f7b935beb7262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:55.943026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:55.943777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-0a7dbf9f-41c3-4f6e-8c0a-1e67f754a1d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:55.946040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1046/2072] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:55 2021] DELETE /identity/v3/projects/f9fe319fb80942398e3f7b935beb7262 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:55.954489 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efe839-5e1b-4621-b479-755aa5be8df0 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:55.958479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15e2ca-87d7-4036-bd1f-58caa1e2045d None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:55.958769 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15e2ca-87d7-4036-bd1f-58caa1e2045d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:55.959042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15e2ca-87d7-4036-bd1f-58caa1e2045d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:56.045436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8f15e2ca-87d7-4036-bd1f-58caa1e2045d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:56.046316 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8c0cf-7248-474d-9472-ad8d803f1d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:56.047764 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8c0cf-7248-474d-9472-ad8d803f1d7d service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:56.048341 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8c0cf-7248-474d-9472-ad8d803f1d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:56.048826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8c0cf-7248-474d-9472-ad8d803f1d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:56.050298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8f15e2ca-87d7-4036-bd1f-58caa1e2045d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:56.051875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-fdf8c0cf-7248-474d-9472-ad8d803f1d7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:56.146701 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8c0cf-7248-474d-9472-ad8d803f1d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:56.148195 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8c0cf-7248-474d-9472-ad8d803f1d7d service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:56.163471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1027/2073] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:56.180311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1047/2074] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:56.188745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27661ce7-7801-46df-9b63-caf9dc9df5b9 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:56.189052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27661ce7-7801-46df-9b63-caf9dc9df5b9 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:56.189329 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27661ce7-7801-46df-9b63-caf9dc9df5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:56.208469 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-27661ce7-7801-46df-9b63-caf9dc9df5b9 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:56.209803 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-27661ce7-7801-46df-9b63-caf9dc9df5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:56.220109 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1028/2075] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:56.224653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15e2ca-87d7-4036-bd1f-58caa1e2045d None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:56.234925 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15e2ca-87d7-4036-bd1f-58caa1e2045d None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:56.246614 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8131900-323b-4861-a3ec-ee5ad3241f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:56.248543 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8131900-323b-4861-a3ec-ee5ad3241f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:56.249342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8131900-323b-4861-a3ec-ee5ad3241f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:56.252133 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8131900-323b-4861-a3ec-ee5ad3241f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:56.258044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8131900-323b-4861-a3ec-ee5ad3241f30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:30:56.258044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8131900-323b-4861-a3ec-ee5ad3241f30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:56.258044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8131900-323b-4861-a3ec-ee5ad3241f30 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:56.273314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1048/2076] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:30:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:30:56.278484 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27661ce7-7801-46df-9b63-caf9dc9df5b9 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:56.289557 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27661ce7-7801-46df-9b63-caf9dc9df5b9 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:56.304288 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf16906-6c29-4021-af97-a00f25094e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:56.305004 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf16906-6c29-4021-af97-a00f25094e5f admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:56.309441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf16906-6c29-4021-af97-a00f25094e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:56.309441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf16906-6c29-4021-af97-a00f25094e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:56.309441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf16906-6c29-4021-af97-a00f25094e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:56.309441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf16906-6c29-4021-af97-a00f25094e5f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:56.438618 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1029/2077] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:56 2021] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:56.439510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8131900-323b-4861-a3ec-ee5ad3241f30 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:56.449868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8131900-323b-4861-a3ec-ee5ad3241f30 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:56.573809 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c67e6b-cef5-4793-a2b3-cee073c4d682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:56.575132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c67e6b-cef5-4793-a2b3-cee073c4d682 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:56.575793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c67e6b-cef5-4793-a2b3-cee073c4d682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:56.576122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c67e6b-cef5-4793-a2b3-cee073c4d682 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:56.577051 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c67e6b-cef5-4793-a2b3-cee073c4d682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:56.580584 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c67e6b-cef5-4793-a2b3-cee073c4d682 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:56.707579 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1049/2078] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:56 2021] POST /identity/v3/users => generated 285 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:30:56.709248 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf16906-6c29-4021-af97-a00f25094e5f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:56.720808 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf16906-6c29-4021-af97-a00f25094e5f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:56.725760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99124b4-e66e-40dc-bb30-0de7ee1bb86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:56.726419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99124b4-e66e-40dc-bb30-0de7ee1bb86d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:56.727378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99124b4-e66e-40dc-bb30-0de7ee1bb86d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:56.727684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99124b4-e66e-40dc-bb30-0de7ee1bb86d admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:56.728535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99124b4-e66e-40dc-bb30-0de7ee1bb86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:56.730110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99124b4-e66e-40dc-bb30-0de7ee1bb86d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:56.746570 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c67e6b-cef5-4793-a2b3-cee073c4d682 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:56.750514 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1030/2079] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:56 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:56.752782 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d6c67e6b-cef5-4793-a2b3-cee073c4d682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:56.758490 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99124b4-e66e-40dc-bb30-0de7ee1bb86d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:56.776792 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c67e6b-cef5-4793-a2b3-cee073c4d682 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:56.784881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99124b4-e66e-40dc-bb30-0de7ee1bb86d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:56.792719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:56.794798 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6cc1e-668e-47f8-8a10-b55ba4470090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:56.796111 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:56.796397 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:56.797684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6cc1e-668e-47f8-8a10-b55ba4470090 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:56.798032 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6cc1e-668e-47f8-8a10-b55ba4470090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:56.798244 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6cc1e-668e-47f8-8a10-b55ba4470090 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:56.798999 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6cc1e-668e-47f8-8a10-b55ba4470090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:56.800246 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] PATH_INFO: `/v3/projects/7b80361ca0f346139d3a619681eb9e1e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:56.800793 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6cc1e-668e-47f8-8a10-b55ba4470090 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:56.802466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b80361ca0f346139d3a619681eb9e1e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:56.804389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:56.816938 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1031/2080] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:56 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:56.821687 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6cc1e-668e-47f8-8a10-b55ba4470090 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:56.839747 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6cc1e-668e-47f8-8a10-b55ba4470090 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:56.844747 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4643de-a007-4c4e-b164-1b4e35e8d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:56.845739 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4643de-a007-4c4e-b164-1b4e35e8d12b admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:56.846015 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4643de-a007-4c4e-b164-1b4e35e8d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:56.846284 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4643de-a007-4c4e-b164-1b4e35e8d12b admin admin] PATH_INFO: `/v3/projects/b8de8dbc609f46bb9623b2645f382428/users/2ec207ef709b4deb8b7920ca1f7f3d96/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:56.862973 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4643de-a007-4c4e-b164-1b4e35e8d12b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8de8dbc609f46bb9623b2645f382428, user_id=2ec207ef709b4deb8b7920ca1f7f3d96, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:56.866535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4643de-a007-4c4e-b164-1b4e35e8d12b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:56.989774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1032/2081] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:56 2021] PUT /identity/v3/projects/b8de8dbc609f46bb9623b2645f382428/users/2ec207ef709b4deb8b7920ca1f7f3d96/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:57.000066 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e9c7b-de7b-45e1-82b7-4f0555c7039c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:57.000734 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e9c7b-de7b-45e1-82b7-4f0555c7039c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:57.001206 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e9c7b-de7b-45e1-82b7-4f0555c7039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:57.009768 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b80361ca0f346139d3a619681eb9e1e', 'request_id': 'req-39f5c697-0286-4cb1-92cd-3ea07328dffd'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:57.044974 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-671e9c7b-de7b-45e1-82b7-4f0555c7039c None None] MFA Rules not processed for user `2ec207ef709b4deb8b7920ca1f7f3d96`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:57.046336 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-671e9c7b-de7b-45e1-82b7-4f0555c7039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:57.116400 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1033/2082] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:56 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:30:57.121235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e9c7b-de7b-45e1-82b7-4f0555c7039c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:57.143987 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b80361ca0f346139d3a619681eb9e1e', 'request_id': 'req-39f5c697-0286-4cb1-92cd-3ea07328dffd'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:57.149891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b80361ca0f346139d3a619681eb9e1e', 'request_id': 'req-39f5c697-0286-4cb1-92cd-3ea07328dffd'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:57.161308 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] The token cache is being invalidate because project 7b80361ca0f346139d3a619681eb9e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:57.161588 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:57.162255 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:57.164006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1050/2083] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:56 2021] DELETE /identity/v3/projects/7b80361ca0f346139d3a619681eb9e1e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:57.167934 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:57.169278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:57.190894 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e9c7b-de7b-45e1-82b7-4f0555c7039c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:57.196027 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1609b0-0002-4207-b191-bff3afd4f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:57.196686 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1609b0-0002-4207-b191-bff3afd4f1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:57.196973 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1609b0-0002-4207-b191-bff3afd4f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:57.197250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1609b0-0002-4207-b191-bff3afd4f1c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:57.197991 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1609b0-0002-4207-b191-bff3afd4f1c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:57.200149 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1609b0-0002-4207-b191-bff3afd4f1c0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:57.240267 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5c697-0286-4cb1-92cd-3ea07328dffd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:57.244814 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1b23f-27f3-4cf1-b273-3ea995f0ecb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:57.245673 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1b23f-27f3-4cf1-b273-3ea995f0ecb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:57.245953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1b23f-27f3-4cf1-b273-3ea995f0ecb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:57.246231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1b23f-27f3-4cf1-b273-3ea995f0ecb8 admin admin] PATH_INFO: `/v3/users/f759bdf767ac430bb771d91f1b777b97` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:57.247425 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1b23f-27f3-4cf1-b273-3ea995f0ecb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f759bdf767ac430bb771d91f1b777b97)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:57.251236 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1b23f-27f3-4cf1-b273-3ea995f0ecb8 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:57.294623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1034/2084] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:57 2021] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:57.298691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1609b0-0002-4207-b191-bff3afd4f1c0 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:57.300328 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ff1609b0-0002-4207-b191-bff3afd4f1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:57.362297 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1609b0-0002-4207-b191-bff3afd4f1c0 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:57.366940 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb8baa-dc41-4b35-a593-3393b19e95a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:57.367597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb8baa-dc41-4b35-a593-3393b19e95a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:57.367913 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb8baa-dc41-4b35-a593-3393b19e95a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:57.368185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb8baa-dc41-4b35-a593-3393b19e95a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:57.368875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb8baa-dc41-4b35-a593-3393b19e95a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:57.370757 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb8baa-dc41-4b35-a593-3393b19e95a2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:57.438773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-72d1b23f-27f3-4cf1-b273-3ea995f0ecb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f759bdf767ac430bb771d91f1b777b97'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:57.439440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-72d1b23f-27f3-4cf1-b273-3ea995f0ecb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f759bdf767ac430bb771d91f1b777b97'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:57.451526 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-72d1b23f-27f3-4cf1-b273-3ea995f0ecb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f759bdf767ac430bb771d91f1b777b97'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:57.458993 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-72d1b23f-27f3-4cf1-b273-3ea995f0ecb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f759bdf767ac430bb771d91f1b777b97'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:57.462840 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1035/2085] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:30:57 2021] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:30:57.464202 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb8baa-dc41-4b35-a593-3393b19e95a2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:57.465917 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-5edb8baa-dc41-4b35-a593-3393b19e95a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:57.478114 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb8baa-dc41-4b35-a593-3393b19e95a2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:57.482770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a3cd0-d8ea-4df8-a1a5-43937c694133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:57.483425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a3cd0-d8ea-4df8-a1a5-43937c694133 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:57.483703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a3cd0-d8ea-4df8-a1a5-43937c694133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:57.484767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a3cd0-d8ea-4df8-a1a5-43937c694133 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:57.485614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a3cd0-d8ea-4df8-a1a5-43937c694133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:57.487183 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a3cd0-d8ea-4df8-a1a5-43937c694133 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:57.497663 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1036/2086] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:57 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:30:57.502493 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a3cd0-d8ea-4df8-a1a5-43937c694133 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:57.512125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a3cd0-d8ea-4df8-a1a5-43937c694133 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:57.517485 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6337d-d0a6-4222-877b-b170081d61c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:57.518343 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6337d-d0a6-4222-877b-b170081d61c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:57.518621 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6337d-d0a6-4222-877b-b170081d61c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:57.518894 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6337d-d0a6-4222-877b-b170081d61c1 admin admin] PATH_INFO: `/v3/projects/5ab76a7d1ebf4c5b875a53d64db2e82b/users/caf67c27883b4b04bd7ff8c63a705f11/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:57.521417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-72d1b23f-27f3-4cf1-b273-3ea995f0ecb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f759bdf767ac430bb771d91f1b777b97'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:57.527969 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1051/2087] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:57 2021] DELETE /identity/v3/users/f759bdf767ac430bb771d91f1b777b97 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:57.534347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6337d-d0a6-4222-877b-b170081d61c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab76a7d1ebf4c5b875a53d64db2e82b, user_id=caf67c27883b4b04bd7ff8c63a705f11, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:57.536986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6337d-d0a6-4222-877b-b170081d61c1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:57.659857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1037/2088] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:57 2021] PUT /identity/v3/projects/5ab76a7d1ebf4c5b875a53d64db2e82b/users/caf67c27883b4b04bd7ff8c63a705f11/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:57.663327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1b23f-27f3-4cf1-b273-3ea995f0ecb8 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:57.746611 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1b23f-27f3-4cf1-b273-3ea995f0ecb8 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:57.827317 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6d418-b209-4eee-a987-c2b141b709b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:57.828139 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d418-b209-4eee-a987-c2b141b709b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:57.828848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d418-b209-4eee-a987-c2b141b709b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:57.829125 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d418-b209-4eee-a987-c2b141b709b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:57.830037 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6d418-b209-4eee-a987-c2b141b709b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:57.831653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6d418-b209-4eee-a987-c2b141b709b1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:57.842100 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1052/2089] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:30:57 2021] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:30:57.847493 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6337d-d0a6-4222-877b-b170081d61c1 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:57.858400 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6337d-d0a6-4222-877b-b170081d61c1 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:57.870264 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cedd92-b750-44fc-b3c6-5cd3f19bd20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:57.871188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cedd92-b750-44fc-b3c6-5cd3f19bd20b admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:57.871772 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cedd92-b750-44fc-b3c6-5cd3f19bd20b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:57.871772 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cedd92-b750-44fc-b3c6-5cd3f19bd20b admin admin] PATH_INFO: `/v3/projects/5ab76a7d1ebf4c5b875a53d64db2e82b/users/caf67c27883b4b04bd7ff8c63a705f11/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:57.877741 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cedd92-b750-44fc-b3c6-5cd3f19bd20b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab76a7d1ebf4c5b875a53d64db2e82b, user_id=caf67c27883b4b04bd7ff8c63a705f11, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:57.881526 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cedd92-b750-44fc-b3c6-5cd3f19bd20b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:57.919500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1038/2090] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:30:57 2021] PUT /identity/v3/projects/5ab76a7d1ebf4c5b875a53d64db2e82b/users/caf67c27883b4b04bd7ff8c63a705f11/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:57.921370 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee4aec-0dc9-4055-b49f-e0709c03406f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:57.925805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee4aec-0dc9-4055-b49f-e0709c03406f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:57.925805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee4aec-0dc9-4055-b49f-e0709c03406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:57.954734 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8eee4aec-0dc9-4055-b49f-e0709c03406f None None] MFA Rules not processed for user `caf67c27883b4b04bd7ff8c63a705f11`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:57.955928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8eee4aec-0dc9-4055-b49f-e0709c03406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:58.005566 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cedd92-b750-44fc-b3c6-5cd3f19bd20b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:58.007317 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b1cedd92-b750-44fc-b3c6-5cd3f19bd20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:58.043587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1053/2091] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:57 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:58.070814 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee4aec-0dc9-4055-b49f-e0709c03406f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:58.072206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8eee4aec-0dc9-4055-b49f-e0709c03406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:58.101396 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cedd92-b750-44fc-b3c6-5cd3f19bd20b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:58.120922 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:58.120922 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:58.120922 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:58.120922 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] PATH_INFO: `/v3/projects/14806da60008444ba3d0e535c2ce329e` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:58.121290 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=14806da60008444ba3d0e535c2ce329e)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:58.123334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:58.158883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee4aec-0dc9-4055-b49f-e0709c03406f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:58.165546 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62b5b4-2e0f-473e-b08e-e11e913746ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:58.167508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62b5b4-2e0f-473e-b08e-e11e913746ba service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:58.167508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62b5b4-2e0f-473e-b08e-e11e913746ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:58.167508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62b5b4-2e0f-473e-b08e-e11e913746ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:58.179870 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62b5b4-2e0f-473e-b08e-e11e913746ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:58.181620 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62b5b4-2e0f-473e-b08e-e11e913746ba service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:58.201764 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1054/2092] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:58 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:30:58.289811 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14806da60008444ba3d0e535c2ce329e', 'request_id': 'req-6079558d-70e1-42cf-a1a6-db2ea47376ca'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:58.396377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62b5b4-2e0f-473e-b08e-e11e913746ba service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:58.407233 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62b5b4-2e0f-473e-b08e-e11e913746ba service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:58.408646 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14806da60008444ba3d0e535c2ce329e', 'request_id': 'req-6079558d-70e1-42cf-a1a6-db2ea47376ca'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:58.415210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14806da60008444ba3d0e535c2ce329e', 'request_id': 'req-6079558d-70e1-42cf-a1a6-db2ea47376ca'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:58.431255 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] The token cache is being invalidate because project 14806da60008444ba3d0e535c2ce329e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:58.431435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:58.432137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:58.434216 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1039/2093] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:58 2021] DELETE /identity/v3/projects/14806da60008444ba3d0e535c2ce329e => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:30:58.441019 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:58.445090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:58.481475 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6bd68-b02f-4ab5-9ddb-e96ec1789808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:58.482165 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6bd68-b02f-4ab5-9ddb-e96ec1789808 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:58.482483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6bd68-b02f-4ab5-9ddb-e96ec1789808 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:58.482751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6bd68-b02f-4ab5-9ddb-e96ec1789808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:58.485968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-2fb6bd68-b02f-4ab5-9ddb-e96ec1789808 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:58.535537 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079558d-70e1-42cf-a1a6-db2ea47376ca admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:58.541936 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981685b0-ed72-4ff7-8e4e-aa3e7b25d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:58.542780 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981685b0-ed72-4ff7-8e4e-aa3e7b25d28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:58.543061 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981685b0-ed72-4ff7-8e4e-aa3e7b25d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:58.543341 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981685b0-ed72-4ff7-8e4e-aa3e7b25d28a admin admin] PATH_INFO: `/v3/users/a0345212622b4a83880ba397e902d69e` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:58.544702 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981685b0-ed72-4ff7-8e4e-aa3e7b25d28a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0345212622b4a83880ba397e902d69e)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:58.547218 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981685b0-ed72-4ff7-8e4e-aa3e7b25d28a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:58.552354 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6bd68-b02f-4ab5-9ddb-e96ec1789808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:58.553786 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6bd68-b02f-4ab5-9ddb-e96ec1789808 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:58.563642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1055/2094] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:30:58 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:30:58.763384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-981685b0-ed72-4ff7-8e4e-aa3e7b25d28a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0345212622b4a83880ba397e902d69e'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:58.769968 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-981685b0-ed72-4ff7-8e4e-aa3e7b25d28a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0345212622b4a83880ba397e902d69e'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:58.770615 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-981685b0-ed72-4ff7-8e4e-aa3e7b25d28a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0345212622b4a83880ba397e902d69e'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:58.783446 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-981685b0-ed72-4ff7-8e4e-aa3e7b25d28a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0345212622b4a83880ba397e902d69e'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:58.841701 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-981685b0-ed72-4ff7-8e4e-aa3e7b25d28a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0345212622b4a83880ba397e902d69e'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:58.849944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1040/2095] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:30:58 2021] DELETE /identity/v3/users/a0345212622b4a83880ba397e902d69e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:59.323099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6bd68-b02f-4ab5-9ddb-e96ec1789808 service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:59.336204 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6bd68-b02f-4ab5-9ddb-e96ec1789808 service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:59.412275 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba18073-84fd-4416-96a5-dc82f71b63d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:59.413133 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba18073-84fd-4416-96a5-dc82f71b63d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:59.416117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba18073-84fd-4416-96a5-dc82f71b63d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:59.416117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba18073-84fd-4416-96a5-dc82f71b63d5 admin admin] PATH_INFO: `/v3/projects/c90b3ed70f2044b8890acd411860354f` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:59.416117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba18073-84fd-4416-96a5-dc82f71b63d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c90b3ed70f2044b8890acd411860354f)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:59.416779 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba18073-84fd-4416-96a5-dc82f71b63d5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:59.585448 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eba18073-84fd-4416-96a5-dc82f71b63d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c90b3ed70f2044b8890acd411860354f', 'request_id': 'req-eba18073-84fd-4416-96a5-dc82f71b63d5'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:59.697564 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eba18073-84fd-4416-96a5-dc82f71b63d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c90b3ed70f2044b8890acd411860354f', 'request_id': 'req-eba18073-84fd-4416-96a5-dc82f71b63d5'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:59.699421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eba18073-84fd-4416-96a5-dc82f71b63d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c90b3ed70f2044b8890acd411860354f', 'request_id': 'req-eba18073-84fd-4416-96a5-dc82f71b63d5'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:59.710994 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eba18073-84fd-4416-96a5-dc82f71b63d5 admin admin] The token cache is being invalidate because project c90b3ed70f2044b8890acd411860354f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:30:59.711276 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eba18073-84fd-4416-96a5-dc82f71b63d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:59.712025 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eba18073-84fd-4416-96a5-dc82f71b63d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:30:59.713570 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1056/2096] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:30:59 2021] DELETE /identity/v3/projects/c90b3ed70f2044b8890acd411860354f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:30:59.720339 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a17d6d-3485-4b5e-9534-7e9987538629 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:59.726552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a17d6d-3485-4b5e-9534-7e9987538629 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:59.726552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a17d6d-3485-4b5e-9534-7e9987538629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:59.738995 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-38a17d6d-3485-4b5e-9534-7e9987538629 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:59.740222 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-38a17d6d-3485-4b5e-9534-7e9987538629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:59.800249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1041/2097] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:59.809919 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aebc20-d054-4e81-a747-d36564b1db55 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:59.810196 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aebc20-d054-4e81-a747-d36564b1db55 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:59.810492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aebc20-d054-4e81-a747-d36564b1db55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:59.829624 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-a6aebc20-d054-4e81-a747-d36564b1db55 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:30:59.830844 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a6aebc20-d054-4e81-a747-d36564b1db55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:30:59.838546 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1057/2098] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:30:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:30:59.842908 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a17d6d-3485-4b5e-9534-7e9987538629 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:59.852878 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a17d6d-3485-4b5e-9534-7e9987538629 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:59.857560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0fa81-1b97-499a-8018-b271110d5f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:59.858243 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0fa81-1b97-499a-8018-b271110d5f41 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:59.858624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0fa81-1b97-499a-8018-b271110d5f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:59.858900 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0fa81-1b97-499a-8018-b271110d5f41 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:59.860156 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0fa81-1b97-499a-8018-b271110d5f41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:30:59.860456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0fa81-1b97-499a-8018-b271110d5f41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:59.862013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0fa81-1b97-499a-8018-b271110d5f41 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:30:59.875760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1042/2099] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:30:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:30:59.880484 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aebc20-d054-4e81-a747-d36564b1db55 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:30:59.889794 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aebc20-d054-4e81-a747-d36564b1db55 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:30:59.895187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ca8f2-c6b9-4743-90d8-da2f6d5c3303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:30:59.895932 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ca8f2-c6b9-4743-90d8-da2f6d5c3303 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:30:59.896212 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ca8f2-c6b9-4743-90d8-da2f6d5c3303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:30:59.896513 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ca8f2-c6b9-4743-90d8-da2f6d5c3303 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:30:59.897308 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ca8f2-c6b9-4743-90d8-da2f6d5c3303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:30:59.899154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ca8f2-c6b9-4743-90d8-da2f6d5c3303 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:00.002979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1058/2100] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:30:59 2021] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:00.007255 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0fa81-1b97-499a-8018-b271110d5f41 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:00.017175 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0fa81-1b97-499a-8018-b271110d5f41 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:00.071524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463df2e-46dc-4919-b111-69f094106876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:00.072494 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463df2e-46dc-4919-b111-69f094106876 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:00.072931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463df2e-46dc-4919-b111-69f094106876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:00.073203 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463df2e-46dc-4919-b111-69f094106876 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:00.073931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463df2e-46dc-4919-b111-69f094106876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:00.076119 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463df2e-46dc-4919-b111-69f094106876 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:00.177654 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1043/2101] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:31:00 2021] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:00.182019 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ca8f2-c6b9-4743-90d8-da2f6d5c3303 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:00.193315 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ca8f2-c6b9-4743-90d8-da2f6d5c3303 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:00.198776 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6693f1f-3119-4502-b74e-ec017a673d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:00.199873 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6693f1f-3119-4502-b74e-ec017a673d8e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:00.200159 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6693f1f-3119-4502-b74e-ec017a673d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:00.200428 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6693f1f-3119-4502-b74e-ec017a673d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:00.201181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6693f1f-3119-4502-b74e-ec017a673d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:00.202775 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6693f1f-3119-4502-b74e-ec017a673d8e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:00.221182 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1059/2102] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:00 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:00.225456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463df2e-46dc-4919-b111-69f094106876 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:00.236138 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463df2e-46dc-4919-b111-69f094106876 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:00.241209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e999b0f-e373-483f-b8f7-61c74ba1b4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:00.241870 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e999b0f-e373-483f-b8f7-61c74ba1b4ae admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:00.242153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e999b0f-e373-483f-b8f7-61c74ba1b4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:00.242425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e999b0f-e373-483f-b8f7-61c74ba1b4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:00.243168 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e999b0f-e373-483f-b8f7-61c74ba1b4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:00.244775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e999b0f-e373-483f-b8f7-61c74ba1b4ae admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:00.255259 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1044/2103] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:00.260016 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6693f1f-3119-4502-b74e-ec017a673d8e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:00.271183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6693f1f-3119-4502-b74e-ec017a673d8e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:00.276129 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe10cd-7003-4e13-88e7-14b54fcae7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:00.281748 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe10cd-7003-4e13-88e7-14b54fcae7fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:00.281748 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe10cd-7003-4e13-88e7-14b54fcae7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:00.281748 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe10cd-7003-4e13-88e7-14b54fcae7fc admin admin] PATH_INFO: `/v3/projects/69d6ff02dedd4e8082a8ac5055ee1c86/users/b9bb9529a960430da945719a7f8782ff/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:00.293848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe10cd-7003-4e13-88e7-14b54fcae7fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d6ff02dedd4e8082a8ac5055ee1c86, user_id=b9bb9529a960430da945719a7f8782ff, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:00.297061 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe10cd-7003-4e13-88e7-14b54fcae7fc admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:00.419075 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1060/2104] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:00 2021] PUT /identity/v3/projects/69d6ff02dedd4e8082a8ac5055ee1c86/users/b9bb9529a960430da945719a7f8782ff/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:00.430447 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b15b8-e793-48c4-821b-d6c2ce8243b8 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:00.430736 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b15b8-e793-48c4-821b-d6c2ce8243b8 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:00.431036 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b15b8-e793-48c4-821b-d6c2ce8243b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:00.463421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d56b15b8-e793-48c4-821b-d6c2ce8243b8 None None] MFA Rules not processed for user `b9bb9529a960430da945719a7f8782ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:00.464693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d56b15b8-e793-48c4-821b-d6c2ce8243b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:00.531951 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1045/2105] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:00 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:00.536760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe10cd-7003-4e13-88e7-14b54fcae7fc admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:00.598316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe10cd-7003-4e13-88e7-14b54fcae7fc admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:00.603109 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f61ff-162d-42d6-924c-910d1eca0443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:00.603789 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f61ff-162d-42d6-924c-910d1eca0443 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:00.604075 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f61ff-162d-42d6-924c-910d1eca0443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:00.604350 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f61ff-162d-42d6-924c-910d1eca0443 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:00.605062 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f61ff-162d-42d6-924c-910d1eca0443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:00.606947 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f61ff-162d-42d6-924c-910d1eca0443 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:00.728995 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1061/2106] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:31:00 2021] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:00.736735 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b15b8-e793-48c4-821b-d6c2ce8243b8 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:00.747514 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b15b8-e793-48c4-821b-d6c2ce8243b8 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:00.803269 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfed94e-0a91-4e16-8223-b2a8693be822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:00.803955 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfed94e-0a91-4e16-8223-b2a8693be822 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:00.804231 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfed94e-0a91-4e16-8223-b2a8693be822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:00.804498 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfed94e-0a91-4e16-8223-b2a8693be822 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:00.805196 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfed94e-0a91-4e16-8223-b2a8693be822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:00.807049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfed94e-0a91-4e16-8223-b2a8693be822 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:00.871011 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1046/2107] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:31:00 2021] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:00.876653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f61ff-162d-42d6-924c-910d1eca0443 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:00.887340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f61ff-162d-42d6-924c-910d1eca0443 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:00.894206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406b50d-10e4-4af4-bcb2-3045bccda9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:00.894998 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406b50d-10e4-4af4-bcb2-3045bccda9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:00.895348 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406b50d-10e4-4af4-bcb2-3045bccda9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:00.895679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406b50d-10e4-4af4-bcb2-3045bccda9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:00.896578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406b50d-10e4-4af4-bcb2-3045bccda9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:00.898291 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406b50d-10e4-4af4-bcb2-3045bccda9b5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:00.911652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1062/2108] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:00 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:00.914787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfed94e-0a91-4e16-8223-b2a8693be822 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:00.924645 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfed94e-0a91-4e16-8223-b2a8693be822 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:00.929199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf570784-842b-4f54-9468-42dec5f99750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:00.930068 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf570784-842b-4f54-9468-42dec5f99750 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:00.930346 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf570784-842b-4f54-9468-42dec5f99750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:00.930616 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf570784-842b-4f54-9468-42dec5f99750 admin admin] PATH_INFO: `/v3/projects/0cc10225d446465cb2feb232e45389fe/users/3c0d760f7d5b4136a91f203f34ae001d/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:00.945487 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf570784-842b-4f54-9468-42dec5f99750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc10225d446465cb2feb232e45389fe, user_id=3c0d760f7d5b4136a91f203f34ae001d, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:00.948107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf570784-842b-4f54-9468-42dec5f99750 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:01.036178 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1047/2109] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:00 2021] PUT /identity/v3/projects/0cc10225d446465cb2feb232e45389fe/users/3c0d760f7d5b4136a91f203f34ae001d/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:01.040237 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406b50d-10e4-4af4-bcb2-3045bccda9b5 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:01.050157 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406b50d-10e4-4af4-bcb2-3045bccda9b5 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:01.105385 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e586c1f-cafe-4239-922c-7a80439c2c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:01.106045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586c1f-cafe-4239-922c-7a80439c2c09 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:01.106334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586c1f-cafe-4239-922c-7a80439c2c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:01.106590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586c1f-cafe-4239-922c-7a80439c2c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:01.107322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e586c1f-cafe-4239-922c-7a80439c2c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:01.109017 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e586c1f-cafe-4239-922c-7a80439c2c09 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:01.119290 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1063/2110] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:01 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:01.123653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf570784-842b-4f54-9468-42dec5f99750 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:01.134375 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf570784-842b-4f54-9468-42dec5f99750 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:01.139031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1593dc-f13c-44d4-b6c2-a10fd6ed039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:01.139928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1593dc-f13c-44d4-b6c2-a10fd6ed039f admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:01.140207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1593dc-f13c-44d4-b6c2-a10fd6ed039f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:01.140479 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1593dc-f13c-44d4-b6c2-a10fd6ed039f admin admin] PATH_INFO: `/v3/projects/0cc10225d446465cb2feb232e45389fe/users/3c0d760f7d5b4136a91f203f34ae001d/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:01.142520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1593dc-f13c-44d4-b6c2-a10fd6ed039f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc10225d446465cb2feb232e45389fe, user_id=3c0d760f7d5b4136a91f203f34ae001d, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:01.145173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1593dc-f13c-44d4-b6c2-a10fd6ed039f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:01.155879 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1048/2111] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:01 2021] PUT /identity/v3/projects/0cc10225d446465cb2feb232e45389fe/users/3c0d760f7d5b4136a91f203f34ae001d/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:31:01.166783 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab475d9-3248-4903-be1b-8d66bdd3369e None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:01.166783 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab475d9-3248-4903-be1b-8d66bdd3369e None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:01.166783 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab475d9-3248-4903-be1b-8d66bdd3369e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:01.195713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8ab475d9-3248-4903-be1b-8d66bdd3369e None None] MFA Rules not processed for user `3c0d760f7d5b4136a91f203f34ae001d`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:01.196958 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8ab475d9-3248-4903-be1b-8d66bdd3369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:01.271432 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1064/2112] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:01 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:01.283059 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1593dc-f13c-44d4-b6c2-a10fd6ed039f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:01.284772 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4f1593dc-f13c-44d4-b6c2-a10fd6ed039f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:01.340333 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1593dc-f13c-44d4-b6c2-a10fd6ed039f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:01.344067 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6312545-f3eb-4733-97b2-900b8c2be366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:01.353291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6312545-f3eb-4733-97b2-900b8c2be366 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:01.353291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6312545-f3eb-4733-97b2-900b8c2be366 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:01.353291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6312545-f3eb-4733-97b2-900b8c2be366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:01.354571 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6312545-f3eb-4733-97b2-900b8c2be366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:01.355994 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6312545-f3eb-4733-97b2-900b8c2be366 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:01.366934 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1049/2113] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:01 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:31:01.639973 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab475d9-3248-4903-be1b-8d66bdd3369e None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:01.649578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab475d9-3248-4903-be1b-8d66bdd3369e None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:01.653231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186b719-7e48-442c-bc8c-c5353ac116ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:01.653864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186b719-7e48-442c-bc8c-c5353ac116ec service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:01.654147 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186b719-7e48-442c-bc8c-c5353ac116ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:01.654423 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186b719-7e48-442c-bc8c-c5353ac116ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:01.725437 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186b719-7e48-442c-bc8c-c5353ac116ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:01.726869 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186b719-7e48-442c-bc8c-c5353ac116ec service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:01.739629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1065/2114] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:01 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:31:03.901579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6312545-f3eb-4733-97b2-900b8c2be366 service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:03.903359 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-f6312545-f3eb-4733-97b2-900b8c2be366 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:04.035658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6312545-f3eb-4733-97b2-900b8c2be366 service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:04.040615 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33eaf32-2b5b-49e8-8e46-2ec829f5c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:04.041478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eaf32-2b5b-49e8-8e46-2ec829f5c60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:04.041756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eaf32-2b5b-49e8-8e46-2ec829f5c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:04.042028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eaf32-2b5b-49e8-8e46-2ec829f5c60f admin admin] PATH_INFO: `/v3/users/2ec207ef709b4deb8b7920ca1f7f3d96` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:04.043234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33eaf32-2b5b-49e8-8e46-2ec829f5c60f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ec207ef709b4deb8b7920ca1f7f3d96)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:04.045199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33eaf32-2b5b-49e8-8e46-2ec829f5c60f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:04.237720 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-f33eaf32-2b5b-49e8-8e46-2ec829f5c60f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ec207ef709b4deb8b7920ca1f7f3d96'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:04.244278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-f33eaf32-2b5b-49e8-8e46-2ec829f5c60f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ec207ef709b4deb8b7920ca1f7f3d96'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:04.244946 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-f33eaf32-2b5b-49e8-8e46-2ec829f5c60f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ec207ef709b4deb8b7920ca1f7f3d96'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:04.257200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-f33eaf32-2b5b-49e8-8e46-2ec829f5c60f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ec207ef709b4deb8b7920ca1f7f3d96'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:04.356111 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-f33eaf32-2b5b-49e8-8e46-2ec829f5c60f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ec207ef709b4deb8b7920ca1f7f3d96'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:04.362971 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1050/2115] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:31:03 2021] DELETE /identity/v3/users/2ec207ef709b4deb8b7920ca1f7f3d96 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:31:04.367591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f963a-b32b-4567-95b3-9905d39b3995 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:04.369735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f963a-b32b-4567-95b3-9905d39b3995 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:04.369735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f963a-b32b-4567-95b3-9905d39b3995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:04.396093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-ff1f963a-b32b-4567-95b3-9905d39b3995 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:04.397300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-ff1f963a-b32b-4567-95b3-9905d39b3995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:04.454595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1066/2116] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:04.465180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33eaf32-2b5b-49e8-8e46-2ec829f5c60f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:04.466595 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-f33eaf32-2b5b-49e8-8e46-2ec829f5c60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:04.558750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33eaf32-2b5b-49e8-8e46-2ec829f5c60f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:04.562379 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5aaf9-34c0-4c59-a556-e7319a350cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:04.563008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5aaf9-34c0-4c59-a556-e7319a350cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:04.563282 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5aaf9-34c0-4c59-a556-e7319a350cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:04.563574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5aaf9-34c0-4c59-a556-e7319a350cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:04.573420 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5aaf9-34c0-4c59-a556-e7319a350cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:04.575118 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5aaf9-34c0-4c59-a556-e7319a350cf1 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:04.585907 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1051/2117] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:31:05.003708 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f963a-b32b-4567-95b3-9905d39b3995 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:05.005137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-ff1f963a-b32b-4567-95b3-9905d39b3995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:05.017407 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f963a-b32b-4567-95b3-9905d39b3995 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:05.022923 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:05.023778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:05.024034 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:05.024284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] PATH_INFO: `/v3/projects/b8de8dbc609f46bb9623b2645f382428` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:05.025516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8de8dbc609f46bb9623b2645f382428)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:05.027565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:05.162082 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8de8dbc609f46bb9623b2645f382428', 'request_id': 'req-22526264-5751-4be2-a29d-3f7fbf5b4a89'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:05.259393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8de8dbc609f46bb9623b2645f382428', 'request_id': 'req-22526264-5751-4be2-a29d-3f7fbf5b4a89'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:05.265480 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8de8dbc609f46bb9623b2645f382428', 'request_id': 'req-22526264-5751-4be2-a29d-3f7fbf5b4a89'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:05.277756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] The token cache is being invalidate because project b8de8dbc609f46bb9623b2645f382428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:31:05.277965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:05.278595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:05.280242 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1067/2118] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:31:05 2021] DELETE /identity/v3/projects/b8de8dbc609f46bb9623b2645f382428 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:05.284615 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5aaf9-34c0-4c59-a556-e7319a350cf1 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:05.294214 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5aaf9-34c0-4c59-a556-e7319a350cf1 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:05.348782 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f8802-0151-45ca-a75f-fd185af3f002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:05.349618 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f8802-0151-45ca-a75f-fd185af3f002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:05.349890 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f8802-0151-45ca-a75f-fd185af3f002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:05.350154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f8802-0151-45ca-a75f-fd185af3f002 admin admin] PATH_INFO: `/v3/users/caf67c27883b4b04bd7ff8c63a705f11` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:05.351329 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f8802-0151-45ca-a75f-fd185af3f002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf67c27883b4b04bd7ff8c63a705f11)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:05.353232 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f8802-0151-45ca-a75f-fd185af3f002 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:05.533857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-052f8802-0151-45ca-a75f-fd185af3f002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf67c27883b4b04bd7ff8c63a705f11'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:05.540892 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-052f8802-0151-45ca-a75f-fd185af3f002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf67c27883b4b04bd7ff8c63a705f11'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:05.541576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-052f8802-0151-45ca-a75f-fd185af3f002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf67c27883b4b04bd7ff8c63a705f11'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:05.553797 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-052f8802-0151-45ca-a75f-fd185af3f002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf67c27883b4b04bd7ff8c63a705f11'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:05.618252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-052f8802-0151-45ca-a75f-fd185af3f002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf67c27883b4b04bd7ff8c63a705f11'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:05.624434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1052/2119] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:31:05 2021] DELETE /identity/v3/users/caf67c27883b4b04bd7ff8c63a705f11 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:06.113141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:06.114646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:06.129017 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22526264-5751-4be2-a29d-3f7fbf5b4a89 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:06.193039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e991bf5-9504-4572-8937-103a95cb4d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:06.193955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e991bf5-9504-4572-8937-103a95cb4d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:06.194230 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e991bf5-9504-4572-8937-103a95cb4d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:06.194498 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e991bf5-9504-4572-8937-103a95cb4d9b admin admin] PATH_INFO: `/v3/projects/5ab76a7d1ebf4c5b875a53d64db2e82b` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:06.195704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e991bf5-9504-4572-8937-103a95cb4d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab76a7d1ebf4c5b875a53d64db2e82b)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:06.197618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e991bf5-9504-4572-8937-103a95cb4d9b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:06.333891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2e991bf5-9504-4572-8937-103a95cb4d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab76a7d1ebf4c5b875a53d64db2e82b', 'request_id': 'req-2e991bf5-9504-4572-8937-103a95cb4d9b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:06.407051 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2e991bf5-9504-4572-8937-103a95cb4d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab76a7d1ebf4c5b875a53d64db2e82b', 'request_id': 'req-2e991bf5-9504-4572-8937-103a95cb4d9b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:06.413622 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2e991bf5-9504-4572-8937-103a95cb4d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab76a7d1ebf4c5b875a53d64db2e82b', 'request_id': 'req-2e991bf5-9504-4572-8937-103a95cb4d9b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:06.424999 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2e991bf5-9504-4572-8937-103a95cb4d9b admin admin] The token cache is being invalidate because project 5ab76a7d1ebf4c5b875a53d64db2e82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:31:06.425277 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2e991bf5-9504-4572-8937-103a95cb4d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:06.428657 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2e991bf5-9504-4572-8937-103a95cb4d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:06.428657 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1068/2120] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:31:06 2021] DELETE /identity/v3/projects/5ab76a7d1ebf4c5b875a53d64db2e82b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:06.433628 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53c758-b3d6-4c09-b639-a60a1263b35f None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:06.434130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53c758-b3d6-4c09-b639-a60a1263b35f None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:06.434233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53c758-b3d6-4c09-b639-a60a1263b35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:06.481535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-2f53c758-b3d6-4c09-b639-a60a1263b35f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:06.481535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2f53c758-b3d6-4c09-b639-a60a1263b35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:06.541014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1053/2121] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:06.549045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4bbf-7346-4f8b-a81a-e561838d5c34 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:06.549888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4bbf-7346-4f8b-a81a-e561838d5c34 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:06.550225 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4bbf-7346-4f8b-a81a-e561838d5c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:06.570512 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-daec4bbf-7346-4f8b-a81a-e561838d5c34 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:06.573693 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-daec4bbf-7346-4f8b-a81a-e561838d5c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:06.581507 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1069/2122] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:06.585804 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53c758-b3d6-4c09-b639-a60a1263b35f None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:06.595186 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53c758-b3d6-4c09-b639-a60a1263b35f None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:06.601094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c555e2-666e-4b5a-aac4-36cd59af700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:06.601771 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c555e2-666e-4b5a-aac4-36cd59af700f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:06.602047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c555e2-666e-4b5a-aac4-36cd59af700f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:06.602311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c555e2-666e-4b5a-aac4-36cd59af700f admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:06.603041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c555e2-666e-4b5a-aac4-36cd59af700f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:31:06.603338 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c555e2-666e-4b5a-aac4-36cd59af700f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:06.604985 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c555e2-666e-4b5a-aac4-36cd59af700f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:06.619991 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1054/2123] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:31:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:31:06.621422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec4bbf-7346-4f8b-a81a-e561838d5c34 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:06.631326 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec4bbf-7346-4f8b-a81a-e561838d5c34 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:06.636075 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151a61b-e3a5-4f54-b886-55a7c6057db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:06.636716 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151a61b-e3a5-4f54-b886-55a7c6057db6 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:06.636991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151a61b-e3a5-4f54-b886-55a7c6057db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:06.637259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151a61b-e3a5-4f54-b886-55a7c6057db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:06.637990 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151a61b-e3a5-4f54-b886-55a7c6057db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:06.639875 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151a61b-e3a5-4f54-b886-55a7c6057db6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:06.763414 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1070/2124] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:31:06 2021] POST /identity/v3/projects => generated 389 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:06.768793 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c555e2-666e-4b5a-aac4-36cd59af700f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:06.778976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c555e2-666e-4b5a-aac4-36cd59af700f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:06.842057 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d36075-8351-4fb5-8988-2902df8d64d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:06.842831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d36075-8351-4fb5-8988-2902df8d64d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:06.843110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d36075-8351-4fb5-8988-2902df8d64d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:06.843381 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d36075-8351-4fb5-8988-2902df8d64d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:06.844167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d36075-8351-4fb5-8988-2902df8d64d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:06.846256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d36075-8351-4fb5-8988-2902df8d64d5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:06.957514 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1055/2125] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:31:06 2021] POST /identity/v3/users => generated 295 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:06.960414 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151a61b-e3a5-4f54-b886-55a7c6057db6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:06.971755 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151a61b-e3a5-4f54-b886-55a7c6057db6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:06.976732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73169e-dafb-446f-b9f2-7b76812d11dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:06.977390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73169e-dafb-446f-b9f2-7b76812d11dc admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:06.977672 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73169e-dafb-446f-b9f2-7b76812d11dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:06.977972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73169e-dafb-446f-b9f2-7b76812d11dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:06.978723 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73169e-dafb-446f-b9f2-7b76812d11dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:06.980351 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73169e-dafb-446f-b9f2-7b76812d11dc admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:06.992522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1071/2126] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:06.996413 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d36075-8351-4fb5-8988-2902df8d64d5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:07.007539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d36075-8351-4fb5-8988-2902df8d64d5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:07.014210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8d92c-601d-4ea3-b98a-fb50fffaa0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:07.014210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8d92c-601d-4ea3-b98a-fb50fffaa0ef admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:07.014210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8d92c-601d-4ea3-b98a-fb50fffaa0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:07.014210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8d92c-601d-4ea3-b98a-fb50fffaa0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:07.014665 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8d92c-601d-4ea3-b98a-fb50fffaa0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:07.015856 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8d92c-601d-4ea3-b98a-fb50fffaa0ef admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:07.027333 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1056/2127] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:07.031576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73169e-dafb-446f-b9f2-7b76812d11dc admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:07.042869 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73169e-dafb-446f-b9f2-7b76812d11dc admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:07.047631 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd620a1d-7dc0-4ad1-864f-a79e3cd68b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:07.048547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd620a1d-7dc0-4ad1-864f-a79e3cd68b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:07.055295 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd620a1d-7dc0-4ad1-864f-a79e3cd68b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:07.055295 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd620a1d-7dc0-4ad1-864f-a79e3cd68b27 admin admin] PATH_INFO: `/v3/projects/77cfa6e2ed3943bf8934ecf414ad3b6b/users/f225846947484370b849f48d5785b703/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:07.067868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd620a1d-7dc0-4ad1-864f-a79e3cd68b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77cfa6e2ed3943bf8934ecf414ad3b6b, user_id=f225846947484370b849f48d5785b703, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:07.070558 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd620a1d-7dc0-4ad1-864f-a79e3cd68b27 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:07.138883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1072/2128] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:07 2021] PUT /identity/v3/projects/77cfa6e2ed3943bf8934ecf414ad3b6b/users/f225846947484370b849f48d5785b703/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:07.164496 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1208258-5e39-4e23-8cb9-de669e385de5 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:07.164782 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1208258-5e39-4e23-8cb9-de669e385de5 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:07.165058 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1208258-5e39-4e23-8cb9-de669e385de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:07.198300 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-e1208258-5e39-4e23-8cb9-de669e385de5 None None] MFA Rules not processed for user `f225846947484370b849f48d5785b703`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:07.199520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e1208258-5e39-4e23-8cb9-de669e385de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:07.262888 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1057/2129] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:07 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:07.267571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd620a1d-7dc0-4ad1-864f-a79e3cd68b27 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:07.328310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd620a1d-7dc0-4ad1-864f-a79e3cd68b27 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:07.333202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44561b44-5827-4847-b6c1-c541bc7fecf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:07.333894 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44561b44-5827-4847-b6c1-c541bc7fecf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:07.334181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44561b44-5827-4847-b6c1-c541bc7fecf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:07.334450 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44561b44-5827-4847-b6c1-c541bc7fecf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:07.335163 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44561b44-5827-4847-b6c1-c541bc7fecf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:07.337079 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44561b44-5827-4847-b6c1-c541bc7fecf8 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:07.475111 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1073/2130] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:31:07 2021] POST /identity/v3/projects => generated 393 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:31:07.476165 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1208258-5e39-4e23-8cb9-de669e385de5 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:07.487969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1208258-5e39-4e23-8cb9-de669e385de5 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:07.548707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fd95b-48bf-4b49-802a-d96114880c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:07.551627 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fd95b-48bf-4b49-802a-d96114880c1b admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:07.551964 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fd95b-48bf-4b49-802a-d96114880c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:07.552818 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fd95b-48bf-4b49-802a-d96114880c1b admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:07.552999 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fd95b-48bf-4b49-802a-d96114880c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:07.555257 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fd95b-48bf-4b49-802a-d96114880c1b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:07.714413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b66e4e-d318-4997-bd30-fce53c2c193e None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:07.714773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b66e4e-d318-4997-bd30-fce53c2c193e None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:07.715052 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b66e4e-d318-4997-bd30-fce53c2c193e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:07.725790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1058/2131] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:31:07 2021] POST /identity/v3/users => generated 303 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:31:07.726775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fd95b-48bf-4b49-802a-d96114880c1b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:07.734110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-b7b66e4e-d318-4997-bd30-fce53c2c193e None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:07.737827 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b7b66e4e-d318-4997-bd30-fce53c2c193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:07.737974 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fd95b-48bf-4b49-802a-d96114880c1b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:07.742257 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847ea92-5be2-4a54-b647-6932c4a5a920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:07.742911 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847ea92-5be2-4a54-b647-6932c4a5a920 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:07.743191 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847ea92-5be2-4a54-b647-6932c4a5a920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:07.743459 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847ea92-5be2-4a54-b647-6932c4a5a920 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:07.744258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847ea92-5be2-4a54-b647-6932c4a5a920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:07.746208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847ea92-5be2-4a54-b647-6932c4a5a920 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:07.765606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1059/2132] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:07 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:31:07.766686 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847ea92-5be2-4a54-b647-6932c4a5a920 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:07.778731 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847ea92-5be2-4a54-b647-6932c4a5a920 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:07.788738 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cf4c9-6d74-417e-b840-ae9bd65041dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:07.792301 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cf4c9-6d74-417e-b840-ae9bd65041dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:07.792587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cf4c9-6d74-417e-b840-ae9bd65041dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:07.793094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cf4c9-6d74-417e-b840-ae9bd65041dc admin admin] PATH_INFO: `/v3/projects/e8c991e57b3445bfbc2f819d4a134847/users/5b118a6707de4971afca2892063c4161/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:07.807550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1074/2133] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:31:07 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:07.815141 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cf4c9-6d74-417e-b840-ae9bd65041dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c991e57b3445bfbc2f819d4a134847, user_id=5b118a6707de4971afca2892063c4161, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:07.820682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cf4c9-6d74-417e-b840-ae9bd65041dc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:07.854330 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b66e4e-d318-4997-bd30-fce53c2c193e None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:07.855713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b7b66e4e-d318-4997-bd30-fce53c2c193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:07.913039 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1060/2134] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:07 2021] PUT /identity/v3/projects/e8c991e57b3445bfbc2f819d4a134847/users/5b118a6707de4971afca2892063c4161/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:07.916924 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cf4c9-6d74-417e-b840-ae9bd65041dc admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:07.936552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b66e4e-d318-4997-bd30-fce53c2c193e None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:07.985667 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cf4c9-6d74-417e-b840-ae9bd65041dc admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:07.990692 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c8917-a1a6-4120-92df-50485d7345dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:07.991356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c8917-a1a6-4120-92df-50485d7345dc admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:07.991632 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c8917-a1a6-4120-92df-50485d7345dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:07.991932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c8917-a1a6-4120-92df-50485d7345dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:07.992670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c8917-a1a6-4120-92df-50485d7345dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:07.994302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c8917-a1a6-4120-92df-50485d7345dc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:08.008183 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1061/2135] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:07 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:31:08.010583 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba9815-5690-4269-a757-cb7598066c3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:08.011315 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba9815-5690-4269-a757-cb7598066c3e service swift] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:08.011548 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba9815-5690-4269-a757-cb7598066c3e service swift] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:08.011654 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c8917-a1a6-4120-92df-50485d7345dc admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:08.011907 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba9815-5690-4269-a757-cb7598066c3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:08.021676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c8917-a1a6-4120-92df-50485d7345dc admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:08.026357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45eeb5-c825-43e5-a8df-a6d207fb839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:08.027219 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45eeb5-c825-43e5-a8df-a6d207fb839e admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:08.027489 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45eeb5-c825-43e5-a8df-a6d207fb839e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:08.027857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45eeb5-c825-43e5-a8df-a6d207fb839e admin admin] PATH_INFO: `/v3/projects/e8c991e57b3445bfbc2f819d4a134847/users/5b118a6707de4971afca2892063c4161/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:08.029916 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45eeb5-c825-43e5-a8df-a6d207fb839e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c991e57b3445bfbc2f819d4a134847, user_id=5b118a6707de4971afca2892063c4161, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:08.032555 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45eeb5-c825-43e5-a8df-a6d207fb839e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:08.044698 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1062/2136] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:08 2021] PUT /identity/v3/projects/e8c991e57b3445bfbc2f819d4a134847/users/5b118a6707de4971afca2892063c4161/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:08.064035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d22b6-9372-4f9a-8234-da56973528e1 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:08.064397 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d22b6-9372-4f9a-8234-da56973528e1 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:08.065444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d22b6-9372-4f9a-8234-da56973528e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:08.071365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba9815-5690-4269-a757-cb7598066c3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:08.073031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba9815-5690-4269-a757-cb7598066c3e service swift] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:08.082912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1075/2137] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:31:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 01:31:08.097449 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-a57d22b6-9372-4f9a-8234-da56973528e1 None None] MFA Rules not processed for user `5b118a6707de4971afca2892063c4161`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:08.098809 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a57d22b6-9372-4f9a-8234-da56973528e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:08.213983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1063/2138] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:08 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:31:08.232518 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba9815-5690-4269-a757-cb7598066c3e service swift] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:08.234294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e9ba9815-5690-4269-a757-cb7598066c3e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:08.322015 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba9815-5690-4269-a757-cb7598066c3e service swift] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:08.407587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a284e-2cf3-496d-931f-1d920515edfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:08.409496 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a284e-2cf3-496d-931f-1d920515edfb service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:08.410742 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a284e-2cf3-496d-931f-1d920515edfb service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:08.410933 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a284e-2cf3-496d-931f-1d920515edfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:08.428445 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a284e-2cf3-496d-931f-1d920515edfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:08.430103 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a284e-2cf3-496d-931f-1d920515edfb service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:08.443323 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1076/2139] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:08 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:31:08.514322 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d22b6-9372-4f9a-8234-da56973528e1 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:08.526520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d22b6-9372-4f9a-8234-da56973528e1 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:08.532009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542a2e9-08f7-495c-871f-b662da2f4c66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:08.532670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542a2e9-08f7-495c-871f-b662da2f4c66 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:08.533141 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542a2e9-08f7-495c-871f-b662da2f4c66 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:08.533398 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542a2e9-08f7-495c-871f-b662da2f4c66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:08.616561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542a2e9-08f7-495c-871f-b662da2f4c66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:08.618007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542a2e9-08f7-495c-871f-b662da2f4c66 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:08.627884 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1064/2140] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:08 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:31:11.523981 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a284e-2cf3-496d-931f-1d920515edfb service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:11.526201 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-550a284e-2cf3-496d-931f-1d920515edfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:11.605760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a284e-2cf3-496d-931f-1d920515edfb service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:11.614638 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798a5ee-d4e4-4719-ab9f-9c7deaad0e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:11.615595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798a5ee-d4e4-4719-ab9f-9c7deaad0e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:11.616048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798a5ee-d4e4-4719-ab9f-9c7deaad0e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:11.616363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798a5ee-d4e4-4719-ab9f-9c7deaad0e0a admin admin] PATH_INFO: `/v3/users/cc3eb7f733d94a68b7eb6c0ea7aaeb45` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:11.617610 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798a5ee-d4e4-4719-ab9f-9c7deaad0e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3eb7f733d94a68b7eb6c0ea7aaeb45)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:11.619543 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798a5ee-d4e4-4719-ab9f-9c7deaad0e0a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:11.821592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6798a5ee-d4e4-4719-ab9f-9c7deaad0e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3eb7f733d94a68b7eb6c0ea7aaeb45'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:11.822509 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6798a5ee-d4e4-4719-ab9f-9c7deaad0e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3eb7f733d94a68b7eb6c0ea7aaeb45'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:11.843589 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6798a5ee-d4e4-4719-ab9f-9c7deaad0e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3eb7f733d94a68b7eb6c0ea7aaeb45'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:11.862570 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6798a5ee-d4e4-4719-ab9f-9c7deaad0e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3eb7f733d94a68b7eb6c0ea7aaeb45'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:11.971802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6798a5ee-d4e4-4719-ab9f-9c7deaad0e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3eb7f733d94a68b7eb6c0ea7aaeb45'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:11.979243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1077/2141] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:31:11 2021] DELETE /identity/v3/users/cc3eb7f733d94a68b7eb6c0ea7aaeb45 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:11.988770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd050f4-dd03-4fc7-b47a-8c7b1566a1c8 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:11.989325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd050f4-dd03-4fc7-b47a-8c7b1566a1c8 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:11.989325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd050f4-dd03-4fc7-b47a-8c7b1566a1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:12.010735 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-edd050f4-dd03-4fc7-b47a-8c7b1566a1c8 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:12.012348 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-edd050f4-dd03-4fc7-b47a-8c7b1566a1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:12.098454 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1065/2142] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:12.129136 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798a5ee-d4e4-4719-ab9f-9c7deaad0e0a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:12.130593 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6798a5ee-d4e4-4719-ab9f-9c7deaad0e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:12.231661 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798a5ee-d4e4-4719-ab9f-9c7deaad0e0a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:12.239646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba68f6f-be7d-442b-b783-9590e4623cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:12.240359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba68f6f-be7d-442b-b783-9590e4623cfb service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:12.240640 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba68f6f-be7d-442b-b783-9590e4623cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:12.241160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba68f6f-be7d-442b-b783-9590e4623cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:12.271138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba68f6f-be7d-442b-b783-9590e4623cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:12.271138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba68f6f-be7d-442b-b783-9590e4623cfb service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:12.275793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1078/2143] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:31:12.839233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd050f4-dd03-4fc7-b47a-8c7b1566a1c8 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:12.840754 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-edd050f4-dd03-4fc7-b47a-8c7b1566a1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:12.852945 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd050f4-dd03-4fc7-b47a-8c7b1566a1c8 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:12.858050 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6361283-99b7-440e-912d-bc7df1477626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:12.858380 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6361283-99b7-440e-912d-bc7df1477626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:12.858659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6361283-99b7-440e-912d-bc7df1477626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:12.858933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6361283-99b7-440e-912d-bc7df1477626 admin admin] PATH_INFO: `/v3/users/b9bb9529a960430da945719a7f8782ff` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:12.860182 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6361283-99b7-440e-912d-bc7df1477626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9bb9529a960430da945719a7f8782ff)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:12.862095 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6361283-99b7-440e-912d-bc7df1477626 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:12.929811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba68f6f-be7d-442b-b783-9590e4623cfb service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:12.931298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-9ba68f6f-be7d-442b-b783-9590e4623cfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:12.944829 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba68f6f-be7d-442b-b783-9590e4623cfb service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:12.950084 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73430b59-1576-4c48-bf54-24b75ae00145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:12.951181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73430b59-1576-4c48-bf54-24b75ae00145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:12.951621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73430b59-1576-4c48-bf54-24b75ae00145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:12.952092 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73430b59-1576-4c48-bf54-24b75ae00145 admin admin] PATH_INFO: `/v3/projects/74788b1739ab4f55a8f166e0748d7eef` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:12.953482 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73430b59-1576-4c48-bf54-24b75ae00145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74788b1739ab4f55a8f166e0748d7eef)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:12.955633 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73430b59-1576-4c48-bf54-24b75ae00145 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:13.212761 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a6361283-99b7-440e-912d-bc7df1477626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9bb9529a960430da945719a7f8782ff'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:13.213393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-73430b59-1576-4c48-bf54-24b75ae00145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74788b1739ab4f55a8f166e0748d7eef', 'request_id': 'req-73430b59-1576-4c48-bf54-24b75ae00145'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:13.221980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a6361283-99b7-440e-912d-bc7df1477626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9bb9529a960430da945719a7f8782ff'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:13.223148 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a6361283-99b7-440e-912d-bc7df1477626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9bb9529a960430da945719a7f8782ff'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:13.236311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a6361283-99b7-440e-912d-bc7df1477626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9bb9529a960430da945719a7f8782ff'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:13.281162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-73430b59-1576-4c48-bf54-24b75ae00145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74788b1739ab4f55a8f166e0748d7eef', 'request_id': 'req-73430b59-1576-4c48-bf54-24b75ae00145'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:13.288532 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-73430b59-1576-4c48-bf54-24b75ae00145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74788b1739ab4f55a8f166e0748d7eef', 'request_id': 'req-73430b59-1576-4c48-bf54-24b75ae00145'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:13.300946 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-73430b59-1576-4c48-bf54-24b75ae00145 admin admin] The token cache is being invalidate because project 74788b1739ab4f55a8f166e0748d7eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:31:13.301234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-73430b59-1576-4c48-bf54-24b75ae00145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:13.301967 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-73430b59-1576-4c48-bf54-24b75ae00145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:13.303829 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1079/2144] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:31:12 2021] DELETE /identity/v3/projects/74788b1739ab4f55a8f166e0748d7eef => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:31:13.394089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a6361283-99b7-440e-912d-bc7df1477626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9bb9529a960430da945719a7f8782ff'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:13.394089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1066/2145] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:31:12 2021] DELETE /identity/v3/users/b9bb9529a960430da945719a7f8782ff => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:13.396682 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d522141-13f7-4938-ba7d-3a814c2fa3ba None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:13.397280 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d522141-13f7-4938-ba7d-3a814c2fa3ba None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:13.397864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d522141-13f7-4938-ba7d-3a814c2fa3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:13.422757 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-1d522141-13f7-4938-ba7d-3a814c2fa3ba None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:13.424726 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1d522141-13f7-4938-ba7d-3a814c2fa3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:13.497794 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1080/2146] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:13.509763 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6361283-99b7-440e-912d-bc7df1477626 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:13.511392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a6361283-99b7-440e-912d-bc7df1477626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:13.570820 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6361283-99b7-440e-912d-bc7df1477626 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:13.574778 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b6407-1ce7-427f-bcf4-812443004cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:13.575688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b6407-1ce7-427f-bcf4-812443004cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:13.575994 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b6407-1ce7-427f-bcf4-812443004cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:13.576262 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b6407-1ce7-427f-bcf4-812443004cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:13.587397 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b6407-1ce7-427f-bcf4-812443004cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:13.588953 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b6407-1ce7-427f-bcf4-812443004cc0 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:13.600142 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1067/2147] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:31:14.092671 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d522141-13f7-4938-ba7d-3a814c2fa3ba None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:14.094736 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1d522141-13f7-4938-ba7d-3a814c2fa3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:14.120056 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d522141-13f7-4938-ba7d-3a814c2fa3ba None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:14.128780 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:14.129787 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:14.129938 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:14.130204 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] PATH_INFO: `/v3/projects/69d6ff02dedd4e8082a8ac5055ee1c86` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:14.132004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d6ff02dedd4e8082a8ac5055ee1c86)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:14.134030 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:14.294166 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d6ff02dedd4e8082a8ac5055ee1c86', 'request_id': 'req-67acd4f2-2682-445c-87be-aaa94c3601e1'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.433664 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d6ff02dedd4e8082a8ac5055ee1c86', 'request_id': 'req-67acd4f2-2682-445c-87be-aaa94c3601e1'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.440270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b6407-1ce7-427f-bcf4-812443004cc0 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:14.441271 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d6ff02dedd4e8082a8ac5055ee1c86', 'request_id': 'req-67acd4f2-2682-445c-87be-aaa94c3601e1'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.442480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-902b6407-1ce7-427f-bcf4-812443004cc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:14.455636 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] The token cache is being invalidate because project 69d6ff02dedd4e8082a8ac5055ee1c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:31:14.458197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b6407-1ce7-427f-bcf4-812443004cc0 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:14.458471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.459901 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.462171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1081/2148] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:31:14 2021] DELETE /identity/v3/projects/69d6ff02dedd4e8082a8ac5055ee1c86 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:14.465643 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:14.467110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:14.541392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0a067-07af-4346-879f-c8402d2d59cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:14.544323 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acd4f2-2682-445c-87be-aaa94c3601e1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:14.548284 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0a067-07af-4346-879f-c8402d2d59cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:14.548810 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0a067-07af-4346-879f-c8402d2d59cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:14.549300 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0a067-07af-4346-879f-c8402d2d59cb admin admin] PATH_INFO: `/v3/users/f225846947484370b849f48d5785b703` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:14.551487 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0a067-07af-4346-879f-c8402d2d59cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f225846947484370b849f48d5785b703)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:14.553663 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0f65e-fa77-4eb0-9945-2e152d1a3352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:14.554812 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0a067-07af-4346-879f-c8402d2d59cb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:14.555016 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0f65e-fa77-4eb0-9945-2e152d1a3352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:14.555300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0f65e-fa77-4eb0-9945-2e152d1a3352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:14.555554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0f65e-fa77-4eb0-9945-2e152d1a3352 admin admin] PATH_INFO: `/v3/users/3c0d760f7d5b4136a91f203f34ae001d` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:14.557533 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0f65e-fa77-4eb0-9945-2e152d1a3352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0d760f7d5b4136a91f203f34ae001d)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:14.560845 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0f65e-fa77-4eb0-9945-2e152d1a3352 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:14.774794 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-46d0f65e-fa77-4eb0-9945-2e152d1a3352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0d760f7d5b4136a91f203f34ae001d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.775384 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-46d0f65e-fa77-4eb0-9945-2e152d1a3352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0d760f7d5b4136a91f203f34ae001d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.789957 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-46d0f65e-fa77-4eb0-9945-2e152d1a3352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0d760f7d5b4136a91f203f34ae001d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.802971 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-46d0f65e-fa77-4eb0-9945-2e152d1a3352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0d760f7d5b4136a91f203f34ae001d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.837751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-13f0a067-07af-4346-879f-c8402d2d59cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f225846947484370b849f48d5785b703'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.845400 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-13f0a067-07af-4346-879f-c8402d2d59cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f225846947484370b849f48d5785b703'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.846313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-13f0a067-07af-4346-879f-c8402d2d59cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f225846947484370b849f48d5785b703'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.860236 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-13f0a067-07af-4346-879f-c8402d2d59cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f225846947484370b849f48d5785b703'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.895578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-46d0f65e-fa77-4eb0-9945-2e152d1a3352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0d760f7d5b4136a91f203f34ae001d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.903234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1082/2149] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:31:14 2021] DELETE /identity/v3/users/3c0d760f7d5b4136a91f203f34ae001d => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:31:14.984590 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-13f0a067-07af-4346-879f-c8402d2d59cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f225846947484370b849f48d5785b703'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:14.996884 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1068/2150] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:31:14 2021] DELETE /identity/v3/users/f225846947484370b849f48d5785b703 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:31:15.001680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f455fcd-26c6-472f-8de9-1034dcb71ec3 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:15.002999 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f455fcd-26c6-472f-8de9-1034dcb71ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:15.003283 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f455fcd-26c6-472f-8de9-1034dcb71ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:15.024482 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-3f455fcd-26c6-472f-8de9-1034dcb71ec3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:15.025710 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3f455fcd-26c6-472f-8de9-1034dcb71ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:15.122130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1083/2151] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:15.136304 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0a067-07af-4346-879f-c8402d2d59cb admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:15.138479 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-13f0a067-07af-4346-879f-c8402d2d59cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:15.228946 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0a067-07af-4346-879f-c8402d2d59cb admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:15.234093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c5221-9a87-4ddc-8b88-9b7d6f5c4142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:15.234769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c5221-9a87-4ddc-8b88-9b7d6f5c4142 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:15.235051 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c5221-9a87-4ddc-8b88-9b7d6f5c4142 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:15.235961 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c5221-9a87-4ddc-8b88-9b7d6f5c4142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:15.255445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c5221-9a87-4ddc-8b88-9b7d6f5c4142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:15.257769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c5221-9a87-4ddc-8b88-9b7d6f5c4142 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:15.274938 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1069/2152] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:31:15.546854 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f455fcd-26c6-472f-8de9-1034dcb71ec3 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:15.548342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3f455fcd-26c6-472f-8de9-1034dcb71ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:15.575362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f455fcd-26c6-472f-8de9-1034dcb71ec3 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:15.575833 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ca771-e2b3-4446-9500-50f74d5cd959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:15.576369 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca771-e2b3-4446-9500-50f74d5cd959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:15.576695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca771-e2b3-4446-9500-50f74d5cd959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:15.577178 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca771-e2b3-4446-9500-50f74d5cd959 admin admin] PATH_INFO: `/v3/projects/0cc10225d446465cb2feb232e45389fe` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:15.578370 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ca771-e2b3-4446-9500-50f74d5cd959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc10225d446465cb2feb232e45389fe)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:15.582082 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ca771-e2b3-4446-9500-50f74d5cd959 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:15.716785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-b91ca771-e2b3-4446-9500-50f74d5cd959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc10225d446465cb2feb232e45389fe', 'request_id': 'req-b91ca771-e2b3-4446-9500-50f74d5cd959'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:15.853294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-b91ca771-e2b3-4446-9500-50f74d5cd959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc10225d446465cb2feb232e45389fe', 'request_id': 'req-b91ca771-e2b3-4446-9500-50f74d5cd959'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:15.859208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-b91ca771-e2b3-4446-9500-50f74d5cd959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc10225d446465cb2feb232e45389fe', 'request_id': 'req-b91ca771-e2b3-4446-9500-50f74d5cd959'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:15.871679 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c5221-9a87-4ddc-8b88-9b7d6f5c4142 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:15.876222 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9f0c5221-9a87-4ddc-8b88-9b7d6f5c4142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:15.904088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c5221-9a87-4ddc-8b88-9b7d6f5c4142 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:15.910523 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-b91ca771-e2b3-4446-9500-50f74d5cd959 admin admin] The token cache is being invalidate because project 0cc10225d446465cb2feb232e45389fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:31:15.911060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-b91ca771-e2b3-4446-9500-50f74d5cd959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:15.911970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-b91ca771-e2b3-4446-9500-50f74d5cd959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:15.920808 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1084/2153] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:31:15 2021] DELETE /identity/v3/projects/0cc10225d446465cb2feb232e45389fe => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:31:15.922662 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b2026-c432-4db4-8098-02036d22459b None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:15.922932 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b2026-c432-4db4-8098-02036d22459b None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:15.923432 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b2026-c432-4db4-8098-02036d22459b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:15.950201 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-320b2026-c432-4db4-8098-02036d22459b None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:15.951579 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-320b2026-c432-4db4-8098-02036d22459b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:16.043754 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:16.044629 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:16.046592 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:16.047372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] PATH_INFO: `/v3/projects/77cfa6e2ed3943bf8934ecf414ad3b6b` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:16.051879 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77cfa6e2ed3943bf8934ecf414ad3b6b)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:16.058404 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:16.068255 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1085/2154] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:16.083500 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e2738-8b70-4ba3-9a7a-62161993849f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:16.084142 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e2738-8b70-4ba3-9a7a-62161993849f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:16.084608 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e2738-8b70-4ba3-9a7a-62161993849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:16.134773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d54e2738-8b70-4ba3-9a7a-62161993849f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:16.140706 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d54e2738-8b70-4ba3-9a7a-62161993849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:16.166948 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1086/2155] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:31:16.168098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e2738-8b70-4ba3-9a7a-62161993849f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:16.188975 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e2738-8b70-4ba3-9a7a-62161993849f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:16.196629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38e7a-0342-4a7d-9656-39cf12db665d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:16.197598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38e7a-0342-4a7d-9656-39cf12db665d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:16.198064 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38e7a-0342-4a7d-9656-39cf12db665d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:16.198528 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38e7a-0342-4a7d-9656-39cf12db665d admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:16.199345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f38e7a-0342-4a7d-9656-39cf12db665d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:31:16.200166 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f38e7a-0342-4a7d-9656-39cf12db665d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:16.202203 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f38e7a-0342-4a7d-9656-39cf12db665d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:16.217540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1087/2156] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:31:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:31:16.222963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38e7a-0342-4a7d-9656-39cf12db665d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:16.231386 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77cfa6e2ed3943bf8934ecf414ad3b6b', 'request_id': 'req-1249f2f4-90ee-49ff-9839-984fcc284a76'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:16.243793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38e7a-0342-4a7d-9656-39cf12db665d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:16.307409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2659a1-1e3b-4177-9311-1f257459d5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:16.308110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2659a1-1e3b-4177-9311-1f257459d5ad admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:16.308397 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2659a1-1e3b-4177-9311-1f257459d5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:16.308716 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2659a1-1e3b-4177-9311-1f257459d5ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:16.311880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2659a1-1e3b-4177-9311-1f257459d5ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:16.311880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2659a1-1e3b-4177-9311-1f257459d5ad admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:16.367363 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77cfa6e2ed3943bf8934ecf414ad3b6b', 'request_id': 'req-1249f2f4-90ee-49ff-9839-984fcc284a76'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:16.373239 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77cfa6e2ed3943bf8934ecf414ad3b6b', 'request_id': 'req-1249f2f4-90ee-49ff-9839-984fcc284a76'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:16.384812 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] The token cache is being invalidate because project 77cfa6e2ed3943bf8934ecf414ad3b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:31:16.385103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:16.385733 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:16.387506 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1070/2157] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:31:15 2021] DELETE /identity/v3/projects/77cfa6e2ed3943bf8934ecf414ad3b6b => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:16.391357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:16.393140 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:16.409298 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249f2f4-90ee-49ff-9839-984fcc284a76 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:16.415595 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ad4f6-736f-4871-b699-6f1ef0c33d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:16.416242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad4f6-736f-4871-b699-6f1ef0c33d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:16.416543 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad4f6-736f-4871-b699-6f1ef0c33d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:16.416937 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad4f6-736f-4871-b699-6f1ef0c33d61 admin admin] PATH_INFO: `/v3/users/5b118a6707de4971afca2892063c4161` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:16.418264 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ad4f6-736f-4871-b699-6f1ef0c33d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b118a6707de4971afca2892063c4161)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:16.421122 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ad4f6-736f-4871-b699-6f1ef0c33d61 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:16.428275 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1088/2158] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:31:16 2021] POST /identity/v3/projects => generated 359 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:16.432623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2659a1-1e3b-4177-9311-1f257459d5ad admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:16.434472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6d2659a1-1e3b-4177-9311-1f257459d5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:16.504214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2659a1-1e3b-4177-9311-1f257459d5ad admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:16.510564 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62943b77-35a8-45e9-be8e-b281a5175884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:16.511581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62943b77-35a8-45e9-be8e-b281a5175884 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:16.511936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62943b77-35a8-45e9-be8e-b281a5175884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:16.512210 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62943b77-35a8-45e9-be8e-b281a5175884 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:16.512928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62943b77-35a8-45e9-be8e-b281a5175884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:16.515151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62943b77-35a8-45e9-be8e-b281a5175884 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:16.694881 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1089/2159] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:31:16 2021] POST /identity/v3/users => generated 280 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:16.701052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6a7ad4f6-736f-4871-b699-6f1ef0c33d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b118a6707de4971afca2892063c4161'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:16.702619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62943b77-35a8-45e9-be8e-b281a5175884 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:16.711476 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6a7ad4f6-736f-4871-b699-6f1ef0c33d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b118a6707de4971afca2892063c4161'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:16.713133 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6a7ad4f6-736f-4871-b699-6f1ef0c33d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b118a6707de4971afca2892063c4161'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:16.733614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6a7ad4f6-736f-4871-b699-6f1ef0c33d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b118a6707de4971afca2892063c4161'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:16.740061 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62943b77-35a8-45e9-be8e-b281a5175884 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:16.752969 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848581c2-ba43-42e7-883b-eae9e4da76ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:16.754109 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848581c2-ba43-42e7-883b-eae9e4da76ae admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:16.755916 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848581c2-ba43-42e7-883b-eae9e4da76ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:16.756486 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848581c2-ba43-42e7-883b-eae9e4da76ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:16.758325 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848581c2-ba43-42e7-883b-eae9e4da76ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:16.760352 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848581c2-ba43-42e7-883b-eae9e4da76ae admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:16.775926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1090/2160] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:16 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:16.779349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848581c2-ba43-42e7-883b-eae9e4da76ae admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:16.781155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-848581c2-ba43-42e7-883b-eae9e4da76ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:16.796742 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848581c2-ba43-42e7-883b-eae9e4da76ae admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:16.801905 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcbc7b-4684-4476-874f-00b28dcd5aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:16.807076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcbc7b-4684-4476-874f-00b28dcd5aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:16.807076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcbc7b-4684-4476-874f-00b28dcd5aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:16.807076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcbc7b-4684-4476-874f-00b28dcd5aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:16.807076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcbc7b-4684-4476-874f-00b28dcd5aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:16.807076 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcbc7b-4684-4476-874f-00b28dcd5aa5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:16.816747 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1091/2161] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:16 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:31:16.820984 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcbc7b-4684-4476-874f-00b28dcd5aa5 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:16.833327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcbc7b-4684-4476-874f-00b28dcd5aa5 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:16.838308 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8df3c-22ce-47fe-9ba2-9a75458ec174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:16.839282 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8df3c-22ce-47fe-9ba2-9a75458ec174 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:16.839494 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8df3c-22ce-47fe-9ba2-9a75458ec174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:16.839807 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8df3c-22ce-47fe-9ba2-9a75458ec174 admin admin] PATH_INFO: `/v3/projects/7abff548656944c7b7a37a1bf87a1cc0/users/35e38ade4c614a19aed2f64f78872484/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:16.858550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8df3c-22ce-47fe-9ba2-9a75458ec174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abff548656944c7b7a37a1bf87a1cc0, user_id=35e38ade4c614a19aed2f64f78872484, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:16.870045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8df3c-22ce-47fe-9ba2-9a75458ec174 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:16.944722 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6a7ad4f6-736f-4871-b699-6f1ef0c33d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b118a6707de4971afca2892063c4161'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:16.954710 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1071/2162] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:31:16 2021] DELETE /identity/v3/users/5b118a6707de4971afca2892063c4161 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:31:16.993059 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1092/2163] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:16 2021] PUT /identity/v3/projects/7abff548656944c7b7a37a1bf87a1cc0/users/35e38ade4c614a19aed2f64f78872484/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:31:17.010611 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff48e2-1efd-4a24-84d4-23e32711ced4 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:17.011094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff48e2-1efd-4a24-84d4-23e32711ced4 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:17.011449 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff48e2-1efd-4a24-84d4-23e32711ced4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:17.063990 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-12ff48e2-1efd-4a24-84d4-23e32711ced4 None None] MFA Rules not processed for user `35e38ade4c614a19aed2f64f78872484`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:17.066040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-12ff48e2-1efd-4a24-84d4-23e32711ced4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:17.171899 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1072/2164] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:17 2021] POST /identity/v3/auth/tokens => generated 3379 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:17.206431 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8df3c-22ce-47fe-9ba2-9a75458ec174 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:17.209145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-edb8df3c-22ce-47fe-9ba2-9a75458ec174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:17.310433 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8df3c-22ce-47fe-9ba2-9a75458ec174 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:17.319348 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7e8b4-0a54-4252-b67c-fa8d2ecb145c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:17.320806 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7e8b4-0a54-4252-b67c-fa8d2ecb145c service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:17.321328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7e8b4-0a54-4252-b67c-fa8d2ecb145c service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:17.321677 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7e8b4-0a54-4252-b67c-fa8d2ecb145c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:17.335420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7e8b4-0a54-4252-b67c-fa8d2ecb145c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:17.337686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7e8b4-0a54-4252-b67c-fa8d2ecb145c service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:17.352189 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1093/2165] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:17 2021] GET /identity/v3/auth/tokens => generated 3379 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:31:17.367474 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff48e2-1efd-4a24-84d4-23e32711ced4 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:17.453822 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff48e2-1efd-4a24-84d4-23e32711ced4 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:17.459134 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7056c7-188b-43a0-aee5-ccb38977d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:17.460142 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7056c7-188b-43a0-aee5-ccb38977d181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:17.460422 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7056c7-188b-43a0-aee5-ccb38977d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:17.460699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7056c7-188b-43a0-aee5-ccb38977d181 admin admin] PATH_INFO: `/v3/users/35e38ade4c614a19aed2f64f78872484` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:17.462947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7056c7-188b-43a0-aee5-ccb38977d181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e38ade4c614a19aed2f64f78872484)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:17.465093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7056c7-188b-43a0-aee5-ccb38977d181 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:17.578207 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7e8b4-0a54-4252-b67c-fa8d2ecb145c service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:17.580735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c7f7e8b4-0a54-4252-b67c-fa8d2ecb145c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:17.608187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7e8b4-0a54-4252-b67c-fa8d2ecb145c service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:17.613317 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:17.614174 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:17.614451 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:17.614725 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40 admin admin] PATH_INFO: `/v3/projects/e8c991e57b3445bfbc2f819d4a134847` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:17.616001 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c991e57b3445bfbc2f819d4a134847)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:17.617910 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:17.673389 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-7f7056c7-188b-43a0-aee5-ccb38977d181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e38ade4c614a19aed2f64f78872484'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:17.680172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-7f7056c7-188b-43a0-aee5-ccb38977d181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e38ade4c614a19aed2f64f78872484'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:17.681499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-7f7056c7-188b-43a0-aee5-ccb38977d181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e38ade4c614a19aed2f64f78872484'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:17.692164 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-7f7056c7-188b-43a0-aee5-ccb38977d181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e38ade4c614a19aed2f64f78872484'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:17.725811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c991e57b3445bfbc2f819d4a134847', 'request_id': 'req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:17.773244 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-7f7056c7-188b-43a0-aee5-ccb38977d181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e38ade4c614a19aed2f64f78872484'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:17.783989 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1073/2166] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:31:17 2021] DELETE /identity/v3/users/35e38ade4c614a19aed2f64f78872484 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:17.787283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14e1f-670e-4ecb-97ea-49f994f36bb5 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:17.787637 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14e1f-670e-4ecb-97ea-49f994f36bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:17.788025 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14e1f-670e-4ecb-97ea-49f994f36bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:17.808466 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-fef14e1f-670e-4ecb-97ea-49f994f36bb5 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:17.809784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-fef14e1f-670e-4ecb-97ea-49f994f36bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:17.835896 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c991e57b3445bfbc2f819d4a134847', 'request_id': 'req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:17.843915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c991e57b3445bfbc2f819d4a134847', 'request_id': 'req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:17.861451 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40 admin admin] The token cache is being invalidate because project e8c991e57b3445bfbc2f819d4a134847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:31:17.861737 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:17.862594 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9c4a0106-e9a2-4103-bf3a-b9f8c0b86e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:17.865472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1094/2167] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:31:17 2021] DELETE /identity/v3/projects/e8c991e57b3445bfbc2f819d4a134847 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:31:17.880413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b754d6f-9375-4210-9acc-cd4f2ce54bd3 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:17.881131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b754d6f-9375-4210-9acc-cd4f2ce54bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:17.881131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b754d6f-9375-4210-9acc-cd4f2ce54bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:17.909979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-0b754d6f-9375-4210-9acc-cd4f2ce54bd3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:17.911245 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0b754d6f-9375-4210-9acc-cd4f2ce54bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:17.923344 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1095/2168] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:17.933765 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1074/2169] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:17.934819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5c24a-ec22-4c1e-a9d2-f4d5baf044b6 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:17.935108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5c24a-ec22-4c1e-a9d2-f4d5baf044b6 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:17.935388 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5c24a-ec22-4c1e-a9d2-f4d5baf044b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:17.951270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef14e1f-670e-4ecb-97ea-49f994f36bb5 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:17.956226 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-fef14e1f-670e-4ecb-97ea-49f994f36bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:17.957692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-60e5c24a-ec22-4c1e-a9d2-f4d5baf044b6 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:17.958991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-60e5c24a-ec22-4c1e-a9d2-f4d5baf044b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:17.972403 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1096/2170] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:17.977128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5c24a-ec22-4c1e-a9d2-f4d5baf044b6 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:17.992610 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5c24a-ec22-4c1e-a9d2-f4d5baf044b6 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:18.021678 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160750f-c438-4c57-a641-33c2910723b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:18.022836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160750f-c438-4c57-a641-33c2910723b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:18.024774 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160750f-c438-4c57-a641-33c2910723b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:18.025079 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160750f-c438-4c57-a641-33c2910723b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:18.026004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160750f-c438-4c57-a641-33c2910723b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:31:18.026441 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160750f-c438-4c57-a641-33c2910723b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:18.028407 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160750f-c438-4c57-a641-33c2910723b8 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:18.039927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef14e1f-670e-4ecb-97ea-49f994f36bb5 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:18.044451 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8327d-23b3-40e7-8052-036490e85189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:18.045092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8327d-23b3-40e7-8052-036490e85189 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:18.046760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8327d-23b3-40e7-8052-036490e85189 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:18.046760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8327d-23b3-40e7-8052-036490e85189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:18.051768 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1097/2171] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:31:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:31:18.053562 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160750f-c438-4c57-a641-33c2910723b8 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:18.059121 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8327d-23b3-40e7-8052-036490e85189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:18.061545 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8327d-23b3-40e7-8052-036490e85189 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:18.065934 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160750f-c438-4c57-a641-33c2910723b8 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:18.072039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fe5cc-4fce-4df7-ae25-b1a353bf3031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:18.072704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fe5cc-4fce-4df7-ae25-b1a353bf3031 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:18.073021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fe5cc-4fce-4df7-ae25-b1a353bf3031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:18.073300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fe5cc-4fce-4df7-ae25-b1a353bf3031 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:18.074033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fe5cc-4fce-4df7-ae25-b1a353bf3031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:18.075618 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1075/2172] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:31:18.076310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fe5cc-4fce-4df7-ae25-b1a353bf3031 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:18.171155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1098/2173] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:31:18 2021] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:18.172561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8327d-23b3-40e7-8052-036490e85189 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:18.184085 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8327d-23b3-40e7-8052-036490e85189 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:18.274155 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fec56e-0181-4f93-b839-368cb13bec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:18.275043 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fec56e-0181-4f93-b839-368cb13bec78 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:18.275321 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fec56e-0181-4f93-b839-368cb13bec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:18.275591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fec56e-0181-4f93-b839-368cb13bec78 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:18.276352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fec56e-0181-4f93-b839-368cb13bec78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:18.285933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fec56e-0181-4f93-b839-368cb13bec78 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:18.386462 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1076/2174] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:31:18 2021] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:18.390333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fe5cc-4fce-4df7-ae25-b1a353bf3031 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:18.404628 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fe5cc-4fce-4df7-ae25-b1a353bf3031 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:18.418232 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ce0a0-fd35-4897-9979-2f82b2197c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:18.419947 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ce0a0-fd35-4897-9979-2f82b2197c93 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:18.420495 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ce0a0-fd35-4897-9979-2f82b2197c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:18.420773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ce0a0-fd35-4897-9979-2f82b2197c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:18.421533 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ce0a0-fd35-4897-9979-2f82b2197c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:18.423215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ce0a0-fd35-4897-9979-2f82b2197c93 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:18.436262 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1099/2175] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:18 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:18.441250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fec56e-0181-4f93-b839-368cb13bec78 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:18.452809 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fec56e-0181-4f93-b839-368cb13bec78 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:18.460042 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bfa4c-b7ff-4534-8d66-9fcd9c72a2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:18.461095 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bfa4c-b7ff-4534-8d66-9fcd9c72a2ed admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:18.461612 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bfa4c-b7ff-4534-8d66-9fcd9c72a2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:18.462276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bfa4c-b7ff-4534-8d66-9fcd9c72a2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:18.463291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bfa4c-b7ff-4534-8d66-9fcd9c72a2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:18.465303 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bfa4c-b7ff-4534-8d66-9fcd9c72a2ed admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:18.481030 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1077/2176] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:18 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:31:18.485358 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ce0a0-fd35-4897-9979-2f82b2197c93 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:18.498226 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ce0a0-fd35-4897-9979-2f82b2197c93 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:18.505031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd9f54-dc2e-4c94-b27a-4c5885b219fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:18.506183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd9f54-dc2e-4c94-b27a-4c5885b219fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:18.507910 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd9f54-dc2e-4c94-b27a-4c5885b219fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:18.507910 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd9f54-dc2e-4c94-b27a-4c5885b219fd admin admin] PATH_INFO: `/v3/projects/ecc8a9d6748a4e94861b24d80cdc0a0d/users/4ac5f094f74e4dfb893ccf4221dfcff6/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:18.525333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd9f54-dc2e-4c94-b27a-4c5885b219fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc8a9d6748a4e94861b24d80cdc0a0d, user_id=4ac5f094f74e4dfb893ccf4221dfcff6, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:18.528746 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd9f54-dc2e-4c94-b27a-4c5885b219fd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:18.655694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1100/2177] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:18 2021] PUT /identity/v3/projects/ecc8a9d6748a4e94861b24d80cdc0a0d/users/4ac5f094f74e4dfb893ccf4221dfcff6/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:18.672076 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f173e58-3992-45f0-91fe-fb7a9ca1d75c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:18.672076 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f173e58-3992-45f0-91fe-fb7a9ca1d75c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:18.672076 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f173e58-3992-45f0-91fe-fb7a9ca1d75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:18.684724 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-1f173e58-3992-45f0-91fe-fb7a9ca1d75c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:18.686254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-1f173e58-3992-45f0-91fe-fb7a9ca1d75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:18.701657 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd9f54-dc2e-4c94-b27a-4c5885b219fd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:18.706972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-52dd9f54-dc2e-4c94-b27a-4c5885b219fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:18.796854 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1078/2178] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:18.809734 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f173e58-3992-45f0-91fe-fb7a9ca1d75c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:18.812023 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-1f173e58-3992-45f0-91fe-fb7a9ca1d75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:18.835634 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd9f54-dc2e-4c94-b27a-4c5885b219fd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:18.843674 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68babaf-58c8-49bd-8600-9fe1075ce683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:18.844917 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68babaf-58c8-49bd-8600-9fe1075ce683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:18.845202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68babaf-58c8-49bd-8600-9fe1075ce683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:18.846087 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68babaf-58c8-49bd-8600-9fe1075ce683 admin admin] PATH_INFO: `/v3/projects/7abff548656944c7b7a37a1bf87a1cc0` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:18.849317 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68babaf-58c8-49bd-8600-9fe1075ce683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7abff548656944c7b7a37a1bf87a1cc0)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:18.851345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68babaf-58c8-49bd-8600-9fe1075ce683 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:18.933441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f173e58-3992-45f0-91fe-fb7a9ca1d75c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:18.937363 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc1a50-51be-467c-9384-dbce903fccc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:18.938376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc1a50-51be-467c-9384-dbce903fccc5 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:18.938671 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc1a50-51be-467c-9384-dbce903fccc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:18.938952 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc1a50-51be-467c-9384-dbce903fccc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:18.951336 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc1a50-51be-467c-9384-dbce903fccc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:18.952842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc1a50-51be-467c-9384-dbce903fccc5 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:18.967793 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1079/2179] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:31:19.054705 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-f68babaf-58c8-49bd-8600-9fe1075ce683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7abff548656944c7b7a37a1bf87a1cc0', 'request_id': 'req-f68babaf-58c8-49bd-8600-9fe1075ce683'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:19.157161 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-f68babaf-58c8-49bd-8600-9fe1075ce683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7abff548656944c7b7a37a1bf87a1cc0', 'request_id': 'req-f68babaf-58c8-49bd-8600-9fe1075ce683'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:19.175308 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-f68babaf-58c8-49bd-8600-9fe1075ce683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7abff548656944c7b7a37a1bf87a1cc0', 'request_id': 'req-f68babaf-58c8-49bd-8600-9fe1075ce683'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:19.207544 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-f68babaf-58c8-49bd-8600-9fe1075ce683 admin admin] The token cache is being invalidate because project 7abff548656944c7b7a37a1bf87a1cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:31:19.207867 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-f68babaf-58c8-49bd-8600-9fe1075ce683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:19.210488 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-f68babaf-58c8-49bd-8600-9fe1075ce683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:19.214005 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1101/2180] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:31:18 2021] DELETE /identity/v3/projects/7abff548656944c7b7a37a1bf87a1cc0 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:19.220175 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cf916-a103-4fe0-92bb-3d0d1007d377 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:19.220555 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cf916-a103-4fe0-92bb-3d0d1007d377 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:19.221277 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cf916-a103-4fe0-92bb-3d0d1007d377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:19.247076 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-f99cf916-a103-4fe0-92bb-3d0d1007d377 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:19.248349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-f99cf916-a103-4fe0-92bb-3d0d1007d377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:19.333620 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1080/2181] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:19.342306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b23722-6e6d-4cc3-ab93-542ec6f1f714 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:19.346735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b23722-6e6d-4cc3-ab93-542ec6f1f714 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:19.346735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b23722-6e6d-4cc3-ab93-542ec6f1f714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:19.363058 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-40b23722-6e6d-4cc3-ab93-542ec6f1f714 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:19.364457 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-40b23722-6e6d-4cc3-ab93-542ec6f1f714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:19.373097 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1102/2182] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:31:19.378380 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cf916-a103-4fe0-92bb-3d0d1007d377 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:19.388476 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cf916-a103-4fe0-92bb-3d0d1007d377 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:19.396362 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778d330-8174-4a9a-bb6a-154a282fa9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:19.397041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778d330-8174-4a9a-bb6a-154a282fa9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:19.397321 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778d330-8174-4a9a-bb6a-154a282fa9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:19.397603 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778d330-8174-4a9a-bb6a-154a282fa9c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:19.398359 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778d330-8174-4a9a-bb6a-154a282fa9c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:31:19.398658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778d330-8174-4a9a-bb6a-154a282fa9c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:19.400417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778d330-8174-4a9a-bb6a-154a282fa9c3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:19.414516 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1081/2183] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:31:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:31:19.420714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b23722-6e6d-4cc3-ab93-542ec6f1f714 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:19.457446 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b23722-6e6d-4cc3-ab93-542ec6f1f714 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:19.472941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0fb1c-1703-4a19-867b-a0e32737b468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:19.473812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0fb1c-1703-4a19-867b-a0e32737b468 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:19.474205 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0fb1c-1703-4a19-867b-a0e32737b468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:19.474538 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0fb1c-1703-4a19-867b-a0e32737b468 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:19.475560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0fb1c-1703-4a19-867b-a0e32737b468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:19.478220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0fb1c-1703-4a19-867b-a0e32737b468 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:19.659630 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1103/2184] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:31:19 2021] POST /identity/v3/projects => generated 373 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:19.660029 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778d330-8174-4a9a-bb6a-154a282fa9c3 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:19.677607 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778d330-8174-4a9a-bb6a-154a282fa9c3 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:19.787413 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46588d-3423-440a-8eec-612b4db727ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:19.788287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46588d-3423-440a-8eec-612b4db727ac admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:19.788831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46588d-3423-440a-8eec-612b4db727ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:19.789255 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46588d-3423-440a-8eec-612b4db727ac admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:19.790038 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46588d-3423-440a-8eec-612b4db727ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:19.792421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46588d-3423-440a-8eec-612b4db727ac admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:19.885550 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1082/2185] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:31:19 2021] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:19.886720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0fb1c-1703-4a19-867b-a0e32737b468 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:19.900563 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0fb1c-1703-4a19-867b-a0e32737b468 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:19.907492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d6e66-12c1-425d-b04b-eb3c3619138f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:19.910178 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d6e66-12c1-425d-b04b-eb3c3619138f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:19.910465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d6e66-12c1-425d-b04b-eb3c3619138f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:19.910908 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d6e66-12c1-425d-b04b-eb3c3619138f admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:19.911877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d6e66-12c1-425d-b04b-eb3c3619138f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:19.913707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d6e66-12c1-425d-b04b-eb3c3619138f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:19.927181 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1104/2186] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:19 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:19.931377 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46588d-3423-440a-8eec-612b4db727ac admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:19.943321 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46588d-3423-440a-8eec-612b4db727ac admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:19.948107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba9ba6-fcf2-4962-aa13-189670ffd15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:19.948782 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba9ba6-fcf2-4962-aa13-189670ffd15b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:19.949060 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba9ba6-fcf2-4962-aa13-189670ffd15b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:19.949330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba9ba6-fcf2-4962-aa13-189670ffd15b admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:19.950333 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba9ba6-fcf2-4962-aa13-189670ffd15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:19.952132 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba9ba6-fcf2-4962-aa13-189670ffd15b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:19.964618 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1083/2187] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:19 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:19.968697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d6e66-12c1-425d-b04b-eb3c3619138f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:19.979886 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d6e66-12c1-425d-b04b-eb3c3619138f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:19.988213 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129ffe-377f-4b42-a31f-b264a339fd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:19.989308 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129ffe-377f-4b42-a31f-b264a339fd45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:19.989473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129ffe-377f-4b42-a31f-b264a339fd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:19.989752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129ffe-377f-4b42-a31f-b264a339fd45 admin admin] PATH_INFO: `/v3/projects/470e3eaf009647048defa05ad0448ef1/users/1686739decca4ee7838328e9c93965f9/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:20.010081 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f129ffe-377f-4b42-a31f-b264a339fd45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=470e3eaf009647048defa05ad0448ef1, user_id=1686739decca4ee7838328e9c93965f9, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:20.013429 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f129ffe-377f-4b42-a31f-b264a339fd45 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:20.093981 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1105/2188] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:19 2021] PUT /identity/v3/projects/470e3eaf009647048defa05ad0448ef1/users/1686739decca4ee7838328e9c93965f9/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:20.105338 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d305e2d-5f4e-43f1-bba3-8acf1b1d507f None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:20.105882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d305e2d-5f4e-43f1-bba3-8acf1b1d507f None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:20.106084 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d305e2d-5f4e-43f1-bba3-8acf1b1d507f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:20.138594 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-9d305e2d-5f4e-43f1-bba3-8acf1b1d507f None None] MFA Rules not processed for user `1686739decca4ee7838328e9c93965f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:20.139745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9d305e2d-5f4e-43f1-bba3-8acf1b1d507f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:20.211382 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1084/2189] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:20 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:31:20.223458 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129ffe-377f-4b42-a31f-b264a339fd45 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:20.225705 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8f129ffe-377f-4b42-a31f-b264a339fd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:20.307070 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129ffe-377f-4b42-a31f-b264a339fd45 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:20.314233 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dacfe-eea8-4fb0-9904-3348e0dd5b8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:20.315335 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dacfe-eea8-4fb0-9904-3348e0dd5b8d service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:20.315768 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dacfe-eea8-4fb0-9904-3348e0dd5b8d service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:20.316814 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dacfe-eea8-4fb0-9904-3348e0dd5b8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:20.334688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520dacfe-eea8-4fb0-9904-3348e0dd5b8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:20.337296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520dacfe-eea8-4fb0-9904-3348e0dd5b8d service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:20.357161 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1106/2190] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:20 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:31:20.385354 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d305e2d-5f4e-43f1-bba3-8acf1b1d507f None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:20.453766 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d305e2d-5f4e-43f1-bba3-8acf1b1d507f None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:20.459640 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab67d65-cb51-4112-8c96-6aa5ffeb2023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:20.460749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab67d65-cb51-4112-8c96-6aa5ffeb2023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:20.461028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab67d65-cb51-4112-8c96-6aa5ffeb2023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:20.461352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab67d65-cb51-4112-8c96-6aa5ffeb2023 admin admin] PATH_INFO: `/v3/users/1686739decca4ee7838328e9c93965f9` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:20.462968 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab67d65-cb51-4112-8c96-6aa5ffeb2023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1686739decca4ee7838328e9c93965f9)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:20.466296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab67d65-cb51-4112-8c96-6aa5ffeb2023 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:20.701474 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4e226-d934-4294-a0d0-7df98633b189 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:20.702008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4e226-d934-4294-a0d0-7df98633b189 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:20.702008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4e226-d934-4294-a0d0-7df98633b189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:20.712147 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-cab67d65-cb51-4112-8c96-6aa5ffeb2023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1686739decca4ee7838328e9c93965f9'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:20.720228 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-cab67d65-cb51-4112-8c96-6aa5ffeb2023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1686739decca4ee7838328e9c93965f9'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:20.721299 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-cab67d65-cb51-4112-8c96-6aa5ffeb2023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1686739decca4ee7838328e9c93965f9'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:20.733998 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d7d4e226-d934-4294-a0d0-7df98633b189 None None] MFA Rules not processed for user `4ac5f094f74e4dfb893ccf4221dfcff6`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:20.741340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d7d4e226-d934-4294-a0d0-7df98633b189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:20.745524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-cab67d65-cb51-4112-8c96-6aa5ffeb2023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1686739decca4ee7838328e9c93965f9'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:20.837717 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-cab67d65-cb51-4112-8c96-6aa5ffeb2023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1686739decca4ee7838328e9c93965f9'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:20.863775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1085/2191] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:31:20 2021] DELETE /identity/v3/users/1686739decca4ee7838328e9c93965f9 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:20.866405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e3a2-c7d6-405c-8469-67fd804d0e5c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:20.870762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e3a2-c7d6-405c-8469-67fd804d0e5c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:20.871559 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e3a2-c7d6-405c-8469-67fd804d0e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:20.924765 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1107/2192] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:20 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:31:20.934395 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-c2b5e3a2-c7d6-405c-8469-67fd804d0e5c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:20.935250 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4e226-d934-4294-a0d0-7df98633b189 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:20.935653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c2b5e3a2-c7d6-405c-8469-67fd804d0e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:20.936715 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d7d4e226-d934-4294-a0d0-7df98633b189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:20.978454 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4e226-d934-4294-a0d0-7df98633b189 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:21.121545 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1086/2193] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:21.129597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5e3a2-c7d6-405c-8469-67fd804d0e5c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:21.129902 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b75d5-c095-4b1f-8b1e-725275f9138d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:21.130793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b75d5-c095-4b1f-8b1e-725275f9138d admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:21.131292 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b75d5-c095-4b1f-8b1e-725275f9138d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:21.131644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b75d5-c095-4b1f-8b1e-725275f9138d admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:21.132501 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b75d5-c095-4b1f-8b1e-725275f9138d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:21.144539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c2b5e3a2-c7d6-405c-8469-67fd804d0e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:21.144697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b75d5-c095-4b1f-8b1e-725275f9138d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:21.238797 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5e3a2-c7d6-405c-8469-67fd804d0e5c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:21.258322 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f12935-b7b5-4696-82da-c0e55cb6ee64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:21.259255 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f12935-b7b5-4696-82da-c0e55cb6ee64 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:21.259544 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f12935-b7b5-4696-82da-c0e55cb6ee64 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:21.259929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f12935-b7b5-4696-82da-c0e55cb6ee64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:21.276676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f12935-b7b5-4696-82da-c0e55cb6ee64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:21.278122 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f12935-b7b5-4696-82da-c0e55cb6ee64 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:21.289361 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1087/2194] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:31:21.307027 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1108/2195] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:31:20 2021] POST /identity/v3/projects => generated 373 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:21.310965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f12935-b7b5-4696-82da-c0e55cb6ee64 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:21.321813 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f12935-b7b5-4696-82da-c0e55cb6ee64 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:21.382709 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759a3f9-f339-435f-8189-951159392855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:21.383457 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759a3f9-f339-435f-8189-951159392855 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:21.384014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759a3f9-f339-435f-8189-951159392855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:21.384405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759a3f9-f339-435f-8189-951159392855 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:21.385590 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759a3f9-f339-435f-8189-951159392855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:21.388794 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759a3f9-f339-435f-8189-951159392855 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:21.520894 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1088/2196] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:31:21 2021] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:21.523696 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b75d5-c095-4b1f-8b1e-725275f9138d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:21.538110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b75d5-c095-4b1f-8b1e-725275f9138d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:21.546522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798f806-0ea9-4778-8e42-6ac21323aa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:21.547273 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798f806-0ea9-4778-8e42-6ac21323aa49 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:21.547511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798f806-0ea9-4778-8e42-6ac21323aa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:21.547906 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798f806-0ea9-4778-8e42-6ac21323aa49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:21.549147 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798f806-0ea9-4778-8e42-6ac21323aa49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:21.550766 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798f806-0ea9-4778-8e42-6ac21323aa49 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:21.577565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1109/2197] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:21 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:21.584325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759a3f9-f339-435f-8189-951159392855 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:21.598631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759a3f9-f339-435f-8189-951159392855 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:21.605413 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd65ed6-0977-4448-973c-00dd1bdeb441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:21.606791 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd65ed6-0977-4448-973c-00dd1bdeb441 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:21.607089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd65ed6-0977-4448-973c-00dd1bdeb441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:21.607338 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd65ed6-0977-4448-973c-00dd1bdeb441 admin admin] PATH_INFO: `/v3/projects/61b06db331594c8597039ffada0ab5f3/users/52b9dd5f32524ce2b9c30a3c933a2b19/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:21.640980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd65ed6-0977-4448-973c-00dd1bdeb441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b06db331594c8597039ffada0ab5f3, user_id=52b9dd5f32524ce2b9c30a3c933a2b19, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:21.645235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd65ed6-0977-4448-973c-00dd1bdeb441 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:21.722976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1089/2198] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:21 2021] PUT /identity/v3/projects/61b06db331594c8597039ffada0ab5f3/users/52b9dd5f32524ce2b9c30a3c933a2b19/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:21.726931 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798f806-0ea9-4778-8e42-6ac21323aa49 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:21.737460 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798f806-0ea9-4778-8e42-6ac21323aa49 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:21.801387 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd65ed6-0977-4448-973c-00dd1bdeb441 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:21.805915 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-bbd65ed6-0977-4448-973c-00dd1bdeb441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:21.822805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c686ef-05c8-4b6a-9e69-999bf5f7a6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:21.823513 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c686ef-05c8-4b6a-9e69-999bf5f7a6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:21.823974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c686ef-05c8-4b6a-9e69-999bf5f7a6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:21.824164 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c686ef-05c8-4b6a-9e69-999bf5f7a6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:21.824959 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c686ef-05c8-4b6a-9e69-999bf5f7a6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:21.827266 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c686ef-05c8-4b6a-9e69-999bf5f7a6d1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:21.837071 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd65ed6-0977-4448-973c-00dd1bdeb441 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:21.849197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:21.854168 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1110/2199] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:21 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:21.855439 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c686ef-05c8-4b6a-9e69-999bf5f7a6d1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:21.863347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:21.863965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:21.866862 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] PATH_INFO: `/v3/projects/470e3eaf009647048defa05ad0448ef1` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:21.872606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=470e3eaf009647048defa05ad0448ef1)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:21.875838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:21.884517 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c686ef-05c8-4b6a-9e69-999bf5f7a6d1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:21.891786 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0446cf-0086-4944-a1f0-05edc3a697e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:21.894053 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0446cf-0086-4944-a1f0-05edc3a697e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:21.894333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0446cf-0086-4944-a1f0-05edc3a697e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:21.894610 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0446cf-0086-4944-a1f0-05edc3a697e7 admin admin] PATH_INFO: `/v3/projects/61b06db331594c8597039ffada0ab5f3/users/52b9dd5f32524ce2b9c30a3c933a2b19/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:21.897974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0446cf-0086-4944-a1f0-05edc3a697e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b06db331594c8597039ffada0ab5f3, user_id=52b9dd5f32524ce2b9c30a3c933a2b19, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:21.903584 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0446cf-0086-4944-a1f0-05edc3a697e7 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:21.925199 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1111/2200] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:21 2021] PUT /identity/v3/projects/61b06db331594c8597039ffada0ab5f3/users/52b9dd5f32524ce2b9c30a3c933a2b19/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:22.031067 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470e3eaf009647048defa05ad0448ef1', 'request_id': 'req-1d5f7154-969b-4995-bb2e-703ff3a771dc'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:22.127761 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470e3eaf009647048defa05ad0448ef1', 'request_id': 'req-1d5f7154-969b-4995-bb2e-703ff3a771dc'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:22.135094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470e3eaf009647048defa05ad0448ef1', 'request_id': 'req-1d5f7154-969b-4995-bb2e-703ff3a771dc'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:22.151803 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] The token cache is being invalidate because project 470e3eaf009647048defa05ad0448ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:31:22.152155 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:22.154358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:22.156248 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1090/2201] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:31:21 2021] DELETE /identity/v3/projects/470e3eaf009647048defa05ad0448ef1 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:23.479947 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f14d11-27fd-4f4f-8f51-df0bbd402467 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:23.480928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f14d11-27fd-4f4f-8f51-df0bbd402467 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:23.481730 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f14d11-27fd-4f4f-8f51-df0bbd402467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:23.530615 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d8f14d11-27fd-4f4f-8f51-df0bbd402467 None None] MFA Rules not processed for user `52b9dd5f32524ce2b9c30a3c933a2b19`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:23.532711 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d8f14d11-27fd-4f4f-8f51-df0bbd402467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:23.645511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1112/2202] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:23 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:23.656986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:23.661844 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:23.725495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f7154-969b-4995-bb2e-703ff3a771dc admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:23.729280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51cf42-bac1-4242-9d2f-b8d1f6525d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:23.730141 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51cf42-bac1-4242-9d2f-b8d1f6525d84 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:23.730596 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51cf42-bac1-4242-9d2f-b8d1f6525d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:23.731030 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51cf42-bac1-4242-9d2f-b8d1f6525d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:23.733455 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-7f51cf42-bac1-4242-9d2f-b8d1f6525d84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:23.819261 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51cf42-bac1-4242-9d2f-b8d1f6525d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:23.819504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51cf42-bac1-4242-9d2f-b8d1f6525d84 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:23.831526 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1091/2203] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:23 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:31:25.610156 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f14d11-27fd-4f4f-8f51-df0bbd402467 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:25.611910 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d8f14d11-27fd-4f4f-8f51-df0bbd402467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:25.626266 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f14d11-27fd-4f4f-8f51-df0bbd402467 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:25.630689 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7748bbf-839c-4a78-8407-e5762cb7cd6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:25.631346 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7748bbf-839c-4a78-8407-e5762cb7cd6f service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:25.631624 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7748bbf-839c-4a78-8407-e5762cb7cd6f service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:25.631931 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7748bbf-839c-4a78-8407-e5762cb7cd6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:25.641802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7748bbf-839c-4a78-8407-e5762cb7cd6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:25.643256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7748bbf-839c-4a78-8407-e5762cb7cd6f service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:25.654035 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1113/2204] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:25 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:31:37.649200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffb82b-337f-4b30-bff2-9fb4843cc983 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:37.649743 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffb82b-337f-4b30-bff2-9fb4843cc983 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:37.649743 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffb82b-337f-4b30-bff2-9fb4843cc983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:37.677965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d4ffb82b-337f-4b30-bff2-9fb4843cc983 None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:37.679193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d4ffb82b-337f-4b30-bff2-9fb4843cc983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:37.741358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1092/2205] 10.222.0.87 () {58 vars in 967 bytes} [Fri Oct 29 01:31:37 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:37.755062 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7748bbf-839c-4a78-8407-e5762cb7cd6f service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:37.756506 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d7748bbf-839c-4a78-8407-e5762cb7cd6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:37.842137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7748bbf-839c-4a78-8407-e5762cb7cd6f service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:37.848942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96d084-6816-4935-a541-e9e2aa643c05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:37.849602 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96d084-6816-4935-a541-e9e2aa643c05 service swift] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:37.849916 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96d084-6816-4935-a541-e9e2aa643c05 service swift] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:37.850156 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96d084-6816-4935-a541-e9e2aa643c05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:37.859256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96d084-6816-4935-a541-e9e2aa643c05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:37.860874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96d084-6816-4935-a541-e9e2aa643c05 service swift] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:37.872314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1114/2206] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:31:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 01:31:41.340048 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffb82b-337f-4b30-bff2-9fb4843cc983 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:41.341714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d4ffb82b-337f-4b30-bff2-9fb4843cc983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:41.414213 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffb82b-337f-4b30-bff2-9fb4843cc983 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:41.419164 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ed69d-0559-474b-8cb5-581f1e63b4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:41.420124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ed69d-0559-474b-8cb5-581f1e63b4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:41.420356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ed69d-0559-474b-8cb5-581f1e63b4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:41.420630 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ed69d-0559-474b-8cb5-581f1e63b4e9 admin admin] PATH_INFO: `/v3/users/5b2dbc6652b34cd3a4fc39dbabd839bc` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:41.421894 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ed69d-0559-474b-8cb5-581f1e63b4e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2dbc6652b34cd3a4fc39dbabd839bc)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:41.423881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ed69d-0559-474b-8cb5-581f1e63b4e9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:41.620978 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ef3ed69d-0559-474b-8cb5-581f1e63b4e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2dbc6652b34cd3a4fc39dbabd839bc'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:41.628127 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ef3ed69d-0559-474b-8cb5-581f1e63b4e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2dbc6652b34cd3a4fc39dbabd839bc'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:41.630858 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ef3ed69d-0559-474b-8cb5-581f1e63b4e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2dbc6652b34cd3a4fc39dbabd839bc'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:41.641919 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ef3ed69d-0559-474b-8cb5-581f1e63b4e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2dbc6652b34cd3a4fc39dbabd839bc'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:41.715784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-ef3ed69d-0559-474b-8cb5-581f1e63b4e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2dbc6652b34cd3a4fc39dbabd839bc'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:41.722691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1093/2207] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:31:41 2021] DELETE /identity/v3/users/5b2dbc6652b34cd3a4fc39dbabd839bc => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:41.992105 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96d084-6816-4935-a541-e9e2aa643c05 service swift] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:42.004365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96d084-6816-4935-a541-e9e2aa643c05 service swift] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:42.085303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee77a94-9357-43da-8fa3-f77a946fe189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:42.086361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee77a94-9357-43da-8fa3-f77a946fe189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:42.086811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee77a94-9357-43da-8fa3-f77a946fe189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:42.087442 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee77a94-9357-43da-8fa3-f77a946fe189 admin admin] PATH_INFO: `/v3/projects/131e8f4d098e4d2ba64328c91f63c18c` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:42.090136 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee77a94-9357-43da-8fa3-f77a946fe189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=131e8f4d098e4d2ba64328c91f63c18c)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:42.092134 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee77a94-9357-43da-8fa3-f77a946fe189 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:42.269704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6ee77a94-9357-43da-8fa3-f77a946fe189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '131e8f4d098e4d2ba64328c91f63c18c', 'request_id': 'req-6ee77a94-9357-43da-8fa3-f77a946fe189'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:42.396525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6ee77a94-9357-43da-8fa3-f77a946fe189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '131e8f4d098e4d2ba64328c91f63c18c', 'request_id': 'req-6ee77a94-9357-43da-8fa3-f77a946fe189'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:42.407951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6ee77a94-9357-43da-8fa3-f77a946fe189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '131e8f4d098e4d2ba64328c91f63c18c', 'request_id': 'req-6ee77a94-9357-43da-8fa3-f77a946fe189'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:42.430243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6ee77a94-9357-43da-8fa3-f77a946fe189 admin admin] The token cache is being invalidate because project 131e8f4d098e4d2ba64328c91f63c18c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:31:42.430543 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6ee77a94-9357-43da-8fa3-f77a946fe189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:42.431194 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6ee77a94-9357-43da-8fa3-f77a946fe189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:42.435458 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1115/2208] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:31:41 2021] DELETE /identity/v3/projects/131e8f4d098e4d2ba64328c91f63c18c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:42.440661 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1801c0-406d-4368-92ee-7b0e76c5c8b2 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:42.441961 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1801c0-406d-4368-92ee-7b0e76c5c8b2 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:42.442422 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1801c0-406d-4368-92ee-7b0e76c5c8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:42.485289 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-0b1801c0-406d-4368-92ee-7b0e76c5c8b2 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:42.486624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-0b1801c0-406d-4368-92ee-7b0e76c5c8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:42.554290 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1094/2209] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:42.562649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023818de-ae19-47b4-a4c7-505271345c9f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:42.563009 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023818de-ae19-47b4-a4c7-505271345c9f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:42.563779 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023818de-ae19-47b4-a4c7-505271345c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:42.585654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-023818de-ae19-47b4-a4c7-505271345c9f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:42.586949 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-023818de-ae19-47b4-a4c7-505271345c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:42.599277 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1116/2210] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:42.600316 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1801c0-406d-4368-92ee-7b0e76c5c8b2 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:42.618565 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1801c0-406d-4368-92ee-7b0e76c5c8b2 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:42.623073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427b293-123c-4cb3-b578-f6bba0d326b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:42.623754 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427b293-123c-4cb3-b578-f6bba0d326b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:42.624034 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427b293-123c-4cb3-b578-f6bba0d326b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:42.624299 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427b293-123c-4cb3-b578-f6bba0d326b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:42.625033 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427b293-123c-4cb3-b578-f6bba0d326b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:31:42.625326 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427b293-123c-4cb3-b578-f6bba0d326b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:42.626868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427b293-123c-4cb3-b578-f6bba0d326b9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:42.638823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1095/2211] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:31:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:31:42.643923 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023818de-ae19-47b4-a4c7-505271345c9f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:42.654410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023818de-ae19-47b4-a4c7-505271345c9f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:42.659534 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede904c-65bd-4206-8765-7671253949c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:42.664333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede904c-65bd-4206-8765-7671253949c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:42.664333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede904c-65bd-4206-8765-7671253949c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:42.664333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede904c-65bd-4206-8765-7671253949c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:42.664333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede904c-65bd-4206-8765-7671253949c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:42.664736 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede904c-65bd-4206-8765-7671253949c4 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:42.749201 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1117/2212] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:31:42 2021] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:42.752487 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427b293-123c-4cb3-b578-f6bba0d326b9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:42.763073 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427b293-123c-4cb3-b578-f6bba0d326b9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:42.820412 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86635d48-7b20-45d2-8b3f-876dfa15ad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:42.821215 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86635d48-7b20-45d2-8b3f-876dfa15ad1e admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:42.821782 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86635d48-7b20-45d2-8b3f-876dfa15ad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:42.821782 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86635d48-7b20-45d2-8b3f-876dfa15ad1e admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:42.822349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86635d48-7b20-45d2-8b3f-876dfa15ad1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:42.824282 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86635d48-7b20-45d2-8b3f-876dfa15ad1e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:42.920444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1096/2213] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:31:42 2021] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:31:42.921002 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede904c-65bd-4206-8765-7671253949c4 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:42.929628 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86635d48-7b20-45d2-8b3f-876dfa15ad1e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:42.933933 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede904c-65bd-4206-8765-7671253949c4 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:42.935338 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-86635d48-7b20-45d2-8b3f-876dfa15ad1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:42.947128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624c759-380d-428b-8c5a-016f209dea50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:42.948584 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624c759-380d-428b-8c5a-016f209dea50 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:42.948584 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624c759-380d-428b-8c5a-016f209dea50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:42.948775 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624c759-380d-428b-8c5a-016f209dea50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:42.949470 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624c759-380d-428b-8c5a-016f209dea50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:42.951373 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624c759-380d-428b-8c5a-016f209dea50 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:42.954342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86635d48-7b20-45d2-8b3f-876dfa15ad1e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:42.960558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb2947-d0db-43ee-a9dd-0f9ff5496c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:42.963849 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2947-d0db-43ee-a9dd-0f9ff5496c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:42.963849 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2947-d0db-43ee-a9dd-0f9ff5496c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:42.963849 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2947-d0db-43ee-a9dd-0f9ff5496c7b admin admin] PATH_INFO: `/v3/users/4ac5f094f74e4dfb893ccf4221dfcff6` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:42.964142 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1118/2214] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:42 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:42.965005 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb2947-d0db-43ee-a9dd-0f9ff5496c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac5f094f74e4dfb893ccf4221dfcff6)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:42.967621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624c759-380d-428b-8c5a-016f209dea50 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:42.967790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb2947-d0db-43ee-a9dd-0f9ff5496c7b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:42.978330 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624c759-380d-428b-8c5a-016f209dea50 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:42.984081 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff244334-ff45-486a-be7c-93bb7084ed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:42.984758 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff244334-ff45-486a-be7c-93bb7084ed8b admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:42.985681 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff244334-ff45-486a-be7c-93bb7084ed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:42.985681 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff244334-ff45-486a-be7c-93bb7084ed8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:42.986061 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff244334-ff45-486a-be7c-93bb7084ed8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:42.987675 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff244334-ff45-486a-be7c-93bb7084ed8b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:42.998485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1119/2215] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:42 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:31:43.002512 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff244334-ff45-486a-be7c-93bb7084ed8b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:43.012937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff244334-ff45-486a-be7c-93bb7084ed8b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:43.017664 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe42a27-9f48-446c-9bc1-f5f5eed4e660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:43.018537 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe42a27-9f48-446c-9bc1-f5f5eed4e660 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:43.018810 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe42a27-9f48-446c-9bc1-f5f5eed4e660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:43.019081 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe42a27-9f48-446c-9bc1-f5f5eed4e660 admin admin] PATH_INFO: `/v3/projects/771b3d26614d4a06a3a71452b04fb606/users/d2204afe21004a0abc892ee4bfe816de/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:43.035316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe42a27-9f48-446c-9bc1-f5f5eed4e660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771b3d26614d4a06a3a71452b04fb606, user_id=d2204afe21004a0abc892ee4bfe816de, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:43.038121 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe42a27-9f48-446c-9bc1-f5f5eed4e660 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:43.168427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1120/2216] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:43 2021] PUT /identity/v3/projects/771b3d26614d4a06a3a71452b04fb606/users/d2204afe21004a0abc892ee4bfe816de/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:31:43.179561 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a45df-448e-48cc-b428-8936ded1f0e6 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:43.179833 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-febb2947-d0db-43ee-a9dd-0f9ff5496c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac5f094f74e4dfb893ccf4221dfcff6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:43.179944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a45df-448e-48cc-b428-8936ded1f0e6 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:43.180145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a45df-448e-48cc-b428-8936ded1f0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:43.187837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-febb2947-d0db-43ee-a9dd-0f9ff5496c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac5f094f74e4dfb893ccf4221dfcff6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:43.188600 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-febb2947-d0db-43ee-a9dd-0f9ff5496c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac5f094f74e4dfb893ccf4221dfcff6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:43.203582 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-febb2947-d0db-43ee-a9dd-0f9ff5496c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac5f094f74e4dfb893ccf4221dfcff6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:43.208943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-770a45df-448e-48cc-b428-8936ded1f0e6 None None] MFA Rules not processed for user `d2204afe21004a0abc892ee4bfe816de`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:43.210397 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-770a45df-448e-48cc-b428-8936ded1f0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:43.278737 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1121/2217] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:43 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:31:43.290489 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a45df-448e-48cc-b428-8936ded1f0e6 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:43.291859 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-770a45df-448e-48cc-b428-8936ded1f0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:43.305018 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-febb2947-d0db-43ee-a9dd-0f9ff5496c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac5f094f74e4dfb893ccf4221dfcff6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:43.311526 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1097/2218] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:31:42 2021] DELETE /identity/v3/users/4ac5f094f74e4dfb893ccf4221dfcff6 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:43.377444 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a45df-448e-48cc-b428-8936ded1f0e6 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:43.426911 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92228dd-f424-4434-89f4-2170a20cebfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:43.428003 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92228dd-f424-4434-89f4-2170a20cebfc service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:43.428152 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92228dd-f424-4434-89f4-2170a20cebfc service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:43.428429 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92228dd-f424-4434-89f4-2170a20cebfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:43.484555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92228dd-f424-4434-89f4-2170a20cebfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:43.486009 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92228dd-f424-4434-89f4-2170a20cebfc service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:43.495775 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1122/2219] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:43 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:31:43.565602 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb2947-d0db-43ee-a9dd-0f9ff5496c7b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:43.568259 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-febb2947-d0db-43ee-a9dd-0f9ff5496c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:43.640059 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb2947-d0db-43ee-a9dd-0f9ff5496c7b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:43.644746 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:43.646225 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:43.646929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:43.646929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] PATH_INFO: `/v3/projects/ecc8a9d6748a4e94861b24d80cdc0a0d` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:43.648791 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc8a9d6748a4e94861b24d80cdc0a0d)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:43.649872 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:43.788818 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc8a9d6748a4e94861b24d80cdc0a0d', 'request_id': 'req-89b3e0d0-c168-413b-a2b0-c01a5b713c68'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:43.893908 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc8a9d6748a4e94861b24d80cdc0a0d', 'request_id': 'req-89b3e0d0-c168-413b-a2b0-c01a5b713c68'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:43.900494 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc8a9d6748a4e94861b24d80cdc0a0d', 'request_id': 'req-89b3e0d0-c168-413b-a2b0-c01a5b713c68'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:43.912145 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] The token cache is being invalidate because project ecc8a9d6748a4e94861b24d80cdc0a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:31:43.912433 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:43.913099 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:43.914646 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1098/2220] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:31:43 2021] DELETE /identity/v3/projects/ecc8a9d6748a4e94861b24d80cdc0a0d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:31:43.918650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92228dd-f424-4434-89f4-2170a20cebfc service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:43.929840 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92228dd-f424-4434-89f4-2170a20cebfc service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:43.985986 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415bdea-794b-49c7-81ed-cf173befbb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:43.986835 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415bdea-794b-49c7-81ed-cf173befbb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:43.987113 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415bdea-794b-49c7-81ed-cf173befbb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:43.987388 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415bdea-794b-49c7-81ed-cf173befbb7e admin admin] PATH_INFO: `/v3/users/52b9dd5f32524ce2b9c30a3c933a2b19` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:43.992355 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415bdea-794b-49c7-81ed-cf173befbb7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b9dd5f32524ce2b9c30a3c933a2b19)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:43.992355 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415bdea-794b-49c7-81ed-cf173befbb7e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:44.262842 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c415bdea-794b-49c7-81ed-cf173befbb7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b9dd5f32524ce2b9c30a3c933a2b19'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:44.263923 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c415bdea-794b-49c7-81ed-cf173befbb7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b9dd5f32524ce2b9c30a3c933a2b19'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:44.276443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c415bdea-794b-49c7-81ed-cf173befbb7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b9dd5f32524ce2b9c30a3c933a2b19'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:44.283489 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c415bdea-794b-49c7-81ed-cf173befbb7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b9dd5f32524ce2b9c30a3c933a2b19'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:44.384204 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c415bdea-794b-49c7-81ed-cf173befbb7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b9dd5f32524ce2b9c30a3c933a2b19'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:44.392314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1123/2221] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:31:43 2021] DELETE /identity/v3/users/52b9dd5f32524ce2b9c30a3c933a2b19 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:44.637359 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:44.639549 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:44.654750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3e0d0-c168-413b-a2b0-c01a5b713c68 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:44.714405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e84f56-7888-47c0-b52c-f93c4119f1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:44.714973 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e84f56-7888-47c0-b52c-f93c4119f1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:44.715254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e84f56-7888-47c0-b52c-f93c4119f1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:44.715528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e84f56-7888-47c0-b52c-f93c4119f1bb admin admin] PATH_INFO: `/v3/projects/61b06db331594c8597039ffada0ab5f3` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:44.716766 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e84f56-7888-47c0-b52c-f93c4119f1bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b06db331594c8597039ffada0ab5f3)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:44.718685 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e84f56-7888-47c0-b52c-f93c4119f1bb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:44.829763 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-87e84f56-7888-47c0-b52c-f93c4119f1bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b06db331594c8597039ffada0ab5f3', 'request_id': 'req-87e84f56-7888-47c0-b52c-f93c4119f1bb'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:44.920881 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-87e84f56-7888-47c0-b52c-f93c4119f1bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b06db331594c8597039ffada0ab5f3', 'request_id': 'req-87e84f56-7888-47c0-b52c-f93c4119f1bb'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:44.927165 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-87e84f56-7888-47c0-b52c-f93c4119f1bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b06db331594c8597039ffada0ab5f3', 'request_id': 'req-87e84f56-7888-47c0-b52c-f93c4119f1bb'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:44.939239 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-87e84f56-7888-47c0-b52c-f93c4119f1bb admin admin] The token cache is being invalidate because project 61b06db331594c8597039ffada0ab5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:31:44.939520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-87e84f56-7888-47c0-b52c-f93c4119f1bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:44.940192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-87e84f56-7888-47c0-b52c-f93c4119f1bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:31:44.941708 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1099/2222] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:31:44 2021] DELETE /identity/v3/projects/61b06db331594c8597039ffada0ab5f3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:44.947831 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a656fe7-27f1-4ff0-9a19-cfea9ea39da3 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:44.948157 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a656fe7-27f1-4ff0-9a19-cfea9ea39da3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:44.948490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a656fe7-27f1-4ff0-9a19-cfea9ea39da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:44.966169 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-1a656fe7-27f1-4ff0-9a19-cfea9ea39da3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:44.967430 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1a656fe7-27f1-4ff0-9a19-cfea9ea39da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:45.025820 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1124/2223] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:31:45.033766 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d14165-851e-4ad9-a62c-e9ed7cc09838 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:45.034050 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d14165-851e-4ad9-a62c-e9ed7cc09838 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:45.034323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d14165-851e-4ad9-a62c-e9ed7cc09838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:45.053664 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-e4d14165-851e-4ad9-a62c-e9ed7cc09838 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:45.054874 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e4d14165-851e-4ad9-a62c-e9ed7cc09838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:45.062693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1100/2224] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:45.066856 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a656fe7-27f1-4ff0-9a19-cfea9ea39da3 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:45.076924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a656fe7-27f1-4ff0-9a19-cfea9ea39da3 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:45.081627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094ec38-c645-4566-922c-43f8fe985ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:45.082275 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094ec38-c645-4566-922c-43f8fe985ecc admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:45.082555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094ec38-c645-4566-922c-43f8fe985ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:45.082826 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094ec38-c645-4566-922c-43f8fe985ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:45.083560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094ec38-c645-4566-922c-43f8fe985ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:31:45.083907 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094ec38-c645-4566-922c-43f8fe985ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:45.085637 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094ec38-c645-4566-922c-43f8fe985ecc admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:45.096960 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1125/2225] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:31:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:31:45.106079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d14165-851e-4ad9-a62c-e9ed7cc09838 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:45.115394 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d14165-851e-4ad9-a62c-e9ed7cc09838 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:45.120725 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa9528-025e-457a-8f11-bd4795f20e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:45.121353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa9528-025e-457a-8f11-bd4795f20e13 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:45.121630 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa9528-025e-457a-8f11-bd4795f20e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:45.121900 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa9528-025e-457a-8f11-bd4795f20e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:45.122593 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa9528-025e-457a-8f11-bd4795f20e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:45.124481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa9528-025e-457a-8f11-bd4795f20e13 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:45.203654 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1101/2226] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:31:45 2021] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:45.207709 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094ec38-c645-4566-922c-43f8fe985ecc admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:45.218302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094ec38-c645-4566-922c-43f8fe985ecc admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:45.273132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54692b-291e-4781-868f-88e9da0e94b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:45.273815 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54692b-291e-4781-868f-88e9da0e94b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:45.274063 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54692b-291e-4781-868f-88e9da0e94b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:45.274679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54692b-291e-4781-868f-88e9da0e94b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:45.275062 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54692b-291e-4781-868f-88e9da0e94b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:45.280226 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54692b-291e-4781-868f-88e9da0e94b9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:45.373291 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1126/2227] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:31:45 2021] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:45.377388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa9528-025e-457a-8f11-bd4795f20e13 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:45.387464 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa9528-025e-457a-8f11-bd4795f20e13 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:45.392245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92d68-70bd-4d87-beb3-97fff97399b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:45.392903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92d68-70bd-4d87-beb3-97fff97399b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:45.393205 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92d68-70bd-4d87-beb3-97fff97399b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:45.393459 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92d68-70bd-4d87-beb3-97fff97399b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:45.394192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c92d68-70bd-4d87-beb3-97fff97399b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:45.395790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c92d68-70bd-4d87-beb3-97fff97399b2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:45.410165 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1102/2228] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:45 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:45.411809 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54692b-291e-4781-868f-88e9da0e94b9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:45.424022 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54692b-291e-4781-868f-88e9da0e94b9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:45.428789 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fbe9e-ee73-4f96-a15b-76468a882d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:45.429444 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fbe9e-ee73-4f96-a15b-76468a882d2c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:45.429722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fbe9e-ee73-4f96-a15b-76468a882d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:45.429991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fbe9e-ee73-4f96-a15b-76468a882d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:45.430841 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fbe9e-ee73-4f96-a15b-76468a882d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:45.432458 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fbe9e-ee73-4f96-a15b-76468a882d2c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:45.442451 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1127/2229] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:45 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:45.446853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92d68-70bd-4d87-beb3-97fff97399b2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:45.457384 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92d68-70bd-4d87-beb3-97fff97399b2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:45.463361 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c0dbe-2cda-41ab-828e-aecf806846f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:45.464267 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c0dbe-2cda-41ab-828e-aecf806846f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:45.464545 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c0dbe-2cda-41ab-828e-aecf806846f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:45.464814 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c0dbe-2cda-41ab-828e-aecf806846f9 admin admin] PATH_INFO: `/v3/projects/880c181f01594574934c52905302743d/users/9676bbb77dc74a37944b3f15108c97f9/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:45.480594 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c0dbe-2cda-41ab-828e-aecf806846f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=880c181f01594574934c52905302743d, user_id=9676bbb77dc74a37944b3f15108c97f9, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:45.483210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c0dbe-2cda-41ab-828e-aecf806846f9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:45.556690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1103/2230] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:45 2021] PUT /identity/v3/projects/880c181f01594574934c52905302743d/users/9676bbb77dc74a37944b3f15108c97f9/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:45.567926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b525ba-3ef7-4abb-b90c-25d6c3f63387 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:45.568218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b525ba-3ef7-4abb-b90c-25d6c3f63387 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:45.568496 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b525ba-3ef7-4abb-b90c-25d6c3f63387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:45.595573 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-e4b525ba-3ef7-4abb-b90c-25d6c3f63387 None None] MFA Rules not processed for user `9676bbb77dc74a37944b3f15108c97f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:45.596869 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e4b525ba-3ef7-4abb-b90c-25d6c3f63387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:45.659210 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1128/2231] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:45 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:45.664750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c0dbe-2cda-41ab-828e-aecf806846f9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:45.732226 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c0dbe-2cda-41ab-828e-aecf806846f9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:45.737083 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96e4d5-ec4f-4035-ac0b-8c8c37b0dbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:45.737775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96e4d5-ec4f-4035-ac0b-8c8c37b0dbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:45.738023 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96e4d5-ec4f-4035-ac0b-8c8c37b0dbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:45.738298 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96e4d5-ec4f-4035-ac0b-8c8c37b0dbf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:45.739011 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96e4d5-ec4f-4035-ac0b-8c8c37b0dbf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:45.741600 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96e4d5-ec4f-4035-ac0b-8c8c37b0dbf4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:45.858715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1104/2232] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:31:45 2021] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:31:45.862668 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b525ba-3ef7-4abb-b90c-25d6c3f63387 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:45.874757 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b525ba-3ef7-4abb-b90c-25d6c3f63387 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:45.929627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30943247-63b3-4ff6-9482-cde938b738a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:45.930762 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30943247-63b3-4ff6-9482-cde938b738a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:45.930762 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30943247-63b3-4ff6-9482-cde938b738a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:45.930936 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30943247-63b3-4ff6-9482-cde938b738a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:45.931531 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30943247-63b3-4ff6-9482-cde938b738a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:45.933493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30943247-63b3-4ff6-9482-cde938b738a9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:46.018679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1129/2233] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:31:45 2021] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:31:46.023553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96e4d5-ec4f-4035-ac0b-8c8c37b0dbf4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:46.033602 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96e4d5-ec4f-4035-ac0b-8c8c37b0dbf4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:46.038826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c3ba0-491d-48a3-8954-9f9cfed33b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:46.039467 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c3ba0-491d-48a3-8954-9f9cfed33b56 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:46.039757 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c3ba0-491d-48a3-8954-9f9cfed33b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:46.040037 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c3ba0-491d-48a3-8954-9f9cfed33b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:46.040760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c3ba0-491d-48a3-8954-9f9cfed33b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:46.042313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c3ba0-491d-48a3-8954-9f9cfed33b56 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:46.054551 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1105/2234] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:46 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:31:46.058495 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30943247-63b3-4ff6-9482-cde938b738a9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:46.069520 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30943247-63b3-4ff6-9482-cde938b738a9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:46.074639 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8d6bc-abc1-464a-b5c4-498e583c5444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:46.075250 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8d6bc-abc1-464a-b5c4-498e583c5444 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:46.075831 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8d6bc-abc1-464a-b5c4-498e583c5444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:46.076111 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8d6bc-abc1-464a-b5c4-498e583c5444 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:46.076857 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8d6bc-abc1-464a-b5c4-498e583c5444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:46.078451 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8d6bc-abc1-464a-b5c4-498e583c5444 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:46.089188 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1130/2235] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:46 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:46.093559 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c3ba0-491d-48a3-8954-9f9cfed33b56 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:46.104502 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c3ba0-491d-48a3-8954-9f9cfed33b56 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:46.109355 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004c259-1bf0-458b-bed4-5eae0685d530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:46.110243 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004c259-1bf0-458b-bed4-5eae0685d530 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:46.110515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004c259-1bf0-458b-bed4-5eae0685d530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:46.110780 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004c259-1bf0-458b-bed4-5eae0685d530 admin admin] PATH_INFO: `/v3/projects/2b662f6fcb9345d29f23b6e0bd47ae60/users/c3866fd64e64436e80b0f51f7270aaf7/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:46.125755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004c259-1bf0-458b-bed4-5eae0685d530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b662f6fcb9345d29f23b6e0bd47ae60, user_id=c3866fd64e64436e80b0f51f7270aaf7, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:46.128461 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004c259-1bf0-458b-bed4-5eae0685d530 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:46.207635 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1106/2236] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:46 2021] PUT /identity/v3/projects/2b662f6fcb9345d29f23b6e0bd47ae60/users/c3866fd64e64436e80b0f51f7270aaf7/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:31:46.218545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0e38-b92b-4c56-98bc-bc1962ead1b1 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:46.218834 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0e38-b92b-4c56-98bc-bc1962ead1b1 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:46.219112 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0e38-b92b-4c56-98bc-bc1962ead1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:46.245618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-2ffd0e38-b92b-4c56-98bc-bc1962ead1b1 None None] MFA Rules not processed for user `c3866fd64e64436e80b0f51f7270aaf7`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:46.246888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-2ffd0e38-b92b-4c56-98bc-bc1962ead1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:46.309426 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1131/2237] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:46 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:46.314098 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004c259-1bf0-458b-bed4-5eae0685d530 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:46.374916 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004c259-1bf0-458b-bed4-5eae0685d530 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:46.379580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5165eb-ab21-458f-b58c-b1a511c780bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:46.380257 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5165eb-ab21-458f-b58c-b1a511c780bf admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:46.380537 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5165eb-ab21-458f-b58c-b1a511c780bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:46.380817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5165eb-ab21-458f-b58c-b1a511c780bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:46.382071 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5165eb-ab21-458f-b58c-b1a511c780bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:46.383950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5165eb-ab21-458f-b58c-b1a511c780bf admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:46.557206 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1107/2238] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:31:46 2021] POST /identity/v3/projects => generated 377 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:31:46.561286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd0e38-b92b-4c56-98bc-bc1962ead1b1 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:46.572366 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd0e38-b92b-4c56-98bc-bc1962ead1b1 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:46.627263 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace6140-3289-4632-985a-de78fdd6de86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:46.627882 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace6140-3289-4632-985a-de78fdd6de86 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:46.628161 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace6140-3289-4632-985a-de78fdd6de86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:46.628430 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace6140-3289-4632-985a-de78fdd6de86 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:46.629130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace6140-3289-4632-985a-de78fdd6de86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:46.631034 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace6140-3289-4632-985a-de78fdd6de86 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:46.778884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1132/2239] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:31:46 2021] POST /identity/v3/users => generated 295 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:31:46.783005 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5165eb-ab21-458f-b58c-b1a511c780bf admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:46.794176 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5165eb-ab21-458f-b58c-b1a511c780bf admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:46.798712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc9b7b-ced4-4bab-99a3-726b3affd31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:46.799405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc9b7b-ced4-4bab-99a3-726b3affd31c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:46.799697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc9b7b-ced4-4bab-99a3-726b3affd31c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:46.800004 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc9b7b-ced4-4bab-99a3-726b3affd31c admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:46.800740 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc9b7b-ced4-4bab-99a3-726b3affd31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:46.802491 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc9b7b-ced4-4bab-99a3-726b3affd31c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:46.813519 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1108/2240] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:46 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:31:46.827382 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace6140-3289-4632-985a-de78fdd6de86 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:46.838041 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace6140-3289-4632-985a-de78fdd6de86 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:46.843095 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb63e5-a471-4030-a3b6-86d1e350aa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:46.843995 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb63e5-a471-4030-a3b6-86d1e350aa82 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:46.844270 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb63e5-a471-4030-a3b6-86d1e350aa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:46.844538 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb63e5-a471-4030-a3b6-86d1e350aa82 admin admin] PATH_INFO: `/v3/projects/94c3520bbd6f428389addcae2f6e4064/users/7cdc3ab236194e3486ef8186da7039ab/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:46.861894 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb63e5-a471-4030-a3b6-86d1e350aa82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c3520bbd6f428389addcae2f6e4064, user_id=7cdc3ab236194e3486ef8186da7039ab, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:46.864911 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb63e5-a471-4030-a3b6-86d1e350aa82 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:46.984655 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1133/2241] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:46 2021] PUT /identity/v3/projects/94c3520bbd6f428389addcae2f6e4064/users/7cdc3ab236194e3486ef8186da7039ab/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:31:46.988553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc9b7b-ced4-4bab-99a3-726b3affd31c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:46.999000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc9b7b-ced4-4bab-99a3-726b3affd31c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:47.060699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f6af5-5df4-4e34-ab6f-257329915bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:47.061363 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6af5-5df4-4e34-ab6f-257329915bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:47.061678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6af5-5df4-4e34-ab6f-257329915bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:47.061954 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6af5-5df4-4e34-ab6f-257329915bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:47.062701 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f6af5-5df4-4e34-ab6f-257329915bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:47.064310 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f6af5-5df4-4e34-ab6f-257329915bc3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:47.074834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1109/2242] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:31:46 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:31:47.079247 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb63e5-a471-4030-a3b6-86d1e350aa82 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:47.090175 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb63e5-a471-4030-a3b6-86d1e350aa82 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:47.094866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84088e08-af30-4086-94cd-d00ef5a49510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:47.095757 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84088e08-af30-4086-94cd-d00ef5a49510 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:47.096049 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84088e08-af30-4086-94cd-d00ef5a49510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:47.096316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84088e08-af30-4086-94cd-d00ef5a49510 admin admin] PATH_INFO: `/v3/projects/94c3520bbd6f428389addcae2f6e4064/users/7cdc3ab236194e3486ef8186da7039ab/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:47.098632 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84088e08-af30-4086-94cd-d00ef5a49510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c3520bbd6f428389addcae2f6e4064, user_id=7cdc3ab236194e3486ef8186da7039ab, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:47.103845 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84088e08-af30-4086-94cd-d00ef5a49510 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:47.112692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1134/2243] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:31:47 2021] PUT /identity/v3/projects/94c3520bbd6f428389addcae2f6e4064/users/7cdc3ab236194e3486ef8186da7039ab/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:31:47.122892 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79106b-d270-4c95-b4f6-86b3affb5870 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:47.123241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79106b-d270-4c95-b4f6-86b3affb5870 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:47.126879 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79106b-d270-4c95-b4f6-86b3affb5870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:47.157064 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ab79106b-d270-4c95-b4f6-86b3affb5870 None None] MFA Rules not processed for user `7cdc3ab236194e3486ef8186da7039ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:47.158291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ab79106b-d270-4c95-b4f6-86b3affb5870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:47.230089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1110/2244] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:31:47 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:31:47.241205 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84088e08-af30-4086-94cd-d00ef5a49510 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:47.243117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-84088e08-af30-4086-94cd-d00ef5a49510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:47.304924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84088e08-af30-4086-94cd-d00ef5a49510 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:47.308924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37652536-be92-46b2-8917-7943d10a2191 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:47.309659 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37652536-be92-46b2-8917-7943d10a2191 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:47.310217 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37652536-be92-46b2-8917-7943d10a2191 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:47.310329 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37652536-be92-46b2-8917-7943d10a2191 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:47.369361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37652536-be92-46b2-8917-7943d10a2191 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:47.371196 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37652536-be92-46b2-8917-7943d10a2191 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:47.382048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1135/2245] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:47 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:31:49.615065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79106b-d270-4c95-b4f6-86b3affb5870 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:49.617464 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ab79106b-d270-4c95-b4f6-86b3affb5870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:49.629334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79106b-d270-4c95-b4f6-86b3affb5870 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:49.633525 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90b2ea-a20d-483d-9ebd-2bd74d5ac997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:49.634344 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90b2ea-a20d-483d-9ebd-2bd74d5ac997 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:49.634768 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90b2ea-a20d-483d-9ebd-2bd74d5ac997 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:49.635154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90b2ea-a20d-483d-9ebd-2bd74d5ac997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:49.701445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90b2ea-a20d-483d-9ebd-2bd74d5ac997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:49.703837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90b2ea-a20d-483d-9ebd-2bd74d5ac997 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:49.714432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1111/2246] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:49 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:31:53.845450 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37652536-be92-46b2-8917-7943d10a2191 service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:53.854881 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37652536-be92-46b2-8917-7943d10a2191 service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:53.859009 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69001437-7dd6-46be-bd45-9c8b6aa7de2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:53.863113 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69001437-7dd6-46be-bd45-9c8b6aa7de2e service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:53.863113 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69001437-7dd6-46be-bd45-9c8b6aa7de2e service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:53.863113 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69001437-7dd6-46be-bd45-9c8b6aa7de2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:53.871826 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69001437-7dd6-46be-bd45-9c8b6aa7de2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:53.873561 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69001437-7dd6-46be-bd45-9c8b6aa7de2e service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:53.884561 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1136/2247] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:31:53 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:31:54.260790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b377d83-5fe6-4aa7-9330-d0fb701ecc90 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:54.261524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b377d83-5fe6-4aa7-9330-d0fb701ecc90 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:54.261524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b377d83-5fe6-4aa7-9330-d0fb701ecc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:54.279812 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-7b377d83-5fe6-4aa7-9330-d0fb701ecc90 None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:31:54.281022 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-7b377d83-5fe6-4aa7-9330-d0fb701ecc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:54.334259 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1112/2248] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:31:54 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:31:54.347931 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69001437-7dd6-46be-bd45-9c8b6aa7de2e service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:31:54.349306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-69001437-7dd6-46be-bd45-9c8b6aa7de2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:31:54.425069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69001437-7dd6-46be-bd45-9c8b6aa7de2e service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:31:54.430308 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eba64-5a75-423c-b40a-1686eb53849e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:31:54.430997 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eba64-5a75-423c-b40a-1686eb53849e service swift] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:31:54.431259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eba64-5a75-423c-b40a-1686eb53849e service swift] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:31:54.431530 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eba64-5a75-423c-b40a-1686eb53849e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:31:54.440014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9eba64-5a75-423c-b40a-1686eb53849e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:31:54.441618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9eba64-5a75-423c-b40a-1686eb53849e service swift] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:31:54.450152 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1137/2249] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:31:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 01:32:05.497950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b377d83-5fe6-4aa7-9330-d0fb701ecc90 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:05.567012 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b377d83-5fe6-4aa7-9330-d0fb701ecc90 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:05.573191 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb89f0d-46e0-467d-86fa-5c807cef45e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:05.578291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb89f0d-46e0-467d-86fa-5c807cef45e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:05.578291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb89f0d-46e0-467d-86fa-5c807cef45e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:05.578291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb89f0d-46e0-467d-86fa-5c807cef45e7 admin admin] PATH_INFO: `/v3/users/9676bbb77dc74a37944b3f15108c97f9` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:05.578291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb89f0d-46e0-467d-86fa-5c807cef45e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9676bbb77dc74a37944b3f15108c97f9)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:05.578291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb89f0d-46e0-467d-86fa-5c807cef45e7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:05.836081 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8cb89f0d-46e0-467d-86fa-5c807cef45e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9676bbb77dc74a37944b3f15108c97f9'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:05.845051 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8cb89f0d-46e0-467d-86fa-5c807cef45e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9676bbb77dc74a37944b3f15108c97f9'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:05.845748 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8cb89f0d-46e0-467d-86fa-5c807cef45e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9676bbb77dc74a37944b3f15108c97f9'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:05.858167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8cb89f0d-46e0-467d-86fa-5c807cef45e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9676bbb77dc74a37944b3f15108c97f9'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:05.953636 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8cb89f0d-46e0-467d-86fa-5c807cef45e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9676bbb77dc74a37944b3f15108c97f9'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:05.962436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1113/2250] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:32:05 2021] DELETE /identity/v3/users/9676bbb77dc74a37944b3f15108c97f9 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:32:05.967204 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c914ab-03a6-49d4-a601-7dfb8c12ebe1 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:05.967767 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c914ab-03a6-49d4-a601-7dfb8c12ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:05.967983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c914ab-03a6-49d4-a601-7dfb8c12ebe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:06.001489 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-64c914ab-03a6-49d4-a601-7dfb8c12ebe1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:06.002696 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-64c914ab-03a6-49d4-a601-7dfb8c12ebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:06.069880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1138/2251] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:32:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:06.082729 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb89f0d-46e0-467d-86fa-5c807cef45e7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:06.084222 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8cb89f0d-46e0-467d-86fa-5c807cef45e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:06.145303 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb89f0d-46e0-467d-86fa-5c807cef45e7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:06.149508 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8d27e-2d5e-45cd-80de-037255cbd5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:06.150149 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8d27e-2d5e-45cd-80de-037255cbd5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:06.150426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8d27e-2d5e-45cd-80de-037255cbd5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:06.151330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8d27e-2d5e-45cd-80de-037255cbd5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:06.160848 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8d27e-2d5e-45cd-80de-037255cbd5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:06.162247 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8d27e-2d5e-45cd-80de-037255cbd5a0 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:06.172656 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1114/2252] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:32:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:32:06.740422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c914ab-03a6-49d4-a601-7dfb8c12ebe1 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:06.742125 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-64c914ab-03a6-49d4-a601-7dfb8c12ebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:06.754380 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c914ab-03a6-49d4-a601-7dfb8c12ebe1 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:06.760706 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:06.761590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:06.761881 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:06.762129 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] PATH_INFO: `/v3/projects/880c181f01594574934c52905302743d` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:06.763424 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] RBAC: Authorizing `identity:delete_project(project_id=880c181f01594574934c52905302743d)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:06.765297 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:06.950162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880c181f01594574934c52905302743d', 'request_id': 'req-7e6e581c-54e8-42e9-baf5-3262d367474e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:07.041020 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880c181f01594574934c52905302743d', 'request_id': 'req-7e6e581c-54e8-42e9-baf5-3262d367474e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:07.048241 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880c181f01594574934c52905302743d', 'request_id': 'req-7e6e581c-54e8-42e9-baf5-3262d367474e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:07.062583 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] The token cache is being invalidate because project 880c181f01594574934c52905302743d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:32:07.062970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:07.063836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:07.065364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1139/2253] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:32:06 2021] DELETE /identity/v3/projects/880c181f01594574934c52905302743d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:32:07.069904 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8d27e-2d5e-45cd-80de-037255cbd5a0 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:07.081768 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8d27e-2d5e-45cd-80de-037255cbd5a0 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:07.166050 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0bc53-60e9-459c-ad47-d43ca6c1ee80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:07.167111 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0bc53-60e9-459c-ad47-d43ca6c1ee80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:07.167398 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0bc53-60e9-459c-ad47-d43ca6c1ee80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:07.167907 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0bc53-60e9-459c-ad47-d43ca6c1ee80 admin admin] PATH_INFO: `/v3/users/c3866fd64e64436e80b0f51f7270aaf7` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:07.172025 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0bc53-60e9-459c-ad47-d43ca6c1ee80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3866fd64e64436e80b0f51f7270aaf7)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:07.172025 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0bc53-60e9-459c-ad47-d43ca6c1ee80 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:07.385699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-12d0bc53-60e9-459c-ad47-d43ca6c1ee80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3866fd64e64436e80b0f51f7270aaf7'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:07.392324 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-12d0bc53-60e9-459c-ad47-d43ca6c1ee80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3866fd64e64436e80b0f51f7270aaf7'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:07.392988 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-12d0bc53-60e9-459c-ad47-d43ca6c1ee80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3866fd64e64436e80b0f51f7270aaf7'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:07.404388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-12d0bc53-60e9-459c-ad47-d43ca6c1ee80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3866fd64e64436e80b0f51f7270aaf7'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:07.509642 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-12d0bc53-60e9-459c-ad47-d43ca6c1ee80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3866fd64e64436e80b0f51f7270aaf7'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:07.516128 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1115/2254] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:32:07 2021] DELETE /identity/v3/users/c3866fd64e64436e80b0f51f7270aaf7 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:32:07.974212 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:07.976252 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:07.989815 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e581c-54e8-42e9-baf5-3262d367474e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:08.066478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:08.067332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:08.067615 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:08.067961 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] PATH_INFO: `/v3/projects/2b662f6fcb9345d29f23b6e0bd47ae60` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:08.070217 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b662f6fcb9345d29f23b6e0bd47ae60)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:08.072168 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:08.221893 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b662f6fcb9345d29f23b6e0bd47ae60', 'request_id': 'req-3d888455-8026-4bb5-9dc8-1ebdeaf19507'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:08.287059 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b662f6fcb9345d29f23b6e0bd47ae60', 'request_id': 'req-3d888455-8026-4bb5-9dc8-1ebdeaf19507'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:08.293690 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b662f6fcb9345d29f23b6e0bd47ae60', 'request_id': 'req-3d888455-8026-4bb5-9dc8-1ebdeaf19507'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:08.305493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] The token cache is being invalidate because project 2b662f6fcb9345d29f23b6e0bd47ae60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:32:08.305869 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:08.306433 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:08.308310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1140/2255] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:32:07 2021] DELETE /identity/v3/projects/2b662f6fcb9345d29f23b6e0bd47ae60 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:32:08.312141 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0bc53-60e9-459c-ad47-d43ca6c1ee80 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:08.313684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-12d0bc53-60e9-459c-ad47-d43ca6c1ee80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:08.327180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0bc53-60e9-459c-ad47-d43ca6c1ee80 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:08.383453 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923daef-6e67-4971-9552-79f0438eb271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:08.384374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923daef-6e67-4971-9552-79f0438eb271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:08.384652 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923daef-6e67-4971-9552-79f0438eb271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:08.384924 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923daef-6e67-4971-9552-79f0438eb271 admin admin] PATH_INFO: `/v3/users/7cdc3ab236194e3486ef8186da7039ab` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:08.388000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923daef-6e67-4971-9552-79f0438eb271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cdc3ab236194e3486ef8186da7039ab)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:08.390014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923daef-6e67-4971-9552-79f0438eb271 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:08.592132 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b923daef-6e67-4971-9552-79f0438eb271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cdc3ab236194e3486ef8186da7039ab'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:08.599094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b923daef-6e67-4971-9552-79f0438eb271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cdc3ab236194e3486ef8186da7039ab'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:08.600144 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b923daef-6e67-4971-9552-79f0438eb271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cdc3ab236194e3486ef8186da7039ab'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:08.617510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b923daef-6e67-4971-9552-79f0438eb271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cdc3ab236194e3486ef8186da7039ab'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:08.721589 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b923daef-6e67-4971-9552-79f0438eb271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cdc3ab236194e3486ef8186da7039ab'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:08.730828 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1116/2256] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:32:08 2021] DELETE /identity/v3/users/7cdc3ab236194e3486ef8186da7039ab => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:32:09.385944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:09.388371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:09.402090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d888455-8026-4bb5-9dc8-1ebdeaf19507 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:09.473338 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:09.474254 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:09.474539 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:09.475351 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90 admin admin] PATH_INFO: `/v3/projects/94c3520bbd6f428389addcae2f6e4064` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:09.476707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c3520bbd6f428389addcae2f6e4064)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:09.478955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:09.585371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c3520bbd6f428389addcae2f6e4064', 'request_id': 'req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:09.664510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c3520bbd6f428389addcae2f6e4064', 'request_id': 'req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:09.670332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c3520bbd6f428389addcae2f6e4064', 'request_id': 'req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:09.682084 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90 admin admin] The token cache is being invalidate because project 94c3520bbd6f428389addcae2f6e4064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:32:09.685731 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:09.685731 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-785ebfd7-61b2-48ba-b269-16ebe1cf7c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:09.685731 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1141/2257] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:32:09 2021] DELETE /identity/v3/projects/94c3520bbd6f428389addcae2f6e4064 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:32:09.690441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d868a1-6446-47bd-9987-91217579d9d5 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:09.690895 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d868a1-6446-47bd-9987-91217579d9d5 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:09.691002 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d868a1-6446-47bd-9987-91217579d9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:09.708597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-18d868a1-6446-47bd-9987-91217579d9d5 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:09.709944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-18d868a1-6446-47bd-9987-91217579d9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:09.769011 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1117/2258] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:32:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:32:09.777305 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d110e83-5a71-4cb4-9777-860b05d20d01 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:09.777584 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d110e83-5a71-4cb4-9777-860b05d20d01 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:09.777857 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d110e83-5a71-4cb4-9777-860b05d20d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:09.796233 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-6d110e83-5a71-4cb4-9777-860b05d20d01 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:09.797409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6d110e83-5a71-4cb4-9777-860b05d20d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:09.805868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1142/2259] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:32:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:09.810140 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d868a1-6446-47bd-9987-91217579d9d5 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:09.819882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d868a1-6446-47bd-9987-91217579d9d5 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:09.829079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e153b-0a68-4d31-9585-01e80de6010c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:09.829079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e153b-0a68-4d31-9585-01e80de6010c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:09.829079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e153b-0a68-4d31-9585-01e80de6010c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:09.829079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e153b-0a68-4d31-9585-01e80de6010c admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:09.829495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e153b-0a68-4d31-9585-01e80de6010c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:32:09.829495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e153b-0a68-4d31-9585-01e80de6010c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:09.829495 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e153b-0a68-4d31-9585-01e80de6010c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:09.840830 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1118/2260] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:32:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:32:09.845105 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d110e83-5a71-4cb4-9777-860b05d20d01 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:09.855174 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d110e83-5a71-4cb4-9777-860b05d20d01 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:09.860882 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89927506-1529-4531-a639-4d4a34e49781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:09.861554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89927506-1529-4531-a639-4d4a34e49781 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:09.861848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89927506-1529-4531-a639-4d4a34e49781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:09.863552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89927506-1529-4531-a639-4d4a34e49781 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:09.863552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89927506-1529-4531-a639-4d4a34e49781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:09.864892 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89927506-1529-4531-a639-4d4a34e49781 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:09.989789 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1143/2261] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:32:09 2021] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:32:09.991045 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e153b-0a68-4d31-9585-01e80de6010c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:10.001558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e153b-0a68-4d31-9585-01e80de6010c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:10.060410 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76c503-7f0c-47f4-a5ff-68adb2e9d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:10.061256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76c503-7f0c-47f4-a5ff-68adb2e9d912 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:10.061697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76c503-7f0c-47f4-a5ff-68adb2e9d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:10.062067 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76c503-7f0c-47f4-a5ff-68adb2e9d912 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:10.063105 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76c503-7f0c-47f4-a5ff-68adb2e9d912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:10.065098 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76c503-7f0c-47f4-a5ff-68adb2e9d912 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:10.231622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1119/2262] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:32:09 2021] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:32:10.236876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89927506-1529-4531-a639-4d4a34e49781 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:10.247391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89927506-1529-4531-a639-4d4a34e49781 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:10.252320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10c98c-0aa6-429f-9332-3453b18f0340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:10.252989 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10c98c-0aa6-429f-9332-3453b18f0340 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:10.253271 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10c98c-0aa6-429f-9332-3453b18f0340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:10.253541 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10c98c-0aa6-429f-9332-3453b18f0340 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:10.254529 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10c98c-0aa6-429f-9332-3453b18f0340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:10.256822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10c98c-0aa6-429f-9332-3453b18f0340 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:10.267915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1144/2263] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:32:10 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:32:10.274229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76c503-7f0c-47f4-a5ff-68adb2e9d912 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:10.284635 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76c503-7f0c-47f4-a5ff-68adb2e9d912 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:10.290484 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a15952-d71a-4dde-b1bf-05286c774afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:10.291162 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15952-d71a-4dde-b1bf-05286c774afc admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:10.291460 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15952-d71a-4dde-b1bf-05286c774afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:10.291785 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15952-d71a-4dde-b1bf-05286c774afc admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:10.292523 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a15952-d71a-4dde-b1bf-05286c774afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:10.294186 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a15952-d71a-4dde-b1bf-05286c774afc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:10.308717 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1120/2264] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:32:10 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:32:10.310614 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10c98c-0aa6-429f-9332-3453b18f0340 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:10.322069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10c98c-0aa6-429f-9332-3453b18f0340 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:10.328642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecf317-816c-4309-9ee1-47c32c24e226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:10.330155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecf317-816c-4309-9ee1-47c32c24e226 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:10.330506 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecf317-816c-4309-9ee1-47c32c24e226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:10.330846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecf317-816c-4309-9ee1-47c32c24e226 admin admin] PATH_INFO: `/v3/projects/18626e87dcd742bca0e65ddb87d7b10b/users/cd18483ef44e4f83909d856b2ec64366/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:10.350944 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ecf317-816c-4309-9ee1-47c32c24e226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18626e87dcd742bca0e65ddb87d7b10b, user_id=cd18483ef44e4f83909d856b2ec64366, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:10.353662 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ecf317-816c-4309-9ee1-47c32c24e226 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:10.482809 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1145/2265] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:32:10 2021] PUT /identity/v3/projects/18626e87dcd742bca0e65ddb87d7b10b/users/cd18483ef44e4f83909d856b2ec64366/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:32:10.494042 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd5fc5-f405-4700-bbc1-443cb7e79394 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:10.494474 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd5fc5-f405-4700-bbc1-443cb7e79394 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:10.494869 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd5fc5-f405-4700-bbc1-443cb7e79394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:10.536690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-44cd5fc5-f405-4700-bbc1-443cb7e79394 None None] MFA Rules not processed for user `cd18483ef44e4f83909d856b2ec64366`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:10.538721 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-44cd5fc5-f405-4700-bbc1-443cb7e79394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:10.629232 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1121/2266] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:32:10 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:10.711438 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecf317-816c-4309-9ee1-47c32c24e226 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:10.720673 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-76ecf317-816c-4309-9ee1-47c32c24e226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:10.792333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecf317-816c-4309-9ee1-47c32c24e226 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:10.798586 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca14027-70d2-424a-9c0f-76b9f95714ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:10.799253 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca14027-70d2-424a-9c0f-76b9f95714ca service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:10.799536 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca14027-70d2-424a-9c0f-76b9f95714ca service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:10.799844 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca14027-70d2-424a-9c0f-76b9f95714ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:10.812379 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca14027-70d2-424a-9c0f-76b9f95714ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:10.817349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca14027-70d2-424a-9c0f-76b9f95714ca service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:10.825272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1146/2267] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:32:10 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:32:12.077760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cd648-aee7-4441-8e7f-024373a794d3 None None] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:12.078280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cd648-aee7-4441-8e7f-024373a794d3 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:12.078366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cd648-aee7-4441-8e7f-024373a794d3 None None] PATH_INFO: `/` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:12.081446 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1122/2268] 10.222.0.87 () {54 vars in 960 bytes} [Fri Oct 29 01:32:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:32:12.088234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee806e-1996-4a04-8cd9-70a6924765e9 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:12.089098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee806e-1996-4a04-8cd9-70a6924765e9 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:12.089370 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee806e-1996-4a04-8cd9-70a6924765e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:12.161170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-21ee806e-1996-4a04-8cd9-70a6924765e9 None None] MFA Rules not processed for user `9aa303a60fec4ac5aaeb96c6618b387e`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:12.163565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-21ee806e-1996-4a04-8cd9-70a6924765e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:12.274778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1147/2269] 10.222.0.87 () {58 vars in 1057 bytes} [Fri Oct 29 01:32:12 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:12.280521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cd648-aee7-4441-8e7f-024373a794d3 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:12.295882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cd648-aee7-4441-8e7f-024373a794d3 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:12.301512 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2275c-f4b6-465f-8d3e-a930648826c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa303a60fec4ac5aaeb96c6618b387e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:12.302160 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2275c-f4b6-465f-8d3e-a930648826c1 service placement] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:12.302609 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2275c-f4b6-465f-8d3e-a930648826c1 service placement] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:12.303152 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2275c-f4b6-465f-8d3e-a930648826c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:12.305945 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-def2275c-f4b6-465f-8d3e-a930648826c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:12.318340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2275c-f4b6-465f-8d3e-a930648826c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:12.321168 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2275c-f4b6-465f-8d3e-a930648826c1 service placement] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:12.332172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1123/2270] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:32:12 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:32:12.588969 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dc5c5-6c33-40cb-ae82-a3c1c1b3aa60 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:12.589505 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dc5c5-6c33-40cb-ae82-a3c1c1b3aa60 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:12.589921 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dc5c5-6c33-40cb-ae82-a3c1c1b3aa60 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:12.592364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1148/2271] 10.222.0.87 () {54 vars in 921 bytes} [Fri Oct 29 01:32:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:32:12.599616 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75301430-4ec5-48d2-9ac5-1e5086fbf863 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:12.600045 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75301430-4ec5-48d2-9ac5-1e5086fbf863 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:12.600317 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75301430-4ec5-48d2-9ac5-1e5086fbf863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:12.676434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-75301430-4ec5-48d2-9ac5-1e5086fbf863 None None] MFA Rules not processed for user `28d331f2997547968c51fec87598420f`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:12.677798 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-75301430-4ec5-48d2-9ac5-1e5086fbf863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:12.754753 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1124/2272] 10.222.0.87 () {58 vars in 1018 bytes} [Fri Oct 29 01:32:12 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:12.769019 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22dc5c5-6c33-40cb-ae82-a3c1c1b3aa60 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:12.770737 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-f22dc5c5-6c33-40cb-ae82-a3c1c1b3aa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:12.859083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22dc5c5-6c33-40cb-ae82-a3c1c1b3aa60 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:12.862924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206d17b-1632-4c42-a53b-10b95939850f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0998dd32ba8648cfb7f43797a9266d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:12.863622 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d17b-1632-4c42-a53b-10b95939850f service glance] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:12.863933 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d17b-1632-4c42-a53b-10b95939850f service glance] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:12.864256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d17b-1632-4c42-a53b-10b95939850f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:12.876737 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206d17b-1632-4c42-a53b-10b95939850f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:12.878185 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206d17b-1632-4c42-a53b-10b95939850f service glance] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:12.890251 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1149/2273] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:32:12 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:32:13.044002 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8551ce-b4c1-48e6-a8fa-7e4dd9865e9b None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:13.044274 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8551ce-b4c1-48e6-a8fa-7e4dd9865e9b None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:13.044547 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8551ce-b4c1-48e6-a8fa-7e4dd9865e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:13.063093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-fd8551ce-b4c1-48e6-a8fa-7e4dd9865e9b None None] MFA Rules not processed for user `cd18483ef44e4f83909d856b2ec64366`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:13.064328 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-fd8551ce-b4c1-48e6-a8fa-7e4dd9865e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:13.072248 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1125/2274] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:32:13 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:13.370458 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7a1c9-8c7e-49d0-a9ff-8b3efffbade6 None None] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:13.371057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7a1c9-8c7e-49d0-a9ff-8b3efffbade6 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:13.371057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7a1c9-8c7e-49d0-a9ff-8b3efffbade6 None None] PATH_INFO: `/` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:13.372847 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1150/2275] 10.222.0.87 () {54 vars in 921 bytes} [Fri Oct 29 01:32:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 01:32:13.378470 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e056c-45eb-4e52-bd0f-66060261e97a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:13.378946 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e056c-45eb-4e52-bd0f-66060261e97a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:13.379038 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e056c-45eb-4e52-bd0f-66060261e97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:13.407020 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d89e056c-45eb-4e52-bd0f-66060261e97a None None] MFA Rules not processed for user `48b92ce8a3bd4d1ebfd94249d525addb`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:13.408466 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d89e056c-45eb-4e52-bd0f-66060261e97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:13.467557 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1126/2276] 10.222.0.87 () {58 vars in 1018 bytes} [Fri Oct 29 01:32:13 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:13.486866 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7a1c9-8c7e-49d0-a9ff-8b3efffbade6 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:13.488758 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-47f7a1c9-8c7e-49d0-a9ff-8b3efffbade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:13.515012 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7a1c9-8c7e-49d0-a9ff-8b3efffbade6 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:13.520612 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebe787-98c4-4e18-8af7-d7ac5e0a99fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:13.522679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebe787-98c4-4e18-8af7-d7ac5e0a99fe service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:13.522679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebe787-98c4-4e18-8af7-d7ac5e0a99fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:13.522926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebe787-98c4-4e18-8af7-d7ac5e0a99fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:13.535173 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebe787-98c4-4e18-8af7-d7ac5e0a99fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:13.537094 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebe787-98c4-4e18-8af7-d7ac5e0a99fe service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:13.547264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1151/2277] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:32:13 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:32:21.930714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf728f9-6749-4f3e-9a8e-381075a95a9e None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:21.931296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf728f9-6749-4f3e-9a8e-381075a95a9e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:21.931296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf728f9-6749-4f3e-9a8e-381075a95a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:21.988082 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-faf728f9-6749-4f3e-9a8e-381075a95a9e None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:21.989556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-faf728f9-6749-4f3e-9a8e-381075a95a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:22.072853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1127/2278] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:32:21 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:22.102478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebe787-98c4-4e18-8af7-d7ac5e0a99fe service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:22.104161 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-55ebe787-98c4-4e18-8af7-d7ac5e0a99fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:22.204647 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebe787-98c4-4e18-8af7-d7ac5e0a99fe service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:22.210243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d201e45-72f7-43d2-90cb-2d786b58dcba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:22.210891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d201e45-72f7-43d2-90cb-2d786b58dcba service swift] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:22.211167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d201e45-72f7-43d2-90cb-2d786b58dcba service swift] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:22.211479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d201e45-72f7-43d2-90cb-2d786b58dcba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:22.220029 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d201e45-72f7-43d2-90cb-2d786b58dcba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:22.221632 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d201e45-72f7-43d2-90cb-2d786b58dcba service swift] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:22.230220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1152/2279] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:32:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 01:32:25.716057 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3128b0e-7af6-4103-b1da-8c2edf83985c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:25.716949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3128b0e-7af6-4103-b1da-8c2edf83985c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:25.717488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3128b0e-7af6-4103-b1da-8c2edf83985c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:25.736199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-c3128b0e-7af6-4103-b1da-8c2edf83985c None None] MFA Rules not processed for user `34ad077fd0164d3c8b4db14262186901`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:25.737409 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c3128b0e-7af6-4103-b1da-8c2edf83985c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:25.798894 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1128/2280] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:32:25 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:37.986094 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d201e45-72f7-43d2-90cb-2d786b58dcba service swift] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:37.987494 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-9d201e45-72f7-43d2-90cb-2d786b58dcba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:38.054101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d201e45-72f7-43d2-90cb-2d786b58dcba service swift] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:38.060048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36c601-abb9-4ec9-8e45-a94f2abec214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:38.060925 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36c601-abb9-4ec9-8e45-a94f2abec214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:38.061359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36c601-abb9-4ec9-8e45-a94f2abec214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:38.061638 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36c601-abb9-4ec9-8e45-a94f2abec214 admin admin] PATH_INFO: `/v3/users/d2204afe21004a0abc892ee4bfe816de` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:38.062874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36c601-abb9-4ec9-8e45-a94f2abec214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2204afe21004a0abc892ee4bfe816de)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:38.065012 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36c601-abb9-4ec9-8e45-a94f2abec214 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:38.330528 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-aa36c601-abb9-4ec9-8e45-a94f2abec214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2204afe21004a0abc892ee4bfe816de'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:38.331235 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-aa36c601-abb9-4ec9-8e45-a94f2abec214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2204afe21004a0abc892ee4bfe816de'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:38.344170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-aa36c601-abb9-4ec9-8e45-a94f2abec214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2204afe21004a0abc892ee4bfe816de'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:38.352112 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-aa36c601-abb9-4ec9-8e45-a94f2abec214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2204afe21004a0abc892ee4bfe816de'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:38.435650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-aa36c601-abb9-4ec9-8e45-a94f2abec214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2204afe21004a0abc892ee4bfe816de'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:38.446078 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1153/2281] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:32:37 2021] DELETE /identity/v3/users/d2204afe21004a0abc892ee4bfe816de => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:32:38.446557 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87ff23-efe6-4f7b-aa9b-af2cbd65f8c6 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:38.447115 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87ff23-efe6-4f7b-aa9b-af2cbd65f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:38.447719 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87ff23-efe6-4f7b-aa9b-af2cbd65f8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:38.465357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-0a87ff23-efe6-4f7b-aa9b-af2cbd65f8c6 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:38.466561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-0a87ff23-efe6-4f7b-aa9b-af2cbd65f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:38.522764 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1129/2282] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:32:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:32:38.534344 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36c601-abb9-4ec9-8e45-a94f2abec214 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:38.535788 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-aa36c601-abb9-4ec9-8e45-a94f2abec214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:38.592327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36c601-abb9-4ec9-8e45-a94f2abec214 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:38.596007 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef83f5-6472-4fe5-92e7-88c4374d99d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:38.596655 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef83f5-6472-4fe5-92e7-88c4374d99d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:38.596940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef83f5-6472-4fe5-92e7-88c4374d99d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:38.597213 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef83f5-6472-4fe5-92e7-88c4374d99d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:38.606226 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef83f5-6472-4fe5-92e7-88c4374d99d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:38.607653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef83f5-6472-4fe5-92e7-88c4374d99d1 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:38.617036 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1154/2283] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:32:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:32:39.023192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87ff23-efe6-4f7b-aa9b-af2cbd65f8c6 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:39.024836 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-0a87ff23-efe6-4f7b-aa9b-af2cbd65f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:39.037436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87ff23-efe6-4f7b-aa9b-af2cbd65f8c6 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:39.042444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:39.043972 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:39.044694 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:39.045080 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992 admin admin] PATH_INFO: `/v3/projects/771b3d26614d4a06a3a71452b04fb606` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:39.047006 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=771b3d26614d4a06a3a71452b04fb606)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:39.062957 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:39.191408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771b3d26614d4a06a3a71452b04fb606', 'request_id': 'req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:39.273838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771b3d26614d4a06a3a71452b04fb606', 'request_id': 'req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:39.281237 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771b3d26614d4a06a3a71452b04fb606', 'request_id': 'req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:39.293459 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992 admin admin] The token cache is being invalidate because project 771b3d26614d4a06a3a71452b04fb606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:32:39.293459 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:39.294294 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d3d7d08d-b0f1-4c21-af55-2af0dfee8992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:32:39.299103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1130/2284] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:32:39 2021] DELETE /identity/v3/projects/771b3d26614d4a06a3a71452b04fb606 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:32:39.304455 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cb419-52cf-4c59-882b-f3bca8e5d00d None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:39.305027 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cb419-52cf-4c59-882b-f3bca8e5d00d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:39.305027 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cb419-52cf-4c59-882b-f3bca8e5d00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:39.325325 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-406cb419-52cf-4c59-882b-f3bca8e5d00d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:39.326781 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-406cb419-52cf-4c59-882b-f3bca8e5d00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:39.397305 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1155/2285] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:32:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:39.407210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b2ef2-cb2c-40a2-8c2f-19217a306ad8 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:39.407501 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b2ef2-cb2c-40a2-8c2f-19217a306ad8 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:39.412242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b2ef2-cb2c-40a2-8c2f-19217a306ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:39.429134 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-4b8b2ef2-cb2c-40a2-8c2f-19217a306ad8 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:39.430340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4b8b2ef2-cb2c-40a2-8c2f-19217a306ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:39.439987 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1131/2286] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:32:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:32:39.444335 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cb419-52cf-4c59-882b-f3bca8e5d00d None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:39.455367 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cb419-52cf-4c59-882b-f3bca8e5d00d None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:39.460192 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874c6b-7864-4d61-97e6-d3df802d3930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:39.460861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874c6b-7864-4d61-97e6-d3df802d3930 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:39.461144 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874c6b-7864-4d61-97e6-d3df802d3930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:39.461420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874c6b-7864-4d61-97e6-d3df802d3930 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:39.462176 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15874c6b-7864-4d61-97e6-d3df802d3930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:32:39.462620 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15874c6b-7864-4d61-97e6-d3df802d3930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:39.464158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15874c6b-7864-4d61-97e6-d3df802d3930 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:39.479547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1156/2287] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:32:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:32:39.484294 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b2ef2-cb2c-40a2-8c2f-19217a306ad8 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:39.495340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b2ef2-cb2c-40a2-8c2f-19217a306ad8 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:39.500705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc48a77-1505-4176-8734-92d5dc5292d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:39.501722 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc48a77-1505-4176-8734-92d5dc5292d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:39.502292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc48a77-1505-4176-8734-92d5dc5292d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:39.502790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc48a77-1505-4176-8734-92d5dc5292d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:39.503757 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc48a77-1505-4176-8734-92d5dc5292d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:39.505943 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc48a77-1505-4176-8734-92d5dc5292d3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:39.609974 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1132/2288] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:32:39 2021] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:32:39.614378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874c6b-7864-4d61-97e6-d3df802d3930 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:39.625905 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874c6b-7864-4d61-97e6-d3df802d3930 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:39.699968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c7be8-8c3e-4a5e-b92a-5378c6a24656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:39.700645 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c7be8-8c3e-4a5e-b92a-5378c6a24656 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:39.700925 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c7be8-8c3e-4a5e-b92a-5378c6a24656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:39.701198 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c7be8-8c3e-4a5e-b92a-5378c6a24656 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:39.702165 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c7be8-8c3e-4a5e-b92a-5378c6a24656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:39.704260 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c7be8-8c3e-4a5e-b92a-5378c6a24656 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:39.785972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1157/2289] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:32:39 2021] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:32:39.790597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc48a77-1505-4176-8734-92d5dc5292d3 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:39.801759 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc48a77-1505-4176-8734-92d5dc5292d3 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:39.807283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc877fe-9de7-405e-895d-d547d2922c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:39.808313 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc877fe-9de7-405e-895d-d547d2922c34 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:39.808598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc877fe-9de7-405e-895d-d547d2922c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:39.808869 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc877fe-9de7-405e-895d-d547d2922c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:39.809620 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc877fe-9de7-405e-895d-d547d2922c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:39.811204 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc877fe-9de7-405e-895d-d547d2922c34 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:39.823799 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1133/2290] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:32:39 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:32:39.828248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c7be8-8c3e-4a5e-b92a-5378c6a24656 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:39.838920 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c7be8-8c3e-4a5e-b92a-5378c6a24656 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:39.843779 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb247b01-dee3-48d9-a9d3-61cdb5da3a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:39.844443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb247b01-dee3-48d9-a9d3-61cdb5da3a79 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:39.844718 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb247b01-dee3-48d9-a9d3-61cdb5da3a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:39.844987 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb247b01-dee3-48d9-a9d3-61cdb5da3a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:39.845719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb247b01-dee3-48d9-a9d3-61cdb5da3a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:39.847290 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb247b01-dee3-48d9-a9d3-61cdb5da3a79 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:39.857627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1158/2291] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:32:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:32:39.864095 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc877fe-9de7-405e-895d-d547d2922c34 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:39.872188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc877fe-9de7-405e-895d-d547d2922c34 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:39.876886 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b453c-c961-4dad-85e0-e1f0ff903678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:39.877755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b453c-c961-4dad-85e0-e1f0ff903678 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:39.878033 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b453c-c961-4dad-85e0-e1f0ff903678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:39.878302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b453c-c961-4dad-85e0-e1f0ff903678 admin admin] PATH_INFO: `/v3/projects/fea0db42704249b29fba70abbda7991c/users/7c50a525003e427ba5ff9dea8f4ed47e/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:39.894304 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b453c-c961-4dad-85e0-e1f0ff903678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea0db42704249b29fba70abbda7991c, user_id=7c50a525003e427ba5ff9dea8f4ed47e, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:39.896912 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b453c-c961-4dad-85e0-e1f0ff903678 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:39.961706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1134/2292] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:32:39 2021] PUT /identity/v3/projects/fea0db42704249b29fba70abbda7991c/users/7c50a525003e427ba5ff9dea8f4ed47e/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:32:39.973891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2d384-e134-4fdd-9582-9d8ef2c1ec80 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:39.974178 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2d384-e134-4fdd-9582-9d8ef2c1ec80 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:39.974462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2d384-e134-4fdd-9582-9d8ef2c1ec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:39.995193 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-28c2d384-e134-4fdd-9582-9d8ef2c1ec80 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:39.996453 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-28c2d384-e134-4fdd-9582-9d8ef2c1ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:40.055680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1159/2293] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:32:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:40.065786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b453c-c961-4dad-85e0-e1f0ff903678 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:40.067772 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-150b453c-c961-4dad-85e0-e1f0ff903678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:40.129078 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b453c-c961-4dad-85e0-e1f0ff903678 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:40.132984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a2634-c955-48fb-ad1a-6c6b05499635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:40.133633 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2634-c955-48fb-ad1a-6c6b05499635 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:40.133914 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2634-c955-48fb-ad1a-6c6b05499635 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:40.134189 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2634-c955-48fb-ad1a-6c6b05499635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:40.149443 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a2634-c955-48fb-ad1a-6c6b05499635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:40.151837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a2634-c955-48fb-ad1a-6c6b05499635 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:40.163807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1135/2294] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:32:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:32:48.789891 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbd631-cd9b-4d58-9d18-1556a4132cb6 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:48.790530 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbd631-cd9b-4d58-9d18-1556a4132cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:48.790729 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbd631-cd9b-4d58-9d18-1556a4132cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:48.839618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-b9bbd631-cd9b-4d58-9d18-1556a4132cb6 None None] MFA Rules not processed for user `7c50a525003e427ba5ff9dea8f4ed47e`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:48.841336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b9bbd631-cd9b-4d58-9d18-1556a4132cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:48.975508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1160/2295] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:32:48 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:48.980531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a2634-c955-48fb-ad1a-6c6b05499635 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:49.002169 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a2634-c955-48fb-ad1a-6c6b05499635 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:49.010162 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd1498-db7e-4e8f-a498-a337faaa3333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:49.010835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd1498-db7e-4e8f-a498-a337faaa3333 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:49.011111 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd1498-db7e-4e8f-a498-a337faaa3333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:49.011381 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd1498-db7e-4e8f-a498-a337faaa3333 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:49.012333 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd1498-db7e-4e8f-a498-a337faaa3333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:49.014258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd1498-db7e-4e8f-a498-a337faaa3333 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:49.139688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1136/2296] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:32:48 2021] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:32:49.141309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbd631-cd9b-4d58-9d18-1556a4132cb6 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:49.154713 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbd631-cd9b-4d58-9d18-1556a4132cb6 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:49.213642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c26ef-4783-4752-9fdd-e92b92ecb87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:49.214368 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c26ef-4783-4752-9fdd-e92b92ecb87c admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:49.214647 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c26ef-4783-4752-9fdd-e92b92ecb87c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:49.214914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c26ef-4783-4752-9fdd-e92b92ecb87c admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:49.215626 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c26ef-4783-4752-9fdd-e92b92ecb87c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:49.217648 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c26ef-4783-4752-9fdd-e92b92ecb87c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:49.353064 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1161/2297] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:32:49 2021] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:32:49.354649 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd1498-db7e-4e8f-a498-a337faaa3333 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:49.366387 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd1498-db7e-4e8f-a498-a337faaa3333 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:49.372299 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc525f-1ebf-4ea2-a635-a507b2fc7811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:49.372976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc525f-1ebf-4ea2-a635-a507b2fc7811 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:49.373255 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc525f-1ebf-4ea2-a635-a507b2fc7811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:49.373524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc525f-1ebf-4ea2-a635-a507b2fc7811 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:49.374275 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc525f-1ebf-4ea2-a635-a507b2fc7811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:49.375912 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc525f-1ebf-4ea2-a635-a507b2fc7811 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:49.388110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1137/2298] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:32:49 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:32:49.392322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c26ef-4783-4752-9fdd-e92b92ecb87c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:49.403654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c26ef-4783-4752-9fdd-e92b92ecb87c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:49.408871 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e8c46-d2b5-4fa9-a820-887198a9b8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:49.409765 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8c46-d2b5-4fa9-a820-887198a9b8da admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:49.410041 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8c46-d2b5-4fa9-a820-887198a9b8da admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:49.410313 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8c46-d2b5-4fa9-a820-887198a9b8da admin admin] PATH_INFO: `/v3/projects/0ded337b79e04e829dd47a204b4012d2/users/749bd1b682d74b54b4ee07615feb56bc/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:49.425751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e8c46-d2b5-4fa9-a820-887198a9b8da admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ded337b79e04e829dd47a204b4012d2, user_id=749bd1b682d74b54b4ee07615feb56bc, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:49.428739 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e8c46-d2b5-4fa9-a820-887198a9b8da admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:49.544950 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1162/2299] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:32:49 2021] PUT /identity/v3/projects/0ded337b79e04e829dd47a204b4012d2/users/749bd1b682d74b54b4ee07615feb56bc/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:32:49.549248 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc525f-1ebf-4ea2-a635-a507b2fc7811 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:49.561514 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc525f-1ebf-4ea2-a635-a507b2fc7811 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:49.626293 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88ebcf-9364-4807-9688-3af25b3e9ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:49.626972 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88ebcf-9364-4807-9688-3af25b3e9ebd admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:49.627254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88ebcf-9364-4807-9688-3af25b3e9ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:49.627628 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88ebcf-9364-4807-9688-3af25b3e9ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:49.628374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88ebcf-9364-4807-9688-3af25b3e9ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:49.630015 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88ebcf-9364-4807-9688-3af25b3e9ebd admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:49.643787 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1138/2300] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:32:49 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:32:49.647984 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e8c46-d2b5-4fa9-a820-887198a9b8da admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:49.659423 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e8c46-d2b5-4fa9-a820-887198a9b8da admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:49.664519 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2f1cb-762d-421a-ab9a-33cb03963207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:49.665419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2f1cb-762d-421a-ab9a-33cb03963207 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:49.666282 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2f1cb-762d-421a-ab9a-33cb03963207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:49.666595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2f1cb-762d-421a-ab9a-33cb03963207 admin admin] PATH_INFO: `/v3/projects/0ded337b79e04e829dd47a204b4012d2/users/749bd1b682d74b54b4ee07615feb56bc/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:49.668666 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2f1cb-762d-421a-ab9a-33cb03963207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ded337b79e04e829dd47a204b4012d2, user_id=749bd1b682d74b54b4ee07615feb56bc, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:49.671384 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2f1cb-762d-421a-ab9a-33cb03963207 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:49.684026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1163/2301] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:32:49 2021] PUT /identity/v3/projects/0ded337b79e04e829dd47a204b4012d2/users/749bd1b682d74b54b4ee07615feb56bc/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:32:53.002781 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48195a67-4522-4a6c-b789-dc081041f5f2 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:53.003320 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48195a67-4522-4a6c-b789-dc081041f5f2 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:53.003537 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48195a67-4522-4a6c-b789-dc081041f5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:53.127651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-48195a67-4522-4a6c-b789-dc081041f5f2 None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:53.158803 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-48195a67-4522-4a6c-b789-dc081041f5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:53.336600 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1139/2302] 10.222.0.87 () {58 vars in 967 bytes} [Fri Oct 29 01:32:53 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:53.365422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2f1cb-762d-421a-ab9a-33cb03963207 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:53.369332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-cda2f1cb-762d-421a-ab9a-33cb03963207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:53.568735 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2f1cb-762d-421a-ab9a-33cb03963207 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:53.584254 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94453e84-3094-4ef4-a217-82a20c92e044 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:53.586576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94453e84-3094-4ef4-a217-82a20c92e044 service swift] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:53.586873 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94453e84-3094-4ef4-a217-82a20c92e044 service swift] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:53.587202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94453e84-3094-4ef4-a217-82a20c92e044 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:53.614722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94453e84-3094-4ef4-a217-82a20c92e044 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:53.616650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94453e84-3094-4ef4-a217-82a20c92e044 service swift] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:53.647912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1164/2303] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:32:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 01:32:54.977201 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fcec5-608d-4f43-a566-eec78d644075 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:54.984059 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fcec5-608d-4f43-a566-eec78d644075 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:54.984059 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fcec5-608d-4f43-a566-eec78d644075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:55.041688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-788fcec5-608d-4f43-a566-eec78d644075 None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:55.046492 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-788fcec5-608d-4f43-a566-eec78d644075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:55.069779 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1140/2304] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:32:54 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:55.084121 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94453e84-3094-4ef4-a217-82a20c92e044 service swift] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:55.099695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94453e84-3094-4ef4-a217-82a20c92e044 service swift] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:55.127493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa6e2a-27fb-4457-bf93-022bbbee559d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:55.128680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa6e2a-27fb-4457-bf93-022bbbee559d service swift] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:55.129012 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa6e2a-27fb-4457-bf93-022bbbee559d service swift] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:55.131193 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa6e2a-27fb-4457-bf93-022bbbee559d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:55.153954 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa6e2a-27fb-4457-bf93-022bbbee559d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:55.159169 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa6e2a-27fb-4457-bf93-022bbbee559d service swift] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:55.184966 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1165/2305] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:32:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 01:32:57.357919 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ca7cc-47c0-453a-b981-beee4717ea59 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:57.358792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ca7cc-47c0-453a-b981-beee4717ea59 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:57.359075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ca7cc-47c0-453a-b981-beee4717ea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:57.396187 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-908ca7cc-47c0-453a-b981-beee4717ea59 None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:57.396187 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-908ca7cc-47c0-453a-b981-beee4717ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:57.422896 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa6e2a-27fb-4457-bf93-022bbbee559d service swift] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:57.434796 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1141/2306] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:32:57 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:57.437298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa6e2a-27fb-4457-bf93-022bbbee559d service swift] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:57.442804 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a61dd-c452-4424-911a-9cd43dfe2c2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:57.443758 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a61dd-c452-4424-911a-9cd43dfe2c2b service swift] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:57.444235 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a61dd-c452-4424-911a-9cd43dfe2c2b service swift] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:57.444668 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a61dd-c452-4424-911a-9cd43dfe2c2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:57.458359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a61dd-c452-4424-911a-9cd43dfe2c2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:57.460581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a61dd-c452-4424-911a-9cd43dfe2c2b service swift] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:57.481851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1166/2307] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:32:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 01:32:57.545523 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dad163-9059-4e81-8687-cf06520f761c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:57.545856 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dad163-9059-4e81-8687-cf06520f761c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:57.546406 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dad163-9059-4e81-8687-cf06520f761c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:57.595431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-37dad163-9059-4e81-8687-cf06520f761c None None] MFA Rules not processed for user `749bd1b682d74b54b4ee07615feb56bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:57.597677 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-37dad163-9059-4e81-8687-cf06520f761c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:57.680437 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1142/2308] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:32:57 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:57.692963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a61dd-c452-4424-911a-9cd43dfe2c2b service swift] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:57.694519 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-633a61dd-c452-4424-911a-9cd43dfe2c2b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:57.766512 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a61dd-c452-4424-911a-9cd43dfe2c2b service swift] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:57.772099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d929b6-d4f7-47d1-9333-b0d2b153b1f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:57.772742 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d929b6-d4f7-47d1-9333-b0d2b153b1f4 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:57.773025 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d929b6-d4f7-47d1-9333-b0d2b153b1f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:57.773295 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d929b6-d4f7-47d1-9333-b0d2b153b1f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:57.836635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d929b6-d4f7-47d1-9333-b0d2b153b1f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:57.838764 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d929b6-d4f7-47d1-9333-b0d2b153b1f4 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:57.848794 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1167/2309] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:32:57 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:32:58.242316 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3dd04-0677-453e-a5d0-637a3837401c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:58.242316 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3dd04-0677-453e-a5d0-637a3837401c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:58.242524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3dd04-0677-453e-a5d0-637a3837401c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:58.264211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-11b3dd04-0677-453e-a5d0-637a3837401c None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:32:58.265540 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-11b3dd04-0677-453e-a5d0-637a3837401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:32:58.273429 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1143/2310] 10.222.0.87 () {58 vars in 967 bytes} [Fri Oct 29 01:32:58 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:32:58.286548 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d929b6-d4f7-47d1-9333-b0d2b153b1f4 service nova] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:32:58.297564 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d929b6-d4f7-47d1-9333-b0d2b153b1f4 service nova] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:32:58.302745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f1f84-f593-42a2-983f-9ba757f76e69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:32:58.310360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f1f84-f593-42a2-983f-9ba757f76e69 service swift] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:32:58.310360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f1f84-f593-42a2-983f-9ba757f76e69 service swift] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:32:58.310360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f1f84-f593-42a2-983f-9ba757f76e69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:32:58.313069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f1f84-f593-42a2-983f-9ba757f76e69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:32:58.314677 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f1f84-f593-42a2-983f-9ba757f76e69 service swift] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:32:58.324695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1168/2311] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:32:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 01:33:01.199249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3dd04-0677-453e-a5d0-637a3837401c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:01.201167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-11b3dd04-0677-453e-a5d0-637a3837401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:01.283005 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3dd04-0677-453e-a5d0-637a3837401c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:01.288398 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e10a4-bf4d-4aa9-94f8-9048d18d4aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:01.289644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e10a4-bf4d-4aa9-94f8-9048d18d4aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:01.290011 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e10a4-bf4d-4aa9-94f8-9048d18d4aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:01.290579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e10a4-bf4d-4aa9-94f8-9048d18d4aae admin admin] PATH_INFO: `/v3/users/cd18483ef44e4f83909d856b2ec64366` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:01.292749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e10a4-bf4d-4aa9-94f8-9048d18d4aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd18483ef44e4f83909d856b2ec64366)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:01.294575 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e10a4-bf4d-4aa9-94f8-9048d18d4aae admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:01.318675 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10624-30db-4fe8-8592-30bf663bc18c None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:01.319759 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10624-30db-4fe8-8592-30bf663bc18c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:01.320203 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10624-30db-4fe8-8592-30bf663bc18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:01.339762 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-0ac10624-30db-4fe8-8592-30bf663bc18c None None] MFA Rules not processed for user `7c50a525003e427ba5ff9dea8f4ed47e`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:01.341010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0ac10624-30db-4fe8-8592-30bf663bc18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:01.348931 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1169/2312] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:01 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:01.458093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8e7e10a4-bf4d-4aa9-94f8-9048d18d4aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd18483ef44e4f83909d856b2ec64366'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:01.470010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8e7e10a4-bf4d-4aa9-94f8-9048d18d4aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd18483ef44e4f83909d856b2ec64366'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:01.470767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8e7e10a4-bf4d-4aa9-94f8-9048d18d4aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd18483ef44e4f83909d856b2ec64366'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:01.506980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8e7e10a4-bf4d-4aa9-94f8-9048d18d4aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd18483ef44e4f83909d856b2ec64366'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:01.628818 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-8e7e10a4-bf4d-4aa9-94f8-9048d18d4aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd18483ef44e4f83909d856b2ec64366'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:01.628818 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1144/2313] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:33:01 2021] DELETE /identity/v3/users/cd18483ef44e4f83909d856b2ec64366 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:01.629278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee023c-5ac2-49a0-b8f7-d48e7817dbd8 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:01.629575 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee023c-5ac2-49a0-b8f7-d48e7817dbd8 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:01.629858 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee023c-5ac2-49a0-b8f7-d48e7817dbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:01.668336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-6bee023c-5ac2-49a0-b8f7-d48e7817dbd8 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:01.668336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6bee023c-5ac2-49a0-b8f7-d48e7817dbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:01.746419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1170/2314] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:01.753271 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e10a4-bf4d-4aa9-94f8-9048d18d4aae admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:01.755031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8e7e10a4-bf4d-4aa9-94f8-9048d18d4aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:01.824444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e10a4-bf4d-4aa9-94f8-9048d18d4aae admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:01.829081 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71079d9-8c8d-4041-81b7-dbf41c12a7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:01.829902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71079d9-8c8d-4041-81b7-dbf41c12a7be service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:01.830239 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71079d9-8c8d-4041-81b7-dbf41c12a7be service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:01.830583 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71079d9-8c8d-4041-81b7-dbf41c12a7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:01.841920 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71079d9-8c8d-4041-81b7-dbf41c12a7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:01.843616 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71079d9-8c8d-4041-81b7-dbf41c12a7be service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:01.853892 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1145/2315] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:33:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:33:02.124294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee023c-5ac2-49a0-b8f7-d48e7817dbd8 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:02.127152 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6bee023c-5ac2-49a0-b8f7-d48e7817dbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:02.166928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee023c-5ac2-49a0-b8f7-d48e7817dbd8 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:02.174242 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552ac29-b406-4bd2-8e67-4cdeb83480e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:02.175185 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552ac29-b406-4bd2-8e67-4cdeb83480e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:02.175535 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552ac29-b406-4bd2-8e67-4cdeb83480e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:02.175910 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552ac29-b406-4bd2-8e67-4cdeb83480e9 admin admin] PATH_INFO: `/v3/projects/18626e87dcd742bca0e65ddb87d7b10b` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:02.177829 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552ac29-b406-4bd2-8e67-4cdeb83480e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18626e87dcd742bca0e65ddb87d7b10b)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:02.179865 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552ac29-b406-4bd2-8e67-4cdeb83480e9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:02.369415 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6552ac29-b406-4bd2-8e67-4cdeb83480e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18626e87dcd742bca0e65ddb87d7b10b', 'request_id': 'req-6552ac29-b406-4bd2-8e67-4cdeb83480e9'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:02.460703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6552ac29-b406-4bd2-8e67-4cdeb83480e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18626e87dcd742bca0e65ddb87d7b10b', 'request_id': 'req-6552ac29-b406-4bd2-8e67-4cdeb83480e9'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:02.468419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6552ac29-b406-4bd2-8e67-4cdeb83480e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18626e87dcd742bca0e65ddb87d7b10b', 'request_id': 'req-6552ac29-b406-4bd2-8e67-4cdeb83480e9'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:02.480662 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6552ac29-b406-4bd2-8e67-4cdeb83480e9 admin admin] The token cache is being invalidate because project 18626e87dcd742bca0e65ddb87d7b10b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:33:02.480907 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6552ac29-b406-4bd2-8e67-4cdeb83480e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:02.481784 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6552ac29-b406-4bd2-8e67-4cdeb83480e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:02.483502 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1171/2316] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:33:02 2021] DELETE /identity/v3/projects/18626e87dcd742bca0e65ddb87d7b10b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:02.491306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba53db-d013-4382-acbd-bcc1f4249446 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:02.492328 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba53db-d013-4382-acbd-bcc1f4249446 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:02.492709 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba53db-d013-4382-acbd-bcc1f4249446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:02.525595 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-49ba53db-d013-4382-acbd-bcc1f4249446 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:02.528203 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-49ba53db-d013-4382-acbd-bcc1f4249446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:02.609237 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1146/2317] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:02.617460 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fe9f6-0ae1-4016-8859-f2e7682fb941 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:02.617747 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fe9f6-0ae1-4016-8859-f2e7682fb941 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:02.618024 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fe9f6-0ae1-4016-8859-f2e7682fb941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:02.642855 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-862fe9f6-0ae1-4016-8859-f2e7682fb941 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:02.644154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-862fe9f6-0ae1-4016-8859-f2e7682fb941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:02.652671 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1172/2318] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:02.657264 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba53db-d013-4382-acbd-bcc1f4249446 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:02.667887 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba53db-d013-4382-acbd-bcc1f4249446 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:02.672771 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661746e-27db-499e-9522-56803667cefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:02.674096 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661746e-27db-499e-9522-56803667cefa admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:02.674723 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661746e-27db-499e-9522-56803667cefa admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:02.675146 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661746e-27db-499e-9522-56803667cefa admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:02.679235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661746e-27db-499e-9522-56803667cefa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:33:02.679962 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661746e-27db-499e-9522-56803667cefa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:02.682752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661746e-27db-499e-9522-56803667cefa admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:02.700137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1147/2319] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:33:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:33:02.704807 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fe9f6-0ae1-4016-8859-f2e7682fb941 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:02.714006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fe9f6-0ae1-4016-8859-f2e7682fb941 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:02.718905 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd0dd4-2c0b-4e12-b81b-9ad17463c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:02.719626 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd0dd4-2c0b-4e12-b81b-9ad17463c4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:02.719996 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd0dd4-2c0b-4e12-b81b-9ad17463c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:02.720276 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd0dd4-2c0b-4e12-b81b-9ad17463c4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:02.721015 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd0dd4-2c0b-4e12-b81b-9ad17463c4c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:02.722925 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd0dd4-2c0b-4e12-b81b-9ad17463c4c2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:02.855993 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1173/2320] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:33:02 2021] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:33:02.865741 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661746e-27db-499e-9522-56803667cefa admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:02.879195 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661746e-27db-499e-9522-56803667cefa admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:02.949696 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72d380-a8b6-472f-96d5-53d0b5a00b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:02.950458 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d380-a8b6-472f-96d5-53d0b5a00b37 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:02.954585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d380-a8b6-472f-96d5-53d0b5a00b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:02.954585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d380-a8b6-472f-96d5-53d0b5a00b37 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:02.954585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72d380-a8b6-472f-96d5-53d0b5a00b37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:02.954585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72d380-a8b6-472f-96d5-53d0b5a00b37 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:03.071792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1148/2321] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:33:02 2021] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:33:03.076519 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd0dd4-2c0b-4e12-b81b-9ad17463c4c2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:03.088840 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd0dd4-2c0b-4e12-b81b-9ad17463c4c2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:03.094957 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1525a8-5666-4640-a172-a451e641634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:03.099850 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1525a8-5666-4640-a172-a451e641634f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:03.099850 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1525a8-5666-4640-a172-a451e641634f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:03.099850 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1525a8-5666-4640-a172-a451e641634f admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:03.099850 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1525a8-5666-4640-a172-a451e641634f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:03.099850 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1525a8-5666-4640-a172-a451e641634f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:03.110971 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1174/2322] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:03 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:33:03.115014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72d380-a8b6-472f-96d5-53d0b5a00b37 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:03.126947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72d380-a8b6-472f-96d5-53d0b5a00b37 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:03.132250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4119a3-481f-4723-8def-2467e317a6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:03.132949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4119a3-481f-4723-8def-2467e317a6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:03.133233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4119a3-481f-4723-8def-2467e317a6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:03.133505 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4119a3-481f-4723-8def-2467e317a6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:03.134255 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4119a3-481f-4723-8def-2467e317a6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:03.136785 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4119a3-481f-4723-8def-2467e317a6c5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:03.148079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1149/2323] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:03 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:33:03.153578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1525a8-5666-4640-a172-a451e641634f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:03.167687 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1525a8-5666-4640-a172-a451e641634f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:03.172872 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c08db-8312-4012-b7c8-f9bacdc2c7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:03.173763 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c08db-8312-4012-b7c8-f9bacdc2c7e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:03.174045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c08db-8312-4012-b7c8-f9bacdc2c7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:03.174340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c08db-8312-4012-b7c8-f9bacdc2c7e6 admin admin] PATH_INFO: `/v3/projects/84bceeeb4f67456a90779360ffc620aa/users/bef8571ef39b4efe8f510a28052e2b6f/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:03.189631 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c08db-8312-4012-b7c8-f9bacdc2c7e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84bceeeb4f67456a90779360ffc620aa, user_id=bef8571ef39b4efe8f510a28052e2b6f, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:03.192362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c08db-8312-4012-b7c8-f9bacdc2c7e6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:03.293945 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1175/2324] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:33:03 2021] PUT /identity/v3/projects/84bceeeb4f67456a90779360ffc620aa/users/bef8571ef39b4efe8f510a28052e2b6f/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:03.299453 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67018dbd-193d-4434-af42-f08f00927125 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:03.299580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67018dbd-193d-4434-af42-f08f00927125 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:03.300046 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67018dbd-193d-4434-af42-f08f00927125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:03.319960 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-67018dbd-193d-4434-af42-f08f00927125 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:03.321196 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-67018dbd-193d-4434-af42-f08f00927125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:03.380926 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1150/2325] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:03.395683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c08db-8312-4012-b7c8-f9bacdc2c7e6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:03.398034 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-bc5c08db-8312-4012-b7c8-f9bacdc2c7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:03.474612 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c08db-8312-4012-b7c8-f9bacdc2c7e6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:03.478566 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becee859-c9e9-461b-a388-68a903b090eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:03.479352 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becee859-c9e9-461b-a388-68a903b090eb service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:03.479633 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becee859-c9e9-461b-a388-68a903b090eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:03.479942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becee859-c9e9-461b-a388-68a903b090eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:03.489588 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becee859-c9e9-461b-a388-68a903b090eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:03.491010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becee859-c9e9-461b-a388-68a903b090eb service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:03.500654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1176/2326] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:33:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:33:03.576920 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67018dbd-193d-4434-af42-f08f00927125 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:03.578309 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-67018dbd-193d-4434-af42-f08f00927125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:03.591297 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67018dbd-193d-4434-af42-f08f00927125 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:03.596347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48290272-c92a-46cb-a2cb-482acb09bb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:03.597233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290272-c92a-46cb-a2cb-482acb09bb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:03.597548 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290272-c92a-46cb-a2cb-482acb09bb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:03.597998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290272-c92a-46cb-a2cb-482acb09bb42 admin admin] PATH_INFO: `/v3/users/ac27192a9b2148f4bff8814f63813098` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:03.599229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48290272-c92a-46cb-a2cb-482acb09bb42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac27192a9b2148f4bff8814f63813098)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:03.601175 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48290272-c92a-46cb-a2cb-482acb09bb42 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:03.861264 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-48290272-c92a-46cb-a2cb-482acb09bb42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac27192a9b2148f4bff8814f63813098'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:03.870079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-48290272-c92a-46cb-a2cb-482acb09bb42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac27192a9b2148f4bff8814f63813098'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:03.870732 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-48290272-c92a-46cb-a2cb-482acb09bb42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac27192a9b2148f4bff8814f63813098'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:03.883640 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-48290272-c92a-46cb-a2cb-482acb09bb42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac27192a9b2148f4bff8814f63813098'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:03.972917 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-48290272-c92a-46cb-a2cb-482acb09bb42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac27192a9b2148f4bff8814f63813098'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:03.979512 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1151/2327] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:33:03 2021] DELETE /identity/v3/users/ac27192a9b2148f4bff8814f63813098 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:04.372624 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becee859-c9e9-461b-a388-68a903b090eb service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:04.393330 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becee859-c9e9-461b-a388-68a903b090eb service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:04.456684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365e611-37d1-428c-868c-6ee7325224b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:04.457573 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365e611-37d1-428c-868c-6ee7325224b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:04.457851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365e611-37d1-428c-868c-6ee7325224b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:04.458129 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365e611-37d1-428c-868c-6ee7325224b1 admin admin] PATH_INFO: `/v3/projects/4b037cd872fe4e0b8b9429048c567b1b` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:04.459342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365e611-37d1-428c-868c-6ee7325224b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b037cd872fe4e0b8b9429048c567b1b)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:04.461260 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365e611-37d1-428c-868c-6ee7325224b1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:04.605635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9365e611-37d1-428c-868c-6ee7325224b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b037cd872fe4e0b8b9429048c567b1b', 'request_id': 'req-9365e611-37d1-428c-868c-6ee7325224b1'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:04.738179 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9365e611-37d1-428c-868c-6ee7325224b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b037cd872fe4e0b8b9429048c567b1b', 'request_id': 'req-9365e611-37d1-428c-868c-6ee7325224b1'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:04.745600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9365e611-37d1-428c-868c-6ee7325224b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b037cd872fe4e0b8b9429048c567b1b', 'request_id': 'req-9365e611-37d1-428c-868c-6ee7325224b1'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:04.758318 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9365e611-37d1-428c-868c-6ee7325224b1 admin admin] The token cache is being invalidate because project 4b037cd872fe4e0b8b9429048c567b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:33:04.758736 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9365e611-37d1-428c-868c-6ee7325224b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:04.760356 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9365e611-37d1-428c-868c-6ee7325224b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:04.762269 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1177/2328] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:33:04 2021] DELETE /identity/v3/projects/4b037cd872fe4e0b8b9429048c567b1b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:04.768779 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539295a-ea4e-4f58-898f-c4565c73e76b None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:04.769329 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539295a-ea4e-4f58-898f-c4565c73e76b None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:04.769329 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539295a-ea4e-4f58-898f-c4565c73e76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:04.797209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-6539295a-ea4e-4f58-898f-c4565c73e76b None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:04.798490 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6539295a-ea4e-4f58-898f-c4565c73e76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:04.864165 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1152/2329] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:33:04.872075 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ef8c8-0f6d-47bc-9956-c3ea7e075052 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:04.872459 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ef8c8-0f6d-47bc-9956-c3ea7e075052 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:04.872822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ef8c8-0f6d-47bc-9956-c3ea7e075052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:04.893833 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-4e5ef8c8-0f6d-47bc-9956-c3ea7e075052 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:04.894964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4e5ef8c8-0f6d-47bc-9956-c3ea7e075052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:04.904093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1178/2330] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:04.908395 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539295a-ea4e-4f58-898f-c4565c73e76b None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:04.919864 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539295a-ea4e-4f58-898f-c4565c73e76b None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:04.925530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14209c-9af1-4bd0-bb4b-1070f58a95fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:04.926368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14209c-9af1-4bd0-bb4b-1070f58a95fe admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:04.926651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14209c-9af1-4bd0-bb4b-1070f58a95fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:04.926928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14209c-9af1-4bd0-bb4b-1070f58a95fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:04.927673 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14209c-9af1-4bd0-bb4b-1070f58a95fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:33:04.928012 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14209c-9af1-4bd0-bb4b-1070f58a95fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:04.929589 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14209c-9af1-4bd0-bb4b-1070f58a95fe admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:04.942226 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1153/2331] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:33:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:33:04.947422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ef8c8-0f6d-47bc-9956-c3ea7e075052 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:04.956795 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ef8c8-0f6d-47bc-9956-c3ea7e075052 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:04.961688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3b27d-a90f-47a5-8d79-e7d10b554bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:04.962353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3b27d-a90f-47a5-8d79-e7d10b554bce admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:04.963407 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3b27d-a90f-47a5-8d79-e7d10b554bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:04.963690 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3b27d-a90f-47a5-8d79-e7d10b554bce admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:04.964423 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3b27d-a90f-47a5-8d79-e7d10b554bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:04.966392 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3b27d-a90f-47a5-8d79-e7d10b554bce admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:05.105166 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1179/2332] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:33:04 2021] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:33:05.108896 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14209c-9af1-4bd0-bb4b-1070f58a95fe admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:05.120183 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14209c-9af1-4bd0-bb4b-1070f58a95fe admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:05.200186 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8f62d-8716-4d90-9669-f128585a236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:05.200860 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f62d-8716-4d90-9669-f128585a236f admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:05.201137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f62d-8716-4d90-9669-f128585a236f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:05.201407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f62d-8716-4d90-9669-f128585a236f admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:05.202373 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8f62d-8716-4d90-9669-f128585a236f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:05.204276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8f62d-8716-4d90-9669-f128585a236f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:05.404500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1154/2333] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:33:05 2021] POST /identity/v3/users => generated 294 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:33:05.405808 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3b27d-a90f-47a5-8d79-e7d10b554bce admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:05.416177 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3b27d-a90f-47a5-8d79-e7d10b554bce admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:05.420918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f1b0e-2a6f-461b-9ee7-26fa84839a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:05.421582 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f1b0e-2a6f-461b-9ee7-26fa84839a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:05.422040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f1b0e-2a6f-461b-9ee7-26fa84839a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:05.422379 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f1b0e-2a6f-461b-9ee7-26fa84839a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:05.423131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f1b0e-2a6f-461b-9ee7-26fa84839a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:05.425051 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f1b0e-2a6f-461b-9ee7-26fa84839a54 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:05.436659 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1180/2334] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:05 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:33:05.440455 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8f62d-8716-4d90-9669-f128585a236f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:05.453432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8f62d-8716-4d90-9669-f128585a236f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:05.458142 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a66632-1a6b-4135-bfaa-a250c94be86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:05.458812 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a66632-1a6b-4135-bfaa-a250c94be86d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:05.459093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a66632-1a6b-4135-bfaa-a250c94be86d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:05.459456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a66632-1a6b-4135-bfaa-a250c94be86d admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:05.460275 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a66632-1a6b-4135-bfaa-a250c94be86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:05.461880 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a66632-1a6b-4135-bfaa-a250c94be86d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:05.473119 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1155/2335] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:05 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:33:05.477162 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f1b0e-2a6f-461b-9ee7-26fa84839a54 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:05.489110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f1b0e-2a6f-461b-9ee7-26fa84839a54 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:05.494451 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17b26b-23a8-4a5d-b019-1a9fd22c6e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:05.495413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17b26b-23a8-4a5d-b019-1a9fd22c6e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:05.495777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17b26b-23a8-4a5d-b019-1a9fd22c6e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:05.496191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17b26b-23a8-4a5d-b019-1a9fd22c6e70 admin admin] PATH_INFO: `/v3/projects/80b7052d7a294778845620bedec80494/users/9680ad9ddeb74e35a281525c3f37f80c/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:05.514856 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17b26b-23a8-4a5d-b019-1a9fd22c6e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b7052d7a294778845620bedec80494, user_id=9680ad9ddeb74e35a281525c3f37f80c, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:05.517619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17b26b-23a8-4a5d-b019-1a9fd22c6e70 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:05.582023 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1181/2336] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:33:05 2021] PUT /identity/v3/projects/80b7052d7a294778845620bedec80494/users/9680ad9ddeb74e35a281525c3f37f80c/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:05.594578 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c242b-5d79-4ece-b4c9-abe72b187fab None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:05.594868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c242b-5d79-4ece-b4c9-abe72b187fab None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:05.595143 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c242b-5d79-4ece-b4c9-abe72b187fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:05.629510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-737c242b-5d79-4ece-b4c9-abe72b187fab None None] MFA Rules not processed for user `9680ad9ddeb74e35a281525c3f37f80c`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:05.630740 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-737c242b-5d79-4ece-b4c9-abe72b187fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:05.703866 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1156/2337] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:05 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:05.708965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17b26b-23a8-4a5d-b019-1a9fd22c6e70 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:05.784536 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17b26b-23a8-4a5d-b019-1a9fd22c6e70 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:05.789953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c1325-f63b-4370-b93c-90a2c46e69fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:05.793838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c1325-f63b-4370-b93c-90a2c46e69fe admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:05.793838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c1325-f63b-4370-b93c-90a2c46e69fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:05.793838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c1325-f63b-4370-b93c-90a2c46e69fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:05.793838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c1325-f63b-4370-b93c-90a2c46e69fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:05.795296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c1325-f63b-4370-b93c-90a2c46e69fe admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:05.918370 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1182/2338] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:33:05 2021] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:33:05.927753 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c242b-5d79-4ece-b4c9-abe72b187fab None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:05.947051 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c242b-5d79-4ece-b4c9-abe72b187fab None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:06.020353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a124817-778c-4640-a52d-48c01cf41f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:06.021203 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a124817-778c-4640-a52d-48c01cf41f97 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:06.021655 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a124817-778c-4640-a52d-48c01cf41f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:06.023946 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a124817-778c-4640-a52d-48c01cf41f97 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:06.025399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a124817-778c-4640-a52d-48c01cf41f97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:06.028498 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a124817-778c-4640-a52d-48c01cf41f97 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:06.141242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1157/2339] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:33:05 2021] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:33:06.145729 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c1325-f63b-4370-b93c-90a2c46e69fe admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:06.158038 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c1325-f63b-4370-b93c-90a2c46e69fe admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:06.163060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857549f-2ffb-4f5c-90a3-5ea4a1255a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:06.163798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857549f-2ffb-4f5c-90a3-5ea4a1255a2f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:06.164084 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857549f-2ffb-4f5c-90a3-5ea4a1255a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:06.164361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857549f-2ffb-4f5c-90a3-5ea4a1255a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:06.165110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857549f-2ffb-4f5c-90a3-5ea4a1255a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:06.170643 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857549f-2ffb-4f5c-90a3-5ea4a1255a2f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:06.180848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1183/2340] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:06 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:33:06.185688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a124817-778c-4640-a52d-48c01cf41f97 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:06.198465 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a124817-778c-4640-a52d-48c01cf41f97 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:06.203907 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c561f8-3736-4633-9da6-fc8b2a336874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:06.204801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c561f8-3736-4633-9da6-fc8b2a336874 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:06.205259 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c561f8-3736-4633-9da6-fc8b2a336874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:06.205393 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c561f8-3736-4633-9da6-fc8b2a336874 admin admin] PATH_INFO: `/v3/projects/68b628d3b2b146fd85b38003a83081f6/users/de65666366ab471ba8bc301b9d1f06ac/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:06.222357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c561f8-3736-4633-9da6-fc8b2a336874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b628d3b2b146fd85b38003a83081f6, user_id=de65666366ab471ba8bc301b9d1f06ac, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:06.225080 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c561f8-3736-4633-9da6-fc8b2a336874 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:06.317626 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1158/2341] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:33:06 2021] PUT /identity/v3/projects/68b628d3b2b146fd85b38003a83081f6/users/de65666366ab471ba8bc301b9d1f06ac/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:06.323212 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857549f-2ffb-4f5c-90a3-5ea4a1255a2f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:06.334411 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857549f-2ffb-4f5c-90a3-5ea4a1255a2f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:06.394142 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d96b8-7126-4f2f-abdf-405cb1953e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:06.394814 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d96b8-7126-4f2f-abdf-405cb1953e01 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:06.395090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d96b8-7126-4f2f-abdf-405cb1953e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:06.395366 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d96b8-7126-4f2f-abdf-405cb1953e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:06.396216 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d96b8-7126-4f2f-abdf-405cb1953e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:06.397855 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d96b8-7126-4f2f-abdf-405cb1953e01 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:06.407709 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1184/2342] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:06 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:33:06.411859 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c561f8-3736-4633-9da6-fc8b2a336874 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:06.422527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c561f8-3736-4633-9da6-fc8b2a336874 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:06.427216 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38e8e3-ac71-48e7-88fa-e1c99d846f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:06.428133 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38e8e3-ac71-48e7-88fa-e1c99d846f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:06.428405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38e8e3-ac71-48e7-88fa-e1c99d846f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:06.428673 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38e8e3-ac71-48e7-88fa-e1c99d846f54 admin admin] PATH_INFO: `/v3/projects/68b628d3b2b146fd85b38003a83081f6/users/de65666366ab471ba8bc301b9d1f06ac/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:06.430638 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38e8e3-ac71-48e7-88fa-e1c99d846f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b628d3b2b146fd85b38003a83081f6, user_id=de65666366ab471ba8bc301b9d1f06ac, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:06.433854 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38e8e3-ac71-48e7-88fa-e1c99d846f54 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:06.444443 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1159/2343] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:33:06 2021] PUT /identity/v3/projects/68b628d3b2b146fd85b38003a83081f6/users/de65666366ab471ba8bc301b9d1f06ac/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:06.454727 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cb0c0-997d-4fba-a8b6-734250ef5520 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:06.455008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cb0c0-997d-4fba-a8b6-734250ef5520 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:06.455280 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cb0c0-997d-4fba-a8b6-734250ef5520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:06.483237 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-587cb0c0-997d-4fba-a8b6-734250ef5520 None None] MFA Rules not processed for user `de65666366ab471ba8bc301b9d1f06ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:06.484407 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-587cb0c0-997d-4fba-a8b6-734250ef5520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:06.566893 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1185/2344] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:06 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:06.578629 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38e8e3-ac71-48e7-88fa-e1c99d846f54 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:06.580641 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-fa38e8e3-ac71-48e7-88fa-e1c99d846f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:06.697350 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38e8e3-ac71-48e7-88fa-e1c99d846f54 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:06.705872 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b2129-aaa4-4b81-bbff-7c5dc5d0727c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:06.710984 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b2129-aaa4-4b81-bbff-7c5dc5d0727c service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:06.711270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b2129-aaa4-4b81-bbff-7c5dc5d0727c service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:06.711549 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b2129-aaa4-4b81-bbff-7c5dc5d0727c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:06.726202 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b2129-aaa4-4b81-bbff-7c5dc5d0727c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:06.728464 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b2129-aaa4-4b81-bbff-7c5dc5d0727c service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:06.747489 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1160/2345] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:33:06 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:33:06.818247 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cb0c0-997d-4fba-a8b6-734250ef5520 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:06.913330 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cb0c0-997d-4fba-a8b6-734250ef5520 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:06.920179 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b020c5f-12f5-4a00-bb31-949956a21cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:06.921428 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b020c5f-12f5-4a00-bb31-949956a21cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:06.921913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b020c5f-12f5-4a00-bb31-949956a21cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:06.922190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b020c5f-12f5-4a00-bb31-949956a21cf0 admin admin] PATH_INFO: `/v3/users/9680ad9ddeb74e35a281525c3f37f80c` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:06.923849 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b020c5f-12f5-4a00-bb31-949956a21cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9680ad9ddeb74e35a281525c3f37f80c)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:06.927570 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b020c5f-12f5-4a00-bb31-949956a21cf0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:07.223190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2b020c5f-12f5-4a00-bb31-949956a21cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9680ad9ddeb74e35a281525c3f37f80c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:07.224006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2b020c5f-12f5-4a00-bb31-949956a21cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9680ad9ddeb74e35a281525c3f37f80c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:07.237629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2b020c5f-12f5-4a00-bb31-949956a21cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9680ad9ddeb74e35a281525c3f37f80c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:07.259875 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2b020c5f-12f5-4a00-bb31-949956a21cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9680ad9ddeb74e35a281525c3f37f80c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:07.423934 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2b020c5f-12f5-4a00-bb31-949956a21cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9680ad9ddeb74e35a281525c3f37f80c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:07.430474 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1186/2346] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:33:06 2021] DELETE /identity/v3/users/9680ad9ddeb74e35a281525c3f37f80c => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:07.435854 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e362112-6897-4176-b318-3b3202f16153 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:07.436363 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e362112-6897-4176-b318-3b3202f16153 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:07.436458 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e362112-6897-4176-b318-3b3202f16153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:07.453714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-6e362112-6897-4176-b318-3b3202f16153 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:07.454905 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6e362112-6897-4176-b318-3b3202f16153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:07.512098 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1161/2347] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:07.522266 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b020c5f-12f5-4a00-bb31-949956a21cf0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:07.523707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-2b020c5f-12f5-4a00-bb31-949956a21cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:07.582725 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b020c5f-12f5-4a00-bb31-949956a21cf0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:07.586357 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b098b7-91ff-4e0b-84cb-54aecad62ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:07.587045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b098b7-91ff-4e0b-84cb-54aecad62ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:07.587877 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b098b7-91ff-4e0b-84cb-54aecad62ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:07.588564 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b098b7-91ff-4e0b-84cb-54aecad62ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:07.599197 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b098b7-91ff-4e0b-84cb-54aecad62ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:07.600624 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b098b7-91ff-4e0b-84cb-54aecad62ca5 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:07.612116 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1187/2348] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:33:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:33:08.404347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e362112-6897-4176-b318-3b3202f16153 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:08.406086 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6e362112-6897-4176-b318-3b3202f16153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:08.424247 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e362112-6897-4176-b318-3b3202f16153 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:08.430283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:08.431927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:08.431927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:08.432760 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] PATH_INFO: `/v3/projects/80b7052d7a294778845620bedec80494` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:08.434064 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b7052d7a294778845620bedec80494)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:08.439055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:08.555488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b7052d7a294778845620bedec80494', 'request_id': 'req-675d83c1-8ace-4451-94a5-47b9d745bae4'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:08.636150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b7052d7a294778845620bedec80494', 'request_id': 'req-675d83c1-8ace-4451-94a5-47b9d745bae4'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:08.646527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b7052d7a294778845620bedec80494', 'request_id': 'req-675d83c1-8ace-4451-94a5-47b9d745bae4'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:08.668189 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] The token cache is being invalidate because project 80b7052d7a294778845620bedec80494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:33:08.669445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:08.670160 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:08.672355 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1162/2349] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:33:08 2021] DELETE /identity/v3/projects/80b7052d7a294778845620bedec80494 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:08.676099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b098b7-91ff-4e0b-84cb-54aecad62ca5 service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:08.689590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b098b7-91ff-4e0b-84cb-54aecad62ca5 service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:08.765600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a56e4-3886-43af-b50d-86ef31a2f927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:08.766616 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a56e4-3886-43af-b50d-86ef31a2f927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:08.766939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a56e4-3886-43af-b50d-86ef31a2f927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:08.767255 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a56e4-3886-43af-b50d-86ef31a2f927 admin admin] PATH_INFO: `/v3/users/de65666366ab471ba8bc301b9d1f06ac` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:08.768640 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a56e4-3886-43af-b50d-86ef31a2f927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de65666366ab471ba8bc301b9d1f06ac)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:08.771149 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a56e4-3886-43af-b50d-86ef31a2f927 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:09.001754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ba2a56e4-3886-43af-b50d-86ef31a2f927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de65666366ab471ba8bc301b9d1f06ac'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:09.002769 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ba2a56e4-3886-43af-b50d-86ef31a2f927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de65666366ab471ba8bc301b9d1f06ac'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:09.028778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ba2a56e4-3886-43af-b50d-86ef31a2f927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de65666366ab471ba8bc301b9d1f06ac'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:09.040364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ba2a56e4-3886-43af-b50d-86ef31a2f927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de65666366ab471ba8bc301b9d1f06ac'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:09.136903 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ba2a56e4-3886-43af-b50d-86ef31a2f927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de65666366ab471ba8bc301b9d1f06ac'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:09.152081 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1188/2350] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:33:08 2021] DELETE /identity/v3/users/de65666366ab471ba8bc301b9d1f06ac => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:09.917683 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:09.919694 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:09.951072 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d83c1-8ace-4451-94a5-47b9d745bae4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:10.055604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc5cac-562e-49f4-9c3a-798a96cafef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:10.056650 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc5cac-562e-49f4-9c3a-798a96cafef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:10.057179 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc5cac-562e-49f4-9c3a-798a96cafef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:10.057466 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc5cac-562e-49f4-9c3a-798a96cafef2 admin admin] PATH_INFO: `/v3/projects/68b628d3b2b146fd85b38003a83081f6` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:10.059252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc5cac-562e-49f4-9c3a-798a96cafef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b628d3b2b146fd85b38003a83081f6)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:10.061190 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc5cac-562e-49f4-9c3a-798a96cafef2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:10.216052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-10bc5cac-562e-49f4-9c3a-798a96cafef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b628d3b2b146fd85b38003a83081f6', 'request_id': 'req-10bc5cac-562e-49f4-9c3a-798a96cafef2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:10.271903 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25113908-d9c1-4aa5-8647-35e82b5ddb3c None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:10.272422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25113908-d9c1-4aa5-8647-35e82b5ddb3c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:10.272522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25113908-d9c1-4aa5-8647-35e82b5ddb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:10.302234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-25113908-d9c1-4aa5-8647-35e82b5ddb3c None None] MFA Rules not processed for user `bef8571ef39b4efe8f510a28052e2b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:10.303417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-25113908-d9c1-4aa5-8647-35e82b5ddb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:10.339838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-10bc5cac-562e-49f4-9c3a-798a96cafef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b628d3b2b146fd85b38003a83081f6', 'request_id': 'req-10bc5cac-562e-49f4-9c3a-798a96cafef2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:10.348296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-10bc5cac-562e-49f4-9c3a-798a96cafef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b628d3b2b146fd85b38003a83081f6', 'request_id': 'req-10bc5cac-562e-49f4-9c3a-798a96cafef2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:10.360903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-10bc5cac-562e-49f4-9c3a-798a96cafef2 admin admin] The token cache is being invalidate because project 68b628d3b2b146fd85b38003a83081f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:33:10.363952 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-10bc5cac-562e-49f4-9c3a-798a96cafef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:10.364684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-10bc5cac-562e-49f4-9c3a-798a96cafef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:10.366411 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1163/2351] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:33:09 2021] DELETE /identity/v3/projects/68b628d3b2b146fd85b38003a83081f6 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:10.371997 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d310d2-52b6-4fae-a722-6679aa102068 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:10.372286 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d310d2-52b6-4fae-a722-6679aa102068 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:10.372702 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d310d2-52b6-4fae-a722-6679aa102068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:10.385621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1189/2352] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:10 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:33:10.387127 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25113908-d9c1-4aa5-8647-35e82b5ddb3c None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:10.388730 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-25113908-d9c1-4aa5-8647-35e82b5ddb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:10.397210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-c8d310d2-52b6-4fae-a722-6679aa102068 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:10.398401 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c8d310d2-52b6-4fae-a722-6679aa102068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:10.466030 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1164/2353] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:33:10.466237 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25113908-d9c1-4aa5-8647-35e82b5ddb3c None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:10.472843 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f40b4-0ffb-4e0e-87e5-ccafe9c23795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:10.473623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f40b4-0ffb-4e0e-87e5-ccafe9c23795 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:10.473768 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff481fb3-2ca0-4388-acf8-67eef0263640 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:10.474051 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff481fb3-2ca0-4388-acf8-67eef0263640 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:10.474154 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f40b4-0ffb-4e0e-87e5-ccafe9c23795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:10.474321 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff481fb3-2ca0-4388-acf8-67eef0263640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:10.474575 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f40b4-0ffb-4e0e-87e5-ccafe9c23795 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:10.475719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f40b4-0ffb-4e0e-87e5-ccafe9c23795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:10.481477 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f40b4-0ffb-4e0e-87e5-ccafe9c23795 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:10.494265 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ff481fb3-2ca0-4388-acf8-67eef0263640 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:10.495504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ff481fb3-2ca0-4388-acf8-67eef0263640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:10.504449 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1165/2354] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:33:10.508653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff481fb3-2ca0-4388-acf8-67eef0263640 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:10.519162 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff481fb3-2ca0-4388-acf8-67eef0263640 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:10.524145 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7d441-87f9-421b-b41e-282b08cb9ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:10.524938 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7d441-87f9-421b-b41e-282b08cb9ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:10.525311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7d441-87f9-421b-b41e-282b08cb9ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:10.525549 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7d441-87f9-421b-b41e-282b08cb9ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:10.526323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7d441-87f9-421b-b41e-282b08cb9ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:33:10.526624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7d441-87f9-421b-b41e-282b08cb9ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:10.528385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7d441-87f9-421b-b41e-282b08cb9ff7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:10.545581 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1166/2355] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:33:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:33:10.549786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7d441-87f9-421b-b41e-282b08cb9ff7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:10.561673 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7d441-87f9-421b-b41e-282b08cb9ff7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:10.566480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2503c-3555-40aa-b9e5-545a9dcde409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:10.567126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2503c-3555-40aa-b9e5-545a9dcde409 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:10.567441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2503c-3555-40aa-b9e5-545a9dcde409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:10.567715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2503c-3555-40aa-b9e5-545a9dcde409 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:10.568520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2503c-3555-40aa-b9e5-545a9dcde409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:10.570432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2503c-3555-40aa-b9e5-545a9dcde409 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:10.638341 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1190/2356] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:33:10 2021] POST /identity/v3/projects => generated 377 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:33:10.646745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f40b4-0ffb-4e0e-87e5-ccafe9c23795 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:10.740343 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1167/2357] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:33:10 2021] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:33:10.745244 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2503c-3555-40aa-b9e5-545a9dcde409 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:10.745960 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f40b4-0ffb-4e0e-87e5-ccafe9c23795 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:10.872248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceff8e8-8f43-4238-86c6-d93f7311c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:10.873479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff8e8-8f43-4238-86c6-d93f7311c58f admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:10.874040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff8e8-8f43-4238-86c6-d93f7311c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:10.874911 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff8e8-8f43-4238-86c6-d93f7311c58f admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:10.875135 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceff8e8-8f43-4238-86c6-d93f7311c58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:10.877231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceff8e8-8f43-4238-86c6-d93f7311c58f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:10.904752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2503c-3555-40aa-b9e5-545a9dcde409 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:10.912752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff2e7a-24a4-44ac-84b5-123cd6dd34b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:10.913499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff2e7a-24a4-44ac-84b5-123cd6dd34b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:10.914089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff2e7a-24a4-44ac-84b5-123cd6dd34b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:10.914377 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff2e7a-24a4-44ac-84b5-123cd6dd34b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:10.919049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff2e7a-24a4-44ac-84b5-123cd6dd34b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:10.926176 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff2e7a-24a4-44ac-84b5-123cd6dd34b4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:10.949979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1191/2358] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:33:10 2021] POST /identity/v3/users => generated 295 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:33:10.954846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceff8e8-8f43-4238-86c6-d93f7311c58f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:10.965446 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceff8e8-8f43-4238-86c6-d93f7311c58f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:10.972126 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086be24b-2901-41db-897b-d7c0097a08a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:10.972818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086be24b-2901-41db-897b-d7c0097a08a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:10.973127 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086be24b-2901-41db-897b-d7c0097a08a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:10.973401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086be24b-2901-41db-897b-d7c0097a08a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:10.974145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086be24b-2901-41db-897b-d7c0097a08a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:10.975776 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086be24b-2901-41db-897b-d7c0097a08a8 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:10.987962 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1192/2359] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:10 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:33:10.993228 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086be24b-2901-41db-897b-d7c0097a08a8 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:11.004747 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086be24b-2901-41db-897b-d7c0097a08a8 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:11.012439 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05118dc-4bc1-4f7c-bba5-ca81e08fb740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:11.013598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05118dc-4bc1-4f7c-bba5-ca81e08fb740 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:11.014024 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05118dc-4bc1-4f7c-bba5-ca81e08fb740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:11.014414 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05118dc-4bc1-4f7c-bba5-ca81e08fb740 admin admin] PATH_INFO: `/v3/projects/48c40f6100194f228f40303a3fad55f2/users/c8041d5029ae4ceabb1aa9dc761f0dd6/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:11.041011 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1168/2360] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:33:10 2021] POST /identity/v3/users => generated 294 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:33:11.042851 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff2e7a-24a4-44ac-84b5-123cd6dd34b4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:11.059770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff2e7a-24a4-44ac-84b5-123cd6dd34b4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:11.061456 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05118dc-4bc1-4f7c-bba5-ca81e08fb740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c40f6100194f228f40303a3fad55f2, user_id=c8041d5029ae4ceabb1aa9dc761f0dd6, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:11.065674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ba8e4-a056-48ab-812d-0d348a26ae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:11.066635 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ba8e4-a056-48ab-812d-0d348a26ae99 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:11.067279 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ba8e4-a056-48ab-812d-0d348a26ae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:11.067792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ba8e4-a056-48ab-812d-0d348a26ae99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:11.068820 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ba8e4-a056-48ab-812d-0d348a26ae99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:11.068952 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05118dc-4bc1-4f7c-bba5-ca81e08fb740 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:11.070873 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ba8e4-a056-48ab-812d-0d348a26ae99 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:11.084083 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1169/2361] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:11 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:33:11.089749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ba8e4-a056-48ab-812d-0d348a26ae99 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:11.100217 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ba8e4-a056-48ab-812d-0d348a26ae99 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:11.106726 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7be717-e9bd-4b46-8966-2da492bccff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:11.107576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7be717-e9bd-4b46-8966-2da492bccff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:11.107842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7be717-e9bd-4b46-8966-2da492bccff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:11.109884 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7be717-e9bd-4b46-8966-2da492bccff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:11.109884 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7be717-e9bd-4b46-8966-2da492bccff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:11.111170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7be717-e9bd-4b46-8966-2da492bccff7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:11.123217 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1170/2362] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:11 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:33:11.127477 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7be717-e9bd-4b46-8966-2da492bccff7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:11.139683 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7be717-e9bd-4b46-8966-2da492bccff7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:11.148739 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ce633-f896-48b9-b1fb-3192462f64cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:11.149969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ce633-f896-48b9-b1fb-3192462f64cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:11.150684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ce633-f896-48b9-b1fb-3192462f64cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:11.150684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ce633-f896-48b9-b1fb-3192462f64cd admin admin] PATH_INFO: `/v3/projects/3c3afebb835140d09afbe04f5be8c6f1/users/46eecadc0fe34d82950e8800ad4396c7/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:11.170767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ce633-f896-48b9-b1fb-3192462f64cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c3afebb835140d09afbe04f5be8c6f1, user_id=46eecadc0fe34d82950e8800ad4396c7, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:11.173746 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ce633-f896-48b9-b1fb-3192462f64cd admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:11.191356 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1193/2363] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:33:10 2021] PUT /identity/v3/projects/48c40f6100194f228f40303a3fad55f2/users/c8041d5029ae4ceabb1aa9dc761f0dd6/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:11.195783 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05118dc-4bc1-4f7c-bba5-ca81e08fb740 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:11.253223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1171/2364] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:33:11 2021] PUT /identity/v3/projects/3c3afebb835140d09afbe04f5be8c6f1/users/46eecadc0fe34d82950e8800ad4396c7/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:11.265022 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb82711-9152-41fa-85b3-611e9c914981 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:11.265299 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb82711-9152-41fa-85b3-611e9c914981 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:11.265788 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb82711-9152-41fa-85b3-611e9c914981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:11.276311 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05118dc-4bc1-4f7c-bba5-ca81e08fb740 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:11.294491 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-9fb82711-9152-41fa-85b3-611e9c914981 None None] MFA Rules not processed for user `46eecadc0fe34d82950e8800ad4396c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:11.296359 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9fb82711-9152-41fa-85b3-611e9c914981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:11.366030 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6babcc-dd17-41a5-bd0d-3887cd45f924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:11.366719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6babcc-dd17-41a5-bd0d-3887cd45f924 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:11.370215 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1172/2365] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:11 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:33:11.370393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6babcc-dd17-41a5-bd0d-3887cd45f924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:11.370393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6babcc-dd17-41a5-bd0d-3887cd45f924 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:11.370393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6babcc-dd17-41a5-bd0d-3887cd45f924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:11.370675 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6babcc-dd17-41a5-bd0d-3887cd45f924 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:11.372108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb82711-9152-41fa-85b3-611e9c914981 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:11.385602 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1194/2366] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:11 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:33:11.386303 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb82711-9152-41fa-85b3-611e9c914981 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:11.386763 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6babcc-dd17-41a5-bd0d-3887cd45f924 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:11.390965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20049d52-1299-4bd4-b44c-e1c3d85573ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:11.391814 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20049d52-1299-4bd4-b44c-e1c3d85573ec admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:11.392090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20049d52-1299-4bd4-b44c-e1c3d85573ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:11.392556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20049d52-1299-4bd4-b44c-e1c3d85573ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:11.393077 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20049d52-1299-4bd4-b44c-e1c3d85573ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:11.395206 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20049d52-1299-4bd4-b44c-e1c3d85573ec admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:11.398173 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6babcc-dd17-41a5-bd0d-3887cd45f924 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:11.405243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24845c6-c999-4187-ad56-9b806ddf8a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:11.406234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24845c6-c999-4187-ad56-9b806ddf8a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:11.406604 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24845c6-c999-4187-ad56-9b806ddf8a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:11.406924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24845c6-c999-4187-ad56-9b806ddf8a0f admin admin] PATH_INFO: `/v3/projects/48c40f6100194f228f40303a3fad55f2/users/c8041d5029ae4ceabb1aa9dc761f0dd6/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:11.409054 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24845c6-c999-4187-ad56-9b806ddf8a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c40f6100194f228f40303a3fad55f2, user_id=c8041d5029ae4ceabb1aa9dc761f0dd6, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:11.411833 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24845c6-c999-4187-ad56-9b806ddf8a0f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:11.430528 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1195/2367] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:33:11 2021] PUT /identity/v3/projects/48c40f6100194f228f40303a3fad55f2/users/c8041d5029ae4ceabb1aa9dc761f0dd6/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:11.497705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1173/2368] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:33:11 2021] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:33:11.498786 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24845c6-c999-4187-ad56-9b806ddf8a0f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:11.567912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24845c6-c999-4187-ad56-9b806ddf8a0f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:11.641159 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641fcd4-3b9b-4fbf-9df4-aefdfba5f521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:11.641682 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641fcd4-3b9b-4fbf-9df4-aefdfba5f521 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:11.642060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641fcd4-3b9b-4fbf-9df4-aefdfba5f521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:11.642436 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641fcd4-3b9b-4fbf-9df4-aefdfba5f521 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:11.643248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641fcd4-3b9b-4fbf-9df4-aefdfba5f521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:11.645441 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641fcd4-3b9b-4fbf-9df4-aefdfba5f521 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:11.745194 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1196/2369] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:33:11 2021] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:33:11.749325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20049d52-1299-4bd4-b44c-e1c3d85573ec admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:11.759585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20049d52-1299-4bd4-b44c-e1c3d85573ec admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:11.764334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af527811-ffc9-408b-954e-80304173a551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:11.765012 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af527811-ffc9-408b-954e-80304173a551 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:11.765355 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af527811-ffc9-408b-954e-80304173a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:11.765622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af527811-ffc9-408b-954e-80304173a551 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:11.766385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af527811-ffc9-408b-954e-80304173a551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:11.768027 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af527811-ffc9-408b-954e-80304173a551 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:11.782973 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1174/2370] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:11 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:33:11.787878 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641fcd4-3b9b-4fbf-9df4-aefdfba5f521 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:11.799853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641fcd4-3b9b-4fbf-9df4-aefdfba5f521 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:11.805191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d15c7-6af1-494f-81ea-3362a5646d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:11.806993 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d15c7-6af1-494f-81ea-3362a5646d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:11.807346 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d15c7-6af1-494f-81ea-3362a5646d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:11.807889 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d15c7-6af1-494f-81ea-3362a5646d72 admin admin] PATH_INFO: `/v3/projects/3ae86202da664d78baf4bb688e9ec3ec/users/4e6e6e3f95b34d869e11f147444b2cfd/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:11.828945 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d15c7-6af1-494f-81ea-3362a5646d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae86202da664d78baf4bb688e9ec3ec, user_id=4e6e6e3f95b34d869e11f147444b2cfd, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:11.834238 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d15c7-6af1-494f-81ea-3362a5646d72 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:11.926805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1197/2371] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:33:11 2021] PUT /identity/v3/projects/3ae86202da664d78baf4bb688e9ec3ec/users/4e6e6e3f95b34d869e11f147444b2cfd/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:11.930775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af527811-ffc9-408b-954e-80304173a551 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:11.941367 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af527811-ffc9-408b-954e-80304173a551 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:11.998927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbc170-93dc-4089-9065-28bfdaa51ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:11.999690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbc170-93dc-4089-9065-28bfdaa51ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:11.999958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbc170-93dc-4089-9065-28bfdaa51ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:12.000228 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbc170-93dc-4089-9065-28bfdaa51ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:12.000966 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbc170-93dc-4089-9065-28bfdaa51ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:12.002531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbc170-93dc-4089-9065-28bfdaa51ea0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:12.015945 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1175/2372] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:11 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:33:12.023592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d15c7-6af1-494f-81ea-3362a5646d72 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:12.029923 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d15c7-6af1-494f-81ea-3362a5646d72 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:12.036100 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086413a4-fcc4-477e-a2f9-d6f9edd927f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:12.037107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086413a4-fcc4-477e-a2f9-d6f9edd927f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:12.038175 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086413a4-fcc4-477e-a2f9-d6f9edd927f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:12.038531 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086413a4-fcc4-477e-a2f9-d6f9edd927f1 admin admin] PATH_INFO: `/v3/projects/3ae86202da664d78baf4bb688e9ec3ec/users/4e6e6e3f95b34d869e11f147444b2cfd/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:12.043597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086413a4-fcc4-477e-a2f9-d6f9edd927f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae86202da664d78baf4bb688e9ec3ec, user_id=4e6e6e3f95b34d869e11f147444b2cfd, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:12.046639 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086413a4-fcc4-477e-a2f9-d6f9edd927f1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:12.080145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1198/2373] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:33:12 2021] PUT /identity/v3/projects/3ae86202da664d78baf4bb688e9ec3ec/users/4e6e6e3f95b34d869e11f147444b2cfd/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:33:12.091684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac4b4b-16b2-47a7-b245-73a4294a208e None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:12.092271 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac4b4b-16b2-47a7-b245-73a4294a208e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:12.092864 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac4b4b-16b2-47a7-b245-73a4294a208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:12.138609 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-6cac4b4b-16b2-47a7-b245-73a4294a208e None None] MFA Rules not processed for user `4e6e6e3f95b34d869e11f147444b2cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:12.142805 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6cac4b4b-16b2-47a7-b245-73a4294a208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:12.232521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1176/2374] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:12 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:33:12.242549 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086413a4-fcc4-477e-a2f9-d6f9edd927f1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:12.245220 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-086413a4-fcc4-477e-a2f9-d6f9edd927f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:12.306946 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086413a4-fcc4-477e-a2f9-d6f9edd927f1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:12.311409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e8902-39ab-454a-8bc9-3516a360f643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:12.312402 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e8902-39ab-454a-8bc9-3516a360f643 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:12.312821 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e8902-39ab-454a-8bc9-3516a360f643 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:12.313219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e8902-39ab-454a-8bc9-3516a360f643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:12.334856 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e8902-39ab-454a-8bc9-3516a360f643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:12.336375 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e8902-39ab-454a-8bc9-3516a360f643 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:12.350359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1199/2375] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:33:12 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:33:13.896875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac4b4b-16b2-47a7-b245-73a4294a208e None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:13.996749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac4b4b-16b2-47a7-b245-73a4294a208e None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:14.001658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7695f-da6d-4e93-8eec-b96b6258989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:14.002520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7695f-da6d-4e93-8eec-b96b6258989c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:14.002849 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7695f-da6d-4e93-8eec-b96b6258989c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:14.003120 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7695f-da6d-4e93-8eec-b96b6258989c admin admin] PATH_INFO: `/v3/users/46eecadc0fe34d82950e8800ad4396c7` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:14.004378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7695f-da6d-4e93-8eec-b96b6258989c admin admin] RBAC: Authorizing `identity:delete_user(user_id=46eecadc0fe34d82950e8800ad4396c7)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:14.006315 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7695f-da6d-4e93-8eec-b96b6258989c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:14.243260 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-24c7695f-da6d-4e93-8eec-b96b6258989c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46eecadc0fe34d82950e8800ad4396c7'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:14.251567 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-24c7695f-da6d-4e93-8eec-b96b6258989c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46eecadc0fe34d82950e8800ad4396c7'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:14.252455 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-24c7695f-da6d-4e93-8eec-b96b6258989c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46eecadc0fe34d82950e8800ad4396c7'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:14.266249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-24c7695f-da6d-4e93-8eec-b96b6258989c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46eecadc0fe34d82950e8800ad4396c7'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:14.349209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-24c7695f-da6d-4e93-8eec-b96b6258989c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46eecadc0fe34d82950e8800ad4396c7'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:14.360738 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1177/2376] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:33:13 2021] DELETE /identity/v3/users/46eecadc0fe34d82950e8800ad4396c7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:14.361564 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0f5f9-b0f5-4954-9aea-aa21240c2c67 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:14.362041 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0f5f9-b0f5-4954-9aea-aa21240c2c67 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:14.362153 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0f5f9-b0f5-4954-9aea-aa21240c2c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:14.383479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-01e0f5f9-b0f5-4954-9aea-aa21240c2c67 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:14.386854 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-01e0f5f9-b0f5-4954-9aea-aa21240c2c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:14.457310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1200/2377] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:33:14.467337 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7695f-da6d-4e93-8eec-b96b6258989c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:14.468951 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-24c7695f-da6d-4e93-8eec-b96b6258989c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:14.525707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7695f-da6d-4e93-8eec-b96b6258989c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:14.529898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51400d-f67b-45d5-afde-f309e5b684b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:14.531002 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51400d-f67b-45d5-afde-f309e5b684b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:14.531290 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51400d-f67b-45d5-afde-f309e5b684b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:14.531569 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51400d-f67b-45d5-afde-f309e5b684b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:14.541529 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51400d-f67b-45d5-afde-f309e5b684b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:14.542963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51400d-f67b-45d5-afde-f309e5b684b9 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:14.553451 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1178/2378] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:33:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:33:15.226962 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0f5f9-b0f5-4954-9aea-aa21240c2c67 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:15.228811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-01e0f5f9-b0f5-4954-9aea-aa21240c2c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:15.262101 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0f5f9-b0f5-4954-9aea-aa21240c2c67 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:15.267029 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:15.268234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:15.268585 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:15.269207 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] PATH_INFO: `/v3/projects/3c3afebb835140d09afbe04f5be8c6f1` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:15.270517 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c3afebb835140d09afbe04f5be8c6f1)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:15.273064 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:15.422165 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c3afebb835140d09afbe04f5be8c6f1', 'request_id': 'req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:15.521081 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c3afebb835140d09afbe04f5be8c6f1', 'request_id': 'req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:15.529578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c3afebb835140d09afbe04f5be8c6f1', 'request_id': 'req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:15.544722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] The token cache is being invalidate because project 3c3afebb835140d09afbe04f5be8c6f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:33:15.545264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:15.545991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:15.548383 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1201/2379] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:33:15 2021] DELETE /identity/v3/projects/3c3afebb835140d09afbe04f5be8c6f1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:15.551703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51400d-f67b-45d5-afde-f309e5b684b9 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:15.564041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51400d-f67b-45d5-afde-f309e5b684b9 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:15.633181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8a3d9-191f-425c-9b11-25a404ef8d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:15.637142 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8a3d9-191f-425c-9b11-25a404ef8d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:15.637480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8a3d9-191f-425c-9b11-25a404ef8d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:15.637700 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8a3d9-191f-425c-9b11-25a404ef8d69 admin admin] PATH_INFO: `/v3/users/4e6e6e3f95b34d869e11f147444b2cfd` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:15.639294 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8a3d9-191f-425c-9b11-25a404ef8d69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e6e6e3f95b34d869e11f147444b2cfd)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:15.641257 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8a3d9-191f-425c-9b11-25a404ef8d69 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:15.885602 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-91b8a3d9-191f-425c-9b11-25a404ef8d69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6e6e3f95b34d869e11f147444b2cfd'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:15.913351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-91b8a3d9-191f-425c-9b11-25a404ef8d69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6e6e3f95b34d869e11f147444b2cfd'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:15.913351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-91b8a3d9-191f-425c-9b11-25a404ef8d69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6e6e3f95b34d869e11f147444b2cfd'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:15.913351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-91b8a3d9-191f-425c-9b11-25a404ef8d69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6e6e3f95b34d869e11f147444b2cfd'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:16.001002 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-91b8a3d9-191f-425c-9b11-25a404ef8d69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6e6e3f95b34d869e11f147444b2cfd'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:16.008105 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1179/2380] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:33:15 2021] DELETE /identity/v3/users/4e6e6e3f95b34d869e11f147444b2cfd => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:16.615342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:16.617430 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:16.642811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d2e86-7a87-4bd4-b65f-c9ad4d22434e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:16.744554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:16.744554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:16.744554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:16.744554 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3 admin admin] PATH_INFO: `/v3/projects/3ae86202da664d78baf4bb688e9ec3ec` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:16.745069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae86202da664d78baf4bb688e9ec3ec)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:16.746342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:16.936256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae86202da664d78baf4bb688e9ec3ec', 'request_id': 'req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:17.028039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae86202da664d78baf4bb688e9ec3ec', 'request_id': 'req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:17.042661 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae86202da664d78baf4bb688e9ec3ec', 'request_id': 'req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:17.067853 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3 admin admin] The token cache is being invalidate because project 3ae86202da664d78baf4bb688e9ec3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:33:17.068445 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:17.069326 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cf2863b0-5170-452f-8d54-ee4b3edbb2d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:17.071874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1202/2381] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:33:16 2021] DELETE /identity/v3/projects/3ae86202da664d78baf4bb688e9ec3ec => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:17.078628 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1145b9d-d533-46ba-8b57-ea57b1f56259 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:17.079188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1145b9d-d533-46ba-8b57-ea57b1f56259 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:17.079807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1145b9d-d533-46ba-8b57-ea57b1f56259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:17.103480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-b1145b9d-d533-46ba-8b57-ea57b1f56259 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:17.105042 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b1145b9d-d533-46ba-8b57-ea57b1f56259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:17.175455 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1180/2382] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:17.186081 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daf029-d970-4188-8bde-b01d976a599b None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:17.186371 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daf029-d970-4188-8bde-b01d976a599b None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:17.186983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daf029-d970-4188-8bde-b01d976a599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:17.208526 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-e3daf029-d970-4188-8bde-b01d976a599b None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:17.209962 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e3daf029-d970-4188-8bde-b01d976a599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:17.219598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1203/2383] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:17.224793 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1145b9d-d533-46ba-8b57-ea57b1f56259 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:17.242100 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1145b9d-d533-46ba-8b57-ea57b1f56259 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:17.252377 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f0218-3d68-44f4-bc8e-7df961f80267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:17.255676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f0218-3d68-44f4-bc8e-7df961f80267 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:17.257005 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f0218-3d68-44f4-bc8e-7df961f80267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:17.257392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f0218-3d68-44f4-bc8e-7df961f80267 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:17.258716 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f0218-3d68-44f4-bc8e-7df961f80267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:33:17.259718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f0218-3d68-44f4-bc8e-7df961f80267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:17.262028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f0218-3d68-44f4-bc8e-7df961f80267 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:17.285032 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1181/2384] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:33:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:33:17.287412 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3daf029-d970-4188-8bde-b01d976a599b None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:17.305257 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3daf029-d970-4188-8bde-b01d976a599b None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:17.312869 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af079e25-b9c2-4dc0-9cba-f5bdc198664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:17.313863 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af079e25-b9c2-4dc0-9cba-f5bdc198664d admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:17.314368 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af079e25-b9c2-4dc0-9cba-f5bdc198664d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:17.314839 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af079e25-b9c2-4dc0-9cba-f5bdc198664d admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:17.315897 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af079e25-b9c2-4dc0-9cba-f5bdc198664d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:17.318156 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af079e25-b9c2-4dc0-9cba-f5bdc198664d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:17.453852 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1204/2385] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:33:17 2021] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:33:17.457707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f0218-3d68-44f4-bc8e-7df961f80267 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:17.467832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f0218-3d68-44f4-bc8e-7df961f80267 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:17.526005 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a745c-042d-4fe9-9a99-c7d26df29b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:17.526828 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a745c-042d-4fe9-9a99-c7d26df29b10 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:17.527368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a745c-042d-4fe9-9a99-c7d26df29b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:17.527849 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a745c-042d-4fe9-9a99-c7d26df29b10 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:17.528567 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a745c-042d-4fe9-9a99-c7d26df29b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:17.530463 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a745c-042d-4fe9-9a99-c7d26df29b10 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:17.631012 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1182/2386] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:33:17 2021] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:33:17.636576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af079e25-b9c2-4dc0-9cba-f5bdc198664d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:17.648771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af079e25-b9c2-4dc0-9cba-f5bdc198664d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:17.663152 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadf69b-5775-4f96-9f5c-8def14e2213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:17.663880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf69b-5775-4f96-9f5c-8def14e2213c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:17.664186 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf69b-5775-4f96-9f5c-8def14e2213c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:17.664462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf69b-5775-4f96-9f5c-8def14e2213c admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:17.665809 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadf69b-5775-4f96-9f5c-8def14e2213c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:17.668529 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadf69b-5775-4f96-9f5c-8def14e2213c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:17.683860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1205/2387] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:17 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:33:17.689582 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a745c-042d-4fe9-9a99-c7d26df29b10 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:17.701432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a745c-042d-4fe9-9a99-c7d26df29b10 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:17.708481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87c567-c931-42a2-9d12-766a6f3c1901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:17.709515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87c567-c931-42a2-9d12-766a6f3c1901 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:17.710021 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87c567-c931-42a2-9d12-766a6f3c1901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:17.710656 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87c567-c931-42a2-9d12-766a6f3c1901 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:17.713380 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87c567-c931-42a2-9d12-766a6f3c1901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:17.716090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87c567-c931-42a2-9d12-766a6f3c1901 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:17.735900 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1183/2388] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:17 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:33:17.739876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadf69b-5775-4f96-9f5c-8def14e2213c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:17.751838 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadf69b-5775-4f96-9f5c-8def14e2213c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:17.761896 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64815b5-c2d4-4b78-af77-1406fad086d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:17.762810 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64815b5-c2d4-4b78-af77-1406fad086d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:17.763273 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64815b5-c2d4-4b78-af77-1406fad086d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:17.763828 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64815b5-c2d4-4b78-af77-1406fad086d1 admin admin] PATH_INFO: `/v3/projects/cf2b31c286fc4f6fafd66bac6666eebe/users/75a8e9655ae84051952d963da2c6f45d/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:17.787033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64815b5-c2d4-4b78-af77-1406fad086d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2b31c286fc4f6fafd66bac6666eebe, user_id=75a8e9655ae84051952d963da2c6f45d, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:17.790744 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64815b5-c2d4-4b78-af77-1406fad086d1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:17.905260 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1206/2389] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:33:17 2021] PUT /identity/v3/projects/cf2b31c286fc4f6fafd66bac6666eebe/users/75a8e9655ae84051952d963da2c6f45d/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:17.915970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cc350-3661-4ab6-9a2f-3efff8a2f608 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:17.916752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cc350-3661-4ab6-9a2f-3efff8a2f608 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:17.916860 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cc350-3661-4ab6-9a2f-3efff8a2f608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:17.947348 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-9f4cc350-3661-4ab6-9a2f-3efff8a2f608 None None] MFA Rules not processed for user `75a8e9655ae84051952d963da2c6f45d`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:17.948734 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9f4cc350-3661-4ab6-9a2f-3efff8a2f608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:18.010127 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3444bd8-faa1-4230-8877-ca8e67cfd713 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:18.010469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3444bd8-faa1-4230-8877-ca8e67cfd713 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:18.010703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3444bd8-faa1-4230-8877-ca8e67cfd713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:18.030373 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1184/2390] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:17 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:18.041246 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cc350-3661-4ab6-9a2f-3efff8a2f608 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:18.043599 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9f4cc350-3661-4ab6-9a2f-3efff8a2f608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:18.053389 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-e3444bd8-faa1-4230-8877-ca8e67cfd713 None None] MFA Rules not processed for user `c8041d5029ae4ceabb1aa9dc761f0dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:18.055393 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e3444bd8-faa1-4230-8877-ca8e67cfd713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:18.130097 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cc350-3661-4ab6-9a2f-3efff8a2f608 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:18.135276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f9e98-7f49-4041-92f4-6bff27d93d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:18.136050 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f9e98-7f49-4041-92f4-6bff27d93d5b service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:18.136437 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f9e98-7f49-4041-92f4-6bff27d93d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:18.136801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f9e98-7f49-4041-92f4-6bff27d93d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:18.137791 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1207/2391] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:18 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:18.151963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3444bd8-faa1-4230-8877-ca8e67cfd713 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:18.152735 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f9e98-7f49-4041-92f4-6bff27d93d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:18.153590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e3444bd8-faa1-4230-8877-ca8e67cfd713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:18.154199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f9e98-7f49-4041-92f4-6bff27d93d5b service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:18.167180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1185/2392] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:33:18 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:33:18.198131 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f9e98-7f49-4041-92f4-6bff27d93d5b service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:18.245938 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3444bd8-faa1-4230-8877-ca8e67cfd713 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:18.251493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c89ca-8ed8-47ea-9439-0604d83ac53f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:18.252185 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c89ca-8ed8-47ea-9439-0604d83ac53f service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:18.252469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c89ca-8ed8-47ea-9439-0604d83ac53f service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:18.252749 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c89ca-8ed8-47ea-9439-0604d83ac53f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:18.254691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3f0c89ca-8ed8-47ea-9439-0604d83ac53f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:18.269985 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f9e98-7f49-4041-92f4-6bff27d93d5b service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:18.283559 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268a104-de98-4693-afc0-3b48569d0682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:18.284498 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268a104-de98-4693-afc0-3b48569d0682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:18.284782 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268a104-de98-4693-afc0-3b48569d0682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:18.285171 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268a104-de98-4693-afc0-3b48569d0682 admin admin] PATH_INFO: `/v3/users/75a8e9655ae84051952d963da2c6f45d` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:18.287184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268a104-de98-4693-afc0-3b48569d0682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a8e9655ae84051952d963da2c6f45d)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:18.289130 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268a104-de98-4693-afc0-3b48569d0682 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:18.340404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c89ca-8ed8-47ea-9439-0604d83ac53f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:18.342048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c89ca-8ed8-47ea-9439-0604d83ac53f service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:18.352083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1208/2393] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:33:18 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:33:18.529207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a268a104-de98-4693-afc0-3b48569d0682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a8e9655ae84051952d963da2c6f45d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:18.536209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a268a104-de98-4693-afc0-3b48569d0682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a8e9655ae84051952d963da2c6f45d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:18.536798 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a268a104-de98-4693-afc0-3b48569d0682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a8e9655ae84051952d963da2c6f45d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:18.548882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a268a104-de98-4693-afc0-3b48569d0682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a8e9655ae84051952d963da2c6f45d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:18.625100 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a268a104-de98-4693-afc0-3b48569d0682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a8e9655ae84051952d963da2c6f45d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:18.633357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1186/2394] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:33:18 2021] DELETE /identity/v3/users/75a8e9655ae84051952d963da2c6f45d => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:33:18.639865 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53acce7-4493-472d-a41f-bcf4e5aaad0f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:18.640555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53acce7-4493-472d-a41f-bcf4e5aaad0f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:18.640935 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53acce7-4493-472d-a41f-bcf4e5aaad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:18.661663 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-f53acce7-4493-472d-a41f-bcf4e5aaad0f None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:18.662862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-f53acce7-4493-472d-a41f-bcf4e5aaad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:18.743086 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1209/2395] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:18.755962 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268a104-de98-4693-afc0-3b48569d0682 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:18.758001 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a268a104-de98-4693-afc0-3b48569d0682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:18.824299 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268a104-de98-4693-afc0-3b48569d0682 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:18.828306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1501f8f-1ace-462e-b340-f314098edcaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:18.829081 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1501f8f-1ace-462e-b340-f314098edcaa service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:18.829275 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1501f8f-1ace-462e-b340-f314098edcaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:18.829561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1501f8f-1ace-462e-b340-f314098edcaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:18.841053 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1501f8f-1ace-462e-b340-f314098edcaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:18.842515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1501f8f-1ace-462e-b340-f314098edcaa service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:18.853983 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1187/2396] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:33:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:33:19.329847 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53acce7-4493-472d-a41f-bcf4e5aaad0f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:19.331862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-f53acce7-4493-472d-a41f-bcf4e5aaad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:19.344424 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53acce7-4493-472d-a41f-bcf4e5aaad0f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:19.349785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd9e18-dcc7-4709-a701-b5f30058a2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:19.350977 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd9e18-dcc7-4709-a701-b5f30058a2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:19.351493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd9e18-dcc7-4709-a701-b5f30058a2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:19.352011 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd9e18-dcc7-4709-a701-b5f30058a2fe admin admin] PATH_INFO: `/v3/projects/cf2b31c286fc4f6fafd66bac6666eebe` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:19.358358 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd9e18-dcc7-4709-a701-b5f30058a2fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2b31c286fc4f6fafd66bac6666eebe)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:19.360618 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd9e18-dcc7-4709-a701-b5f30058a2fe admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:19.510861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-4acd9e18-dcc7-4709-a701-b5f30058a2fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2b31c286fc4f6fafd66bac6666eebe', 'request_id': 'req-4acd9e18-dcc7-4709-a701-b5f30058a2fe'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:19.606454 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-4acd9e18-dcc7-4709-a701-b5f30058a2fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2b31c286fc4f6fafd66bac6666eebe', 'request_id': 'req-4acd9e18-dcc7-4709-a701-b5f30058a2fe'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:19.612330 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-4acd9e18-dcc7-4709-a701-b5f30058a2fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2b31c286fc4f6fafd66bac6666eebe', 'request_id': 'req-4acd9e18-dcc7-4709-a701-b5f30058a2fe'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:19.631805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-4acd9e18-dcc7-4709-a701-b5f30058a2fe admin admin] The token cache is being invalidate because project cf2b31c286fc4f6fafd66bac6666eebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:33:19.631805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-4acd9e18-dcc7-4709-a701-b5f30058a2fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:19.631805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-4acd9e18-dcc7-4709-a701-b5f30058a2fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:19.636627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1210/2397] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:33:19 2021] DELETE /identity/v3/projects/cf2b31c286fc4f6fafd66bac6666eebe => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:19.645501 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5365809-6079-4252-b2d4-c936b5df6f9a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:19.646016 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5365809-6079-4252-b2d4-c936b5df6f9a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:19.646111 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5365809-6079-4252-b2d4-c936b5df6f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:19.669877 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d5365809-6079-4252-b2d4-c936b5df6f9a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:19.671231 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d5365809-6079-4252-b2d4-c936b5df6f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:19.752499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1188/2398] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:19.760924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913793f7-0c50-473b-a353-b8111c9ad69c None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:19.761464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913793f7-0c50-473b-a353-b8111c9ad69c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:19.761567 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913793f7-0c50-473b-a353-b8111c9ad69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:19.785378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-913793f7-0c50-473b-a353-b8111c9ad69c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:19.788926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-913793f7-0c50-473b-a353-b8111c9ad69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:19.805594 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1211/2399] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:19.815545 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5365809-6079-4252-b2d4-c936b5df6f9a None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:19.827270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5365809-6079-4252-b2d4-c936b5df6f9a None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:19.836550 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac3068-b01a-46df-be2a-072d051aee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:19.838552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac3068-b01a-46df-be2a-072d051aee49 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:19.838909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac3068-b01a-46df-be2a-072d051aee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:19.839259 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac3068-b01a-46df-be2a-072d051aee49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:19.840230 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac3068-b01a-46df-be2a-072d051aee49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:33:19.840670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac3068-b01a-46df-be2a-072d051aee49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:19.842354 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac3068-b01a-46df-be2a-072d051aee49 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:19.857354 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1189/2400] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:33:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:33:19.878697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913793f7-0c50-473b-a353-b8111c9ad69c None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:19.889006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913793f7-0c50-473b-a353-b8111c9ad69c None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:19.894344 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444289d-a001-400a-af79-2691b3926fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:19.895310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444289d-a001-400a-af79-2691b3926fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:19.895809 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444289d-a001-400a-af79-2691b3926fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:19.896083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444289d-a001-400a-af79-2691b3926fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:19.896961 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444289d-a001-400a-af79-2691b3926fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:19.899134 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444289d-a001-400a-af79-2691b3926fb0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:20.104753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1212/2401] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:33:19 2021] POST /identity/v3/projects => generated 383 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:33:20.106264 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac3068-b01a-46df-be2a-072d051aee49 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:20.116617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac3068-b01a-46df-be2a-072d051aee49 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:20.183048 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1c871-96a1-49d1-9aed-1cc4a0ca1699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:20.183750 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1c871-96a1-49d1-9aed-1cc4a0ca1699 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:20.184028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1c871-96a1-49d1-9aed-1cc4a0ca1699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:20.184306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1c871-96a1-49d1-9aed-1cc4a0ca1699 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:20.185021 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1c871-96a1-49d1-9aed-1cc4a0ca1699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:20.186904 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1c871-96a1-49d1-9aed-1cc4a0ca1699 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:20.316911 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1190/2402] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:33:20 2021] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:33:20.317093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444289d-a001-400a-af79-2691b3926fb0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:20.327531 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444289d-a001-400a-af79-2691b3926fb0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:20.332812 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9696dd-0bb1-40ac-82ab-3767ee2c343d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:20.333489 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9696dd-0bb1-40ac-82ab-3767ee2c343d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:20.333773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9696dd-0bb1-40ac-82ab-3767ee2c343d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:20.334054 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9696dd-0bb1-40ac-82ab-3767ee2c343d admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:20.334802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9696dd-0bb1-40ac-82ab-3767ee2c343d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:20.336799 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9696dd-0bb1-40ac-82ab-3767ee2c343d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:20.349307 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1213/2403] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:20 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:33:20.355030 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1c871-96a1-49d1-9aed-1cc4a0ca1699 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:20.366002 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1c871-96a1-49d1-9aed-1cc4a0ca1699 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:20.370783 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfa68f-2877-4c14-b927-691b3eaffbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:20.371439 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfa68f-2877-4c14-b927-691b3eaffbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:20.371755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfa68f-2877-4c14-b927-691b3eaffbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:20.372059 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfa68f-2877-4c14-b927-691b3eaffbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:20.372877 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfa68f-2877-4c14-b927-691b3eaffbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:20.374408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfa68f-2877-4c14-b927-691b3eaffbe6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:20.385326 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1191/2404] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:33:20.389752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9696dd-0bb1-40ac-82ab-3767ee2c343d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:20.401208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9696dd-0bb1-40ac-82ab-3767ee2c343d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:20.406210 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7f5d3-8e5d-444e-84c8-249f8fca209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:20.407096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7f5d3-8e5d-444e-84c8-249f8fca209b admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:20.407372 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7f5d3-8e5d-444e-84c8-249f8fca209b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:20.407641 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7f5d3-8e5d-444e-84c8-249f8fca209b admin admin] PATH_INFO: `/v3/projects/90199d5fd0cf4fe3b3b97bb81c58c97f/users/2cc899776f62464fb4fe8a206b839a85/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:20.425522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7f5d3-8e5d-444e-84c8-249f8fca209b admin admin] RBAC: Authorizing `identity:create_grant(project_id=90199d5fd0cf4fe3b3b97bb81c58c97f, user_id=2cc899776f62464fb4fe8a206b839a85, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:20.428237 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7f5d3-8e5d-444e-84c8-249f8fca209b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:20.509880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1214/2405] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:33:20 2021] PUT /identity/v3/projects/90199d5fd0cf4fe3b3b97bb81c58c97f/users/2cc899776f62464fb4fe8a206b839a85/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:20.520829 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b00cd-decb-4b5d-92e6-0683ae67d733 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:20.521120 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b00cd-decb-4b5d-92e6-0683ae67d733 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:20.521400 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b00cd-decb-4b5d-92e6-0683ae67d733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:20.554538 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-8b4b00cd-decb-4b5d-92e6-0683ae67d733 None None] MFA Rules not processed for user `2cc899776f62464fb4fe8a206b839a85`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:20.556617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8b4b00cd-decb-4b5d-92e6-0683ae67d733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:20.646118 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1192/2406] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:20 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:20.653874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7f5d3-8e5d-444e-84c8-249f8fca209b admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:20.655699 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1ff7f5d3-8e5d-444e-84c8-249f8fca209b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:20.728668 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7f5d3-8e5d-444e-84c8-249f8fca209b admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:20.733623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ece7d3-37d2-4ab6-aba8-da6b46b3843f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:20.734277 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ece7d3-37d2-4ab6-aba8-da6b46b3843f service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:20.734573 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ece7d3-37d2-4ab6-aba8-da6b46b3843f service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:20.734836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ece7d3-37d2-4ab6-aba8-da6b46b3843f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:20.744964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ece7d3-37d2-4ab6-aba8-da6b46b3843f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:20.746413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ece7d3-37d2-4ab6-aba8-da6b46b3843f service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:20.756394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1215/2407] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:33:20 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:33:31.930118 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b00cd-decb-4b5d-92e6-0683ae67d733 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:31.993417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b00cd-decb-4b5d-92e6-0683ae67d733 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:31.997989 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d284004-8734-4f52-a787-5fc82f39040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:31.998877 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284004-8734-4f52-a787-5fc82f39040a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:31.999152 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284004-8734-4f52-a787-5fc82f39040a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:31.999417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284004-8734-4f52-a787-5fc82f39040a admin admin] PATH_INFO: `/v3/users/2cc899776f62464fb4fe8a206b839a85` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:32.000865 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d284004-8734-4f52-a787-5fc82f39040a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc899776f62464fb4fe8a206b839a85)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:32.002752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d284004-8734-4f52-a787-5fc82f39040a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:32.233069 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3d284004-8734-4f52-a787-5fc82f39040a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc899776f62464fb4fe8a206b839a85'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:32.240152 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3d284004-8734-4f52-a787-5fc82f39040a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc899776f62464fb4fe8a206b839a85'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:32.240860 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3d284004-8734-4f52-a787-5fc82f39040a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc899776f62464fb4fe8a206b839a85'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:32.252702 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3d284004-8734-4f52-a787-5fc82f39040a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc899776f62464fb4fe8a206b839a85'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:32.349004 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3d284004-8734-4f52-a787-5fc82f39040a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc899776f62464fb4fe8a206b839a85'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:32.355842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1193/2408] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:33:31 2021] DELETE /identity/v3/users/2cc899776f62464fb4fe8a206b839a85 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:32.360470 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc0a9f-c444-48c7-88e6-bdca83f9c843 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:32.361035 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc0a9f-c444-48c7-88e6-bdca83f9c843 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:32.361132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc0a9f-c444-48c7-88e6-bdca83f9c843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:32.378407 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-60cc0a9f-c444-48c7-88e6-bdca83f9c843 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:32.379593 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-60cc0a9f-c444-48c7-88e6-bdca83f9c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:32.439979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1216/2409] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:32.450980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d284004-8734-4f52-a787-5fc82f39040a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:32.452705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3d284004-8734-4f52-a787-5fc82f39040a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:32.510034 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d284004-8734-4f52-a787-5fc82f39040a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:32.514666 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368c596-057e-487c-ad70-55d22dd94c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:32.515308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368c596-057e-487c-ad70-55d22dd94c65 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:32.515590 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368c596-057e-487c-ad70-55d22dd94c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:32.515903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368c596-057e-487c-ad70-55d22dd94c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:32.525534 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368c596-057e-487c-ad70-55d22dd94c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:32.526943 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368c596-057e-487c-ad70-55d22dd94c65 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:32.536306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1194/2410] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:33:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:33:33.053740 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc0a9f-c444-48c7-88e6-bdca83f9c843 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:33.055219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-60cc0a9f-c444-48c7-88e6-bdca83f9c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:33.068196 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc0a9f-c444-48c7-88e6-bdca83f9c843 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:33.073146 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f86ac-3383-4ad0-8a53-52c2334d8522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:33.074365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f86ac-3383-4ad0-8a53-52c2334d8522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:33.074695 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f86ac-3383-4ad0-8a53-52c2334d8522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:33.081183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f86ac-3383-4ad0-8a53-52c2334d8522 admin admin] PATH_INFO: `/v3/projects/90199d5fd0cf4fe3b3b97bb81c58c97f` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:33.081183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f86ac-3383-4ad0-8a53-52c2334d8522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90199d5fd0cf4fe3b3b97bb81c58c97f)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:33.081183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f86ac-3383-4ad0-8a53-52c2334d8522 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:33.247981 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-961f86ac-3383-4ad0-8a53-52c2334d8522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90199d5fd0cf4fe3b3b97bb81c58c97f', 'request_id': 'req-961f86ac-3383-4ad0-8a53-52c2334d8522'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:33.332153 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-961f86ac-3383-4ad0-8a53-52c2334d8522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90199d5fd0cf4fe3b3b97bb81c58c97f', 'request_id': 'req-961f86ac-3383-4ad0-8a53-52c2334d8522'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:33.341108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-961f86ac-3383-4ad0-8a53-52c2334d8522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90199d5fd0cf4fe3b3b97bb81c58c97f', 'request_id': 'req-961f86ac-3383-4ad0-8a53-52c2334d8522'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:33.352032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-961f86ac-3383-4ad0-8a53-52c2334d8522 admin admin] The token cache is being invalidate because project 90199d5fd0cf4fe3b3b97bb81c58c97f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:33:33.352927 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-961f86ac-3383-4ad0-8a53-52c2334d8522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:33.353599 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-961f86ac-3383-4ad0-8a53-52c2334d8522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:33.355138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1217/2411] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:33:33 2021] DELETE /identity/v3/projects/90199d5fd0cf4fe3b3b97bb81c58c97f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:33.360861 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e7f77-3aee-424b-a8f5-3aad8b2da7fd None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:33.361323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e7f77-3aee-424b-a8f5-3aad8b2da7fd None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:33.361536 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e7f77-3aee-424b-a8f5-3aad8b2da7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:33.379082 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-a03e7f77-3aee-424b-a8f5-3aad8b2da7fd None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:33.380342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a03e7f77-3aee-424b-a8f5-3aad8b2da7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:33.439695 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1195/2412] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:33:33.448188 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd28f1-f24b-470c-a243-fdb2b8e1731a None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:33.448665 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd28f1-f24b-470c-a243-fdb2b8e1731a None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:33.448760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd28f1-f24b-470c-a243-fdb2b8e1731a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:33.467927 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-28cd28f1-f24b-470c-a243-fdb2b8e1731a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:33.469142 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-28cd28f1-f24b-470c-a243-fdb2b8e1731a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:33.476998 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1218/2413] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:33:33.481545 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e7f77-3aee-424b-a8f5-3aad8b2da7fd None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:33.491366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e7f77-3aee-424b-a8f5-3aad8b2da7fd None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:33.496626 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eef010-ef05-460a-be8b-4ed666b9088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:33.497272 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eef010-ef05-460a-be8b-4ed666b9088b admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:33.497553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eef010-ef05-460a-be8b-4ed666b9088b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:33.497828 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eef010-ef05-460a-be8b-4ed666b9088b admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:33.498562 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eef010-ef05-460a-be8b-4ed666b9088b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:33:33.498869 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eef010-ef05-460a-be8b-4ed666b9088b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:33.500507 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eef010-ef05-460a-be8b-4ed666b9088b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:33.512871 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1196/2414] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:33:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:33:33.517153 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd28f1-f24b-470c-a243-fdb2b8e1731a None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:33.527349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd28f1-f24b-470c-a243-fdb2b8e1731a None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:33.532105 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16370cd8-7f94-4dd8-8b5e-b8dda3f0dde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:33.532766 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16370cd8-7f94-4dd8-8b5e-b8dda3f0dde4 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:33.533046 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16370cd8-7f94-4dd8-8b5e-b8dda3f0dde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:33.533317 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16370cd8-7f94-4dd8-8b5e-b8dda3f0dde4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:33.534039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16370cd8-7f94-4dd8-8b5e-b8dda3f0dde4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:33.535963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16370cd8-7f94-4dd8-8b5e-b8dda3f0dde4 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:33.637847 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1219/2415] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:33:33 2021] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:33:33.641927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eef010-ef05-460a-be8b-4ed666b9088b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:33.653116 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eef010-ef05-460a-be8b-4ed666b9088b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:33.714272 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c5c7d-24ca-4e6e-a28d-e7b7f030e040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:33.714933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c5c7d-24ca-4e6e-a28d-e7b7f030e040 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:33.715218 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c5c7d-24ca-4e6e-a28d-e7b7f030e040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:33.715491 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c5c7d-24ca-4e6e-a28d-e7b7f030e040 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:33.716226 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c5c7d-24ca-4e6e-a28d-e7b7f030e040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:33.718104 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c5c7d-24ca-4e6e-a28d-e7b7f030e040 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:33.795685 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1197/2416] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:33:33 2021] POST /identity/v3/users => generated 285 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:33:33.799626 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16370cd8-7f94-4dd8-8b5e-b8dda3f0dde4 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:33.810581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16370cd8-7f94-4dd8-8b5e-b8dda3f0dde4 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:33.815252 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed131969-3f35-48e1-b63c-24c316046dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:33.815986 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131969-3f35-48e1-b63c-24c316046dbd admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:33.816267 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131969-3f35-48e1-b63c-24c316046dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:33.816543 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131969-3f35-48e1-b63c-24c316046dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:33.817286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed131969-3f35-48e1-b63c-24c316046dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:33.818859 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed131969-3f35-48e1-b63c-24c316046dbd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:33.830518 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1220/2417] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:33:33.834687 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c5c7d-24ca-4e6e-a28d-e7b7f030e040 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:33.845909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c5c7d-24ca-4e6e-a28d-e7b7f030e040 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:33.851254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16d428-fe18-47e5-8afd-fb9ccb8e2146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:33.852373 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16d428-fe18-47e5-8afd-fb9ccb8e2146 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:33.852813 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16d428-fe18-47e5-8afd-fb9ccb8e2146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:33.853254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16d428-fe18-47e5-8afd-fb9ccb8e2146 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:33.854194 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16d428-fe18-47e5-8afd-fb9ccb8e2146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:33.855934 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16d428-fe18-47e5-8afd-fb9ccb8e2146 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:33.866391 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1198/2418] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:33:33 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:33:33.871758 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed131969-3f35-48e1-b63c-24c316046dbd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:33.881894 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed131969-3f35-48e1-b63c-24c316046dbd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:33.887945 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c883198-8483-4887-8603-8471d23556ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:33.888817 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883198-8483-4887-8603-8471d23556ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:33.889097 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883198-8483-4887-8603-8471d23556ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:33.889372 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883198-8483-4887-8603-8471d23556ef admin admin] PATH_INFO: `/v3/projects/74eef9ed69414eeb86a9dd9f971a8a74/users/085885bb51df44c5a4edeeccd5c42390/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:33.904156 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c883198-8483-4887-8603-8471d23556ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=74eef9ed69414eeb86a9dd9f971a8a74, user_id=085885bb51df44c5a4edeeccd5c42390, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:33.906915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c883198-8483-4887-8603-8471d23556ef admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:34.006763 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1221/2419] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:33:33 2021] PUT /identity/v3/projects/74eef9ed69414eeb86a9dd9f971a8a74/users/085885bb51df44c5a4edeeccd5c42390/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:34.025255 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a140c8-6f3c-4b3a-ada5-a7ac87934ebd None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:34.025545 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a140c8-6f3c-4b3a-ada5-a7ac87934ebd None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:34.025822 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a140c8-6f3c-4b3a-ada5-a7ac87934ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:34.051902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-18a140c8-6f3c-4b3a-ada5-a7ac87934ebd None None] MFA Rules not processed for user `085885bb51df44c5a4edeeccd5c42390`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:34.053106 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-18a140c8-6f3c-4b3a-ada5-a7ac87934ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:34.120268 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1199/2420] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:34 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:34.132413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c883198-8483-4887-8603-8471d23556ef admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:34.134647 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0c883198-8483-4887-8603-8471d23556ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:34.199652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c883198-8483-4887-8603-8471d23556ef admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:34.203590 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255575a-9cfe-4425-9adc-972c1bce9c0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0998dd32ba8648cfb7f43797a9266d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:34.204262 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255575a-9cfe-4425-9adc-972c1bce9c0a service glance] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:34.204543 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255575a-9cfe-4425-9adc-972c1bce9c0a service glance] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:34.204815 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255575a-9cfe-4425-9adc-972c1bce9c0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:34.214310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255575a-9cfe-4425-9adc-972c1bce9c0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:34.215752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255575a-9cfe-4425-9adc-972c1bce9c0a service glance] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:34.224678 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1222/2421] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:33:34 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:33:47.558710 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a140c8-6f3c-4b3a-ada5-a7ac87934ebd None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:47.560197 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-18a140c8-6f3c-4b3a-ada5-a7ac87934ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:47.621403 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a140c8-6f3c-4b3a-ada5-a7ac87934ebd None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:47.625473 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a198d23-9227-4a39-ae8d-15f254398b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:47.626178 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a198d23-9227-4a39-ae8d-15f254398b28 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:47.626652 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a198d23-9227-4a39-ae8d-15f254398b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:47.626773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a198d23-9227-4a39-ae8d-15f254398b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:47.629591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2a198d23-9227-4a39-ae8d-15f254398b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:47.701305 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a198d23-9227-4a39-ae8d-15f254398b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:47.703127 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a198d23-9227-4a39-ae8d-15f254398b28 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:47.712753 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1200/2422] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:33:47 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:33:48.467701 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af0714-e960-4403-a40e-5becc0a40230 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:48.468409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af0714-e960-4403-a40e-5becc0a40230 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:48.468409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af0714-e960-4403-a40e-5becc0a40230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:48.489070 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-98af0714-e960-4403-a40e-5becc0a40230 None None] MFA Rules not processed for user `bef8571ef39b4efe8f510a28052e2b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:48.491526 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-98af0714-e960-4403-a40e-5becc0a40230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:48.570779 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1223/2423] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:48 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:58.909897 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a198d23-9227-4a39-ae8d-15f254398b28 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:58.912362 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2a198d23-9227-4a39-ae8d-15f254398b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:58.987675 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a198d23-9227-4a39-ae8d-15f254398b28 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:58.992241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3b578-1d87-4efd-bfca-c004854d6649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:58.997117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3b578-1d87-4efd-bfca-c004854d6649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:58.997117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3b578-1d87-4efd-bfca-c004854d6649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:58.997117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3b578-1d87-4efd-bfca-c004854d6649 admin admin] PATH_INFO: `/v3/users/34ad077fd0164d3c8b4db14262186901` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:58.997117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3b578-1d87-4efd-bfca-c004854d6649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ad077fd0164d3c8b4db14262186901)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:58.997117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3b578-1d87-4efd-bfca-c004854d6649 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:59.254095 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d4d3b578-1d87-4efd-bfca-c004854d6649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ad077fd0164d3c8b4db14262186901'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:59.260681 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d4d3b578-1d87-4efd-bfca-c004854d6649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ad077fd0164d3c8b4db14262186901'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:59.261351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d4d3b578-1d87-4efd-bfca-c004854d6649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ad077fd0164d3c8b4db14262186901'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:59.274532 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d4d3b578-1d87-4efd-bfca-c004854d6649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ad077fd0164d3c8b4db14262186901'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:59.417326 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d4d3b578-1d87-4efd-bfca-c004854d6649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ad077fd0164d3c8b4db14262186901'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:33:59.424621 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1201/2424] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:33:58 2021] DELETE /identity/v3/users/34ad077fd0164d3c8b4db14262186901 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:33:59.507692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed7cb6-6507-44db-916e-c0c69d127c12 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:59.508271 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed7cb6-6507-44db-916e-c0c69d127c12 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:59.508416 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed7cb6-6507-44db-916e-c0c69d127c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:59.527525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-baed7cb6-6507-44db-916e-c0c69d127c12 None None] MFA Rules not processed for user `78823bdcff4e45d8ab82558b434f188d`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:33:59.529092 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-baed7cb6-6507-44db-916e-c0c69d127c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:59.589099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1224/2425] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:33:59 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:33:59.726328 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3b578-1d87-4efd-bfca-c004854d6649 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:33:59.727814 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d4d3b578-1d87-4efd-bfca-c004854d6649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:33:59.823800 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3b578-1d87-4efd-bfca-c004854d6649 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:33:59.829438 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:33:59.830542 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:33:59.830542 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:33:59.830831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6 admin admin] PATH_INFO: `/v3/projects/7aa66fedc6704473996d04ffbf8135e0` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:33:59.832206 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aa66fedc6704473996d04ffbf8135e0)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:33:59.834070 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:33:59.950055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa66fedc6704473996d04ffbf8135e0', 'request_id': 'req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:00.017586 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa66fedc6704473996d04ffbf8135e0', 'request_id': 'req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:00.025060 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa66fedc6704473996d04ffbf8135e0', 'request_id': 'req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:00.036679 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6 admin admin] The token cache is being invalidate because project 7aa66fedc6704473996d04ffbf8135e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:34:00.037012 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:00.037682 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e64c8b7b-fa6d-41cf-a2da-1f5d497434c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:00.039223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1202/2426] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:33:59 2021] DELETE /identity/v3/projects/7aa66fedc6704473996d04ffbf8135e0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:34:00.045004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1642f-467e-4331-b275-a661f045f5a4 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:00.045382 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1642f-467e-4331-b275-a661f045f5a4 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:00.045756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1642f-467e-4331-b275-a661f045f5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:00.065522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-1af1642f-467e-4331-b275-a661f045f5a4 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:00.066148 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1af1642f-467e-4331-b275-a661f045f5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:00.099942 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a498aa-86a1-41b8-ac69-3c916f52762c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:00.100230 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a498aa-86a1-41b8-ac69-3c916f52762c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:00.100826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a498aa-86a1-41b8-ac69-3c916f52762c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:00.126044 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-95a498aa-86a1-41b8-ac69-3c916f52762c None None] MFA Rules not processed for user `045dda1ff9b44334954c08e63fcd20c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:00.127422 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-95a498aa-86a1-41b8-ac69-3c916f52762c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:00.147041 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1225/2427] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:34:00.155499 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfdb4b-a1de-4541-9734-d60e37b31919 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:00.156339 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfdb4b-a1de-4541-9734-d60e37b31919 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:00.156666 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfdb4b-a1de-4541-9734-d60e37b31919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:00.182329 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-e1cfdb4b-a1de-4541-9734-d60e37b31919 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:00.184576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e1cfdb4b-a1de-4541-9734-d60e37b31919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:00.198837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1226/2428] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:34:00.205159 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfdb4b-a1de-4541-9734-d60e37b31919 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:00.219473 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1203/2429] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:00 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:34:00.221090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfdb4b-a1de-4541-9734-d60e37b31919 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:00.226460 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617bcd9-de7a-452b-baef-87f1d8d646e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:00.227130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617bcd9-de7a-452b-baef-87f1d8d646e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:00.227409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617bcd9-de7a-452b-baef-87f1d8d646e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:00.227682 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617bcd9-de7a-452b-baef-87f1d8d646e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:00.228587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617bcd9-de7a-452b-baef-87f1d8d646e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:34:00.228904 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617bcd9-de7a-452b-baef-87f1d8d646e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:00.231152 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617bcd9-de7a-452b-baef-87f1d8d646e5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:00.248383 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1227/2430] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:34:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:34:00.249364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a498aa-86a1-41b8-ac69-3c916f52762c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:00.264407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a498aa-86a1-41b8-ac69-3c916f52762c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:00.273838 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e8498-b62c-4e6f-be7b-84ca0df8788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:00.274524 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e8498-b62c-4e6f-be7b-84ca0df8788f admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:00.274835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e8498-b62c-4e6f-be7b-84ca0df8788f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:00.275129 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e8498-b62c-4e6f-be7b-84ca0df8788f admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:00.275954 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e8498-b62c-4e6f-be7b-84ca0df8788f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:00.277835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e8498-b62c-4e6f-be7b-84ca0df8788f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:00.460690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1204/2431] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:34:00 2021] POST /identity/v3/projects => generated 389 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:34:00.464810 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617bcd9-de7a-452b-baef-87f1d8d646e5 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:00.476273 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617bcd9-de7a-452b-baef-87f1d8d646e5 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:00.554646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8dc1a-3571-4a63-a826-6ee7a5bce20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:00.555665 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8dc1a-3571-4a63-a826-6ee7a5bce20d admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:00.556202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8dc1a-3571-4a63-a826-6ee7a5bce20d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:00.556585 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8dc1a-3571-4a63-a826-6ee7a5bce20d admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:00.557452 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8dc1a-3571-4a63-a826-6ee7a5bce20d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:00.559679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8dc1a-3571-4a63-a826-6ee7a5bce20d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:00.669309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1228/2432] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:34:00 2021] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:34:00.673376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e8498-b62c-4e6f-be7b-84ca0df8788f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:00.684441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e8498-b62c-4e6f-be7b-84ca0df8788f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:00.690185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201eb59a-5c07-45d6-b65f-3ab09be7c1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:00.690936 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eb59a-5c07-45d6-b65f-3ab09be7c1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:00.691284 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eb59a-5c07-45d6-b65f-3ab09be7c1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:00.691642 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eb59a-5c07-45d6-b65f-3ab09be7c1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:00.692486 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201eb59a-5c07-45d6-b65f-3ab09be7c1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:00.694221 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201eb59a-5c07-45d6-b65f-3ab09be7c1b0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:00.706812 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1205/2433] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:34:00 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:34:00.710761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8dc1a-3571-4a63-a826-6ee7a5bce20d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:00.721419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8dc1a-3571-4a63-a826-6ee7a5bce20d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:00.726192 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d883d56-6d5a-4b77-b652-51899262514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:00.726942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d883d56-6d5a-4b77-b652-51899262514d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:00.727223 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d883d56-6d5a-4b77-b652-51899262514d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:00.727497 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d883d56-6d5a-4b77-b652-51899262514d admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:00.728276 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d883d56-6d5a-4b77-b652-51899262514d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:00.729935 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d883d56-6d5a-4b77-b652-51899262514d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:00.741952 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1229/2434] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:34:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:34:00.745820 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201eb59a-5c07-45d6-b65f-3ab09be7c1b0 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:00.755935 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201eb59a-5c07-45d6-b65f-3ab09be7c1b0 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:00.760699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8738e-1288-41c3-8e0b-5ccfbbbf7b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:00.761566 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8738e-1288-41c3-8e0b-5ccfbbbf7b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:00.761875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8738e-1288-41c3-8e0b-5ccfbbbf7b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:00.762144 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8738e-1288-41c3-8e0b-5ccfbbbf7b49 admin admin] PATH_INFO: `/v3/projects/58de4245f4d3446ebb13c7d9b48a56a1/users/8dc337d83bbb4cb0a4923b13c34a8c29/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:00.784005 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8738e-1288-41c3-8e0b-5ccfbbbf7b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58de4245f4d3446ebb13c7d9b48a56a1, user_id=8dc337d83bbb4cb0a4923b13c34a8c29, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:00.787059 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8738e-1288-41c3-8e0b-5ccfbbbf7b49 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:00.863383 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1206/2435] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:34:00 2021] PUT /identity/v3/projects/58de4245f4d3446ebb13c7d9b48a56a1/users/8dc337d83bbb4cb0a4923b13c34a8c29/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:34:00.873722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a53c9-32d1-4508-89da-a3b9b74747fe None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:00.874191 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a53c9-32d1-4508-89da-a3b9b74747fe None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:00.874916 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a53c9-32d1-4508-89da-a3b9b74747fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:00.900560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-bc4a53c9-32d1-4508-89da-a3b9b74747fe None None] MFA Rules not processed for user `8dc337d83bbb4cb0a4923b13c34a8c29`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:00.901764 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-bc4a53c9-32d1-4508-89da-a3b9b74747fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:00.967383 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1230/2436] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:00 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:34:00.975684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8738e-1288-41c3-8e0b-5ccfbbbf7b49 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:00.977718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-5af8738e-1288-41c3-8e0b-5ccfbbbf7b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:01.047707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8738e-1288-41c3-8e0b-5ccfbbbf7b49 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:01.052126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c291c-8352-410c-aba7-3736b59e6db8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:01.052947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c291c-8352-410c-aba7-3736b59e6db8 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:01.053250 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c291c-8352-410c-aba7-3736b59e6db8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:01.053528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c291c-8352-410c-aba7-3736b59e6db8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:01.067559 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c291c-8352-410c-aba7-3736b59e6db8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:01.071330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c291c-8352-410c-aba7-3736b59e6db8 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:01.081891 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1207/2437] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:00 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:34:01.268576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a53c9-32d1-4508-89da-a3b9b74747fe None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:01.269991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-bc4a53c9-32d1-4508-89da-a3b9b74747fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:01.328207 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a53c9-32d1-4508-89da-a3b9b74747fe None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:01.331964 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988864ae-d308-4944-aae5-ce38ad457d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:01.332615 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988864ae-d308-4944-aae5-ce38ad457d4c service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:01.332912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988864ae-d308-4944-aae5-ce38ad457d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:01.333170 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988864ae-d308-4944-aae5-ce38ad457d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:01.335011 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-988864ae-d308-4944-aae5-ce38ad457d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:01.404689 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988864ae-d308-4944-aae5-ce38ad457d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:01.406743 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988864ae-d308-4944-aae5-ce38ad457d4c service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:01.417552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1231/2438] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:34:03.822403 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c291c-8352-410c-aba7-3736b59e6db8 service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:03.837476 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c291c-8352-410c-aba7-3736b59e6db8 service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:03.842312 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c550f-262f-4500-aee8-150064103bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:03.843811 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c550f-262f-4500-aee8-150064103bcc service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:03.844209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c550f-262f-4500-aee8-150064103bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:03.844814 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c550f-262f-4500-aee8-150064103bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:03.847211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-934c550f-262f-4500-aee8-150064103bcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:03.881227 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c550f-262f-4500-aee8-150064103bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:03.882786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c550f-262f-4500-aee8-150064103bcc service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:03.913931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1208/2439] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:03 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:34:13.971751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988864ae-d308-4944-aae5-ce38ad457d4c service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:13.973302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-988864ae-d308-4944-aae5-ce38ad457d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:13.989228 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988864ae-d308-4944-aae5-ce38ad457d4c service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:13.999741 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503dbc-a9b6-4d74-a106-2940b9d43d9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:13.999741 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503dbc-a9b6-4d74-a106-2940b9d43d9e service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:13.999741 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503dbc-a9b6-4d74-a106-2940b9d43d9e service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:13.999741 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503dbc-a9b6-4d74-a106-2940b9d43d9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:14.002010 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-58503dbc-a9b6-4d74-a106-2940b9d43d9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:14.006378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c550f-262f-4500-aee8-150064103bcc service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:14.007889 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-934c550f-262f-4500-aee8-150064103bcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:14.027988 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c550f-262f-4500-aee8-150064103bcc service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:14.034116 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52953c49-d09e-4c07-b6d1-f7ac79dd9c96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:14.034691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52953c49-d09e-4c07-b6d1-f7ac79dd9c96 service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:14.034974 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52953c49-d09e-4c07-b6d1-f7ac79dd9c96 service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:14.035249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52953c49-d09e-4c07-b6d1-f7ac79dd9c96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:14.037276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-52953c49-d09e-4c07-b6d1-f7ac79dd9c96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:14.062102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58503dbc-a9b6-4d74-a106-2940b9d43d9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:14.063691 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58503dbc-a9b6-4d74-a106-2940b9d43d9e service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:14.073199 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1232/2440] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:13 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:34:14.101613 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52953c49-d09e-4c07-b6d1-f7ac79dd9c96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:14.105398 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52953c49-d09e-4c07-b6d1-f7ac79dd9c96 service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:14.115284 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1209/2441] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:14 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:34:16.775474 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503dbc-a9b6-4d74-a106-2940b9d43d9e service nova] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:16.787008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503dbc-a9b6-4d74-a106-2940b9d43d9e service nova] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:16.790863 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482ff44-6385-40a7-92d5-0c6808aaa865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:16.791505 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482ff44-6385-40a7-92d5-0c6808aaa865 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:16.791819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482ff44-6385-40a7-92d5-0c6808aaa865 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:16.792099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482ff44-6385-40a7-92d5-0c6808aaa865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:16.793940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4482ff44-6385-40a7-92d5-0c6808aaa865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:16.803663 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482ff44-6385-40a7-92d5-0c6808aaa865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:16.805206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482ff44-6385-40a7-92d5-0c6808aaa865 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:16.812969 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1233/2442] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:16 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:34:22.010587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52953c49-d09e-4c07-b6d1-f7ac79dd9c96 service nova] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:22.022081 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52953c49-d09e-4c07-b6d1-f7ac79dd9c96 service nova] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:22.025935 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7cf08-571f-41cc-8204-40891177b16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:22.026574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7cf08-571f-41cc-8204-40891177b16c service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:22.026905 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7cf08-571f-41cc-8204-40891177b16c service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:22.027180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7cf08-571f-41cc-8204-40891177b16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:22.029065 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ebe7cf08-571f-41cc-8204-40891177b16c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:22.103259 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7cf08-571f-41cc-8204-40891177b16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:22.104730 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7cf08-571f-41cc-8204-40891177b16c service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:22.114467 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1210/2443] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:22 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:34:25.033192 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482ff44-6385-40a7-92d5-0c6808aaa865 service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:25.059602 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482ff44-6385-40a7-92d5-0c6808aaa865 service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:25.065604 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08645f9-ca29-472b-9f48-f701513340e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:25.066329 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08645f9-ca29-472b-9f48-f701513340e3 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:25.066617 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08645f9-ca29-472b-9f48-f701513340e3 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:25.066896 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08645f9-ca29-472b-9f48-f701513340e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:25.068744 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c08645f9-ca29-472b-9f48-f701513340e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:25.084063 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08645f9-ca29-472b-9f48-f701513340e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:25.085722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08645f9-ca29-472b-9f48-f701513340e3 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:25.107469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1234/2444] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:25 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:34:26.914199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7cf08-571f-41cc-8204-40891177b16c service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:26.988537 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7cf08-571f-41cc-8204-40891177b16c service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:26.993642 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51c11a-f94f-456f-947e-4c4f79399154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:26.994561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51c11a-f94f-456f-947e-4c4f79399154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:26.994836 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51c11a-f94f-456f-947e-4c4f79399154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:26.995108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51c11a-f94f-456f-947e-4c4f79399154 admin admin] PATH_INFO: `/v3/users/8dc337d83bbb4cb0a4923b13c34a8c29` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:26.996406 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51c11a-f94f-456f-947e-4c4f79399154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc337d83bbb4cb0a4923b13c34a8c29)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:26.998986 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51c11a-f94f-456f-947e-4c4f79399154 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:27.234437 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08645f9-ca29-472b-9f48-f701513340e3 service nova] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:27.236009 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c08645f9-ca29-472b-9f48-f701513340e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:27.250193 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08645f9-ca29-472b-9f48-f701513340e3 service nova] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:27.255638 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfab49-304e-42f7-90be-a63d7753523f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:27.256659 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfab49-304e-42f7-90be-a63d7753523f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:27.256940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfab49-304e-42f7-90be-a63d7753523f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:27.257269 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfab49-304e-42f7-90be-a63d7753523f admin admin] PATH_INFO: `/v3/users/085885bb51df44c5a4edeeccd5c42390` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:27.258466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfab49-304e-42f7-90be-a63d7753523f admin admin] RBAC: Authorizing `identity:delete_user(user_id=085885bb51df44c5a4edeeccd5c42390)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:27.260484 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfab49-304e-42f7-90be-a63d7753523f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:27.346356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1f51c11a-f94f-456f-947e-4c4f79399154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc337d83bbb4cb0a4923b13c34a8c29'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:27.354171 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1f51c11a-f94f-456f-947e-4c4f79399154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc337d83bbb4cb0a4923b13c34a8c29'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:27.354882 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1f51c11a-f94f-456f-947e-4c4f79399154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc337d83bbb4cb0a4923b13c34a8c29'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:27.371612 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1f51c11a-f94f-456f-947e-4c4f79399154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc337d83bbb4cb0a4923b13c34a8c29'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:27.473214 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1f51c11a-f94f-456f-947e-4c4f79399154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc337d83bbb4cb0a4923b13c34a8c29'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:27.479575 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1211/2445] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:34:26 2021] DELETE /identity/v3/users/8dc337d83bbb4cb0a4923b13c34a8c29 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:34:27.484543 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfc32-550c-450b-b861-93e55fd0548e None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:27.484837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfc32-550c-450b-b861-93e55fd0548e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:27.485116 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfc32-550c-450b-b861-93e55fd0548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:27.502551 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-fffbfc32-550c-450b-b861-93e55fd0548e None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:27.503893 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-fffbfc32-550c-450b-b861-93e55fd0548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:27.518939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-67cfab49-304e-42f7-90be-a63d7753523f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085885bb51df44c5a4edeeccd5c42390'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:27.519973 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-67cfab49-304e-42f7-90be-a63d7753523f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085885bb51df44c5a4edeeccd5c42390'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:27.534467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-67cfab49-304e-42f7-90be-a63d7753523f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085885bb51df44c5a4edeeccd5c42390'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:27.543001 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-67cfab49-304e-42f7-90be-a63d7753523f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085885bb51df44c5a4edeeccd5c42390'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:27.568272 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1212/2446] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:34:27.578880 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbfc32-550c-450b-b861-93e55fd0548e None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:27.580279 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-fffbfc32-550c-450b-b861-93e55fd0548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:27.634434 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-67cfab49-304e-42f7-90be-a63d7753523f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085885bb51df44c5a4edeeccd5c42390'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:27.641010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbfc32-550c-450b-b861-93e55fd0548e None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:27.644449 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1235/2447] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:34:27 2021] DELETE /identity/v3/users/085885bb51df44c5a4edeeccd5c42390 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:34:27.646187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730232a-a7c5-4b3e-8c78-0c0574fcdeaf None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:27.646187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730232a-a7c5-4b3e-8c78-0c0574fcdeaf None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:27.646497 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730232a-a7c5-4b3e-8c78-0c0574fcdeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:27.664546 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-2730232a-a7c5-4b3e-8c78-0c0574fcdeaf None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:27.665760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-2730232a-a7c5-4b3e-8c78-0c0574fcdeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:27.696399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa77a8e-e0b2-4e98-8112-2318f9ab8bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:27.696996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa77a8e-e0b2-4e98-8112-2318f9ab8bac service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:27.697379 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa77a8e-e0b2-4e98-8112-2318f9ab8bac service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:27.697728 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa77a8e-e0b2-4e98-8112-2318f9ab8bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:27.733996 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1236/2448] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:34:27.743522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730232a-a7c5-4b3e-8c78-0c0574fcdeaf None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:27.755452 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730232a-a7c5-4b3e-8c78-0c0574fcdeaf None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:27.759404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0cc97-0191-4757-8731-b19de074eeac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:27.760180 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0cc97-0191-4757-8731-b19de074eeac service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:27.760539 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0cc97-0191-4757-8731-b19de074eeac service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:27.760889 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0cc97-0191-4757-8731-b19de074eeac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:27.765575 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa77a8e-e0b2-4e98-8112-2318f9ab8bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:27.767316 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa77a8e-e0b2-4e98-8112-2318f9ab8bac service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:27.772536 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0cc97-0191-4757-8731-b19de074eeac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:27.774359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0cc97-0191-4757-8731-b19de074eeac service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:27.779052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1213/2449] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:34:27.786654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1237/2450] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:34:28.497280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa77a8e-e0b2-4e98-8112-2318f9ab8bac service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:28.499307 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-8fa77a8e-e0b2-4e98-8112-2318f9ab8bac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:28.513322 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa77a8e-e0b2-4e98-8112-2318f9ab8bac service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:28.519613 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5062a57-15d1-466b-9dd8-21f5f08c4114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:28.521335 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5062a57-15d1-466b-9dd8-21f5f08c4114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:28.521899 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5062a57-15d1-466b-9dd8-21f5f08c4114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:28.525063 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5062a57-15d1-466b-9dd8-21f5f08c4114 admin admin] PATH_INFO: `/v3/projects/58de4245f4d3446ebb13c7d9b48a56a1` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:28.527548 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0cc97-0191-4757-8731-b19de074eeac service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:28.529070 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5062a57-15d1-466b-9dd8-21f5f08c4114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58de4245f4d3446ebb13c7d9b48a56a1)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:28.533223 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b5c0cc97-0191-4757-8731-b19de074eeac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:28.533497 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5062a57-15d1-466b-9dd8-21f5f08c4114 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:28.556441 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0cc97-0191-4757-8731-b19de074eeac service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:28.565689 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:28.567698 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:28.568540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:28.568942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec admin admin] PATH_INFO: `/v3/projects/74eef9ed69414eeb86a9dd9f971a8a74` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:28.573794 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=74eef9ed69414eeb86a9dd9f971a8a74)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:28.575914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:28.704356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a5062a57-15d1-466b-9dd8-21f5f08c4114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58de4245f4d3446ebb13c7d9b48a56a1', 'request_id': 'req-a5062a57-15d1-466b-9dd8-21f5f08c4114'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:28.740979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74eef9ed69414eeb86a9dd9f971a8a74', 'request_id': 'req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:28.806264 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a5062a57-15d1-466b-9dd8-21f5f08c4114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58de4245f4d3446ebb13c7d9b48a56a1', 'request_id': 'req-a5062a57-15d1-466b-9dd8-21f5f08c4114'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:28.813342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a5062a57-15d1-466b-9dd8-21f5f08c4114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58de4245f4d3446ebb13c7d9b48a56a1', 'request_id': 'req-a5062a57-15d1-466b-9dd8-21f5f08c4114'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:28.824772 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a5062a57-15d1-466b-9dd8-21f5f08c4114 admin admin] The token cache is being invalidate because project 58de4245f4d3446ebb13c7d9b48a56a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:34:28.825135 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a5062a57-15d1-466b-9dd8-21f5f08c4114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:28.825837 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a5062a57-15d1-466b-9dd8-21f5f08c4114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:28.827489 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1214/2451] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:34:28 2021] DELETE /identity/v3/projects/58de4245f4d3446ebb13c7d9b48a56a1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:34:28.833712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fce435-7eda-4dd7-8ae1-9dd292007b88 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:28.834100 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fce435-7eda-4dd7-8ae1-9dd292007b88 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:28.834376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fce435-7eda-4dd7-8ae1-9dd292007b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:28.852767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-82fce435-7eda-4dd7-8ae1-9dd292007b88 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:28.853955 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-82fce435-7eda-4dd7-8ae1-9dd292007b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:28.886155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74eef9ed69414eeb86a9dd9f971a8a74', 'request_id': 'req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:28.892324 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74eef9ed69414eeb86a9dd9f971a8a74', 'request_id': 'req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:28.903894 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec admin admin] The token cache is being invalidate because project 74eef9ed69414eeb86a9dd9f971a8a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:34:28.904099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:28.905385 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eb55110c-f5e4-4b53-b68c-43cfb1edb7ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:28.907217 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1238/2452] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:34:28 2021] DELETE /identity/v3/projects/74eef9ed69414eeb86a9dd9f971a8a74 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:34:28.912882 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f5c72-5bbf-4ecf-9ced-7d33a3c9906d None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:28.913165 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f5c72-5bbf-4ecf-9ced-7d33a3c9906d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:28.913440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f5c72-5bbf-4ecf-9ced-7d33a3c9906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:28.916387 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1215/2453] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:34:28.925156 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6ad84-ca42-4ed4-b6b6-b91f01698232 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:28.925440 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6ad84-ca42-4ed4-b6b6-b91f01698232 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:28.925715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6ad84-ca42-4ed4-b6b6-b91f01698232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:28.932860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-965f5c72-5bbf-4ecf-9ced-7d33a3c9906d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:28.934136 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-965f5c72-5bbf-4ecf-9ced-7d33a3c9906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:28.942724 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1239/2454] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:34:28.944413 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-20c6ad84-ca42-4ed4-b6b6-b91f01698232 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:28.945606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-20c6ad84-ca42-4ed4-b6b6-b91f01698232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:28.950469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2868cb-5a65-45dc-9ae8-8deb5edb3c21 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:28.950756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2868cb-5a65-45dc-9ae8-8deb5edb3c21 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:28.951033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2868cb-5a65-45dc-9ae8-8deb5edb3c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:28.954950 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1216/2455] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:34:28.959557 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6ad84-ca42-4ed4-b6b6-b91f01698232 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:28.970261 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6ad84-ca42-4ed4-b6b6-b91f01698232 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:28.974485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-7e2868cb-5a65-45dc-9ae8-8deb5edb3c21 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:28.975006 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948e7db-365a-4e32-bf22-70d7beb32025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:28.975658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948e7db-365a-4e32-bf22-70d7beb32025 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:28.975876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7e2868cb-5a65-45dc-9ae8-8deb5edb3c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:28.976028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948e7db-365a-4e32-bf22-70d7beb32025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:28.976227 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948e7db-365a-4e32-bf22-70d7beb32025 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:28.976980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948e7db-365a-4e32-bf22-70d7beb32025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:34:28.977287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948e7db-365a-4e32-bf22-70d7beb32025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:28.978834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948e7db-365a-4e32-bf22-70d7beb32025 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:28.984766 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1240/2456] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:34:28.988946 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2868cb-5a65-45dc-9ae8-8deb5edb3c21 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:28.991558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1217/2457] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:34:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:34:28.995647 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948e7db-365a-4e32-bf22-70d7beb32025 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:28.998328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2868cb-5a65-45dc-9ae8-8deb5edb3c21 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:29.004278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85a032-247c-405f-8d5b-54c5087ce86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:29.004278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85a032-247c-405f-8d5b-54c5087ce86d admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.004278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85a032-247c-405f-8d5b-54c5087ce86d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.004278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85a032-247c-405f-8d5b-54c5087ce86d admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.004999 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85a032-247c-405f-8d5b-54c5087ce86d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:34:29.005467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85a032-247c-405f-8d5b-54c5087ce86d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:29.005873 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948e7db-365a-4e32-bf22-70d7beb32025 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:29.006873 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85a032-247c-405f-8d5b-54c5087ce86d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:29.010576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8e05e-24f3-4144-89eb-5e017e9743e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:29.011214 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8e05e-24f3-4144-89eb-5e017e9743e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.011496 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8e05e-24f3-4144-89eb-5e017e9743e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.011802 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8e05e-24f3-4144-89eb-5e017e9743e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.012507 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8e05e-24f3-4144-89eb-5e017e9743e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:29.014686 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8e05e-24f3-4144-89eb-5e017e9743e5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:29.018574 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1241/2458] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:34:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:34:29.022879 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85a032-247c-405f-8d5b-54c5087ce86d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:29.033187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85a032-247c-405f-8d5b-54c5087ce86d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:29.037896 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5aae37-22c1-43cb-8922-1efcea1c1cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:29.038595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aae37-22c1-43cb-8922-1efcea1c1cda admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.038862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aae37-22c1-43cb-8922-1efcea1c1cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.039130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aae37-22c1-43cb-8922-1efcea1c1cda admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.039889 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5aae37-22c1-43cb-8922-1efcea1c1cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:29.041742 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5aae37-22c1-43cb-8922-1efcea1c1cda admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:29.099520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1218/2459] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:34:28 2021] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:34:29.107548 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8e05e-24f3-4144-89eb-5e017e9743e5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:29.132902 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1242/2460] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:34:29 2021] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:34:29.137061 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5aae37-22c1-43cb-8922-1efcea1c1cda admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:29.173021 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8e05e-24f3-4144-89eb-5e017e9743e5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:29.197402 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5aae37-22c1-43cb-8922-1efcea1c1cda admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:29.204405 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea71e2e-4b66-42a8-aa61-0b6e90d60e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:29.205096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea71e2e-4b66-42a8-aa61-0b6e90d60e37 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.205378 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea71e2e-4b66-42a8-aa61-0b6e90d60e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.205646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea71e2e-4b66-42a8-aa61-0b6e90d60e37 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.206359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea71e2e-4b66-42a8-aa61-0b6e90d60e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:29.208284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea71e2e-4b66-42a8-aa61-0b6e90d60e37 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:29.243431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48e70b-62ed-41a6-acca-9225e6841bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:29.244222 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48e70b-62ed-41a6-acca-9225e6841bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.244506 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48e70b-62ed-41a6-acca-9225e6841bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.244774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48e70b-62ed-41a6-acca-9225e6841bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.245484 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48e70b-62ed-41a6-acca-9225e6841bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:29.247510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48e70b-62ed-41a6-acca-9225e6841bc5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:29.344163 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1243/2461] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:34:29 2021] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:34:29.348223 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea71e2e-4b66-42a8-aa61-0b6e90d60e37 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:29.357941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea71e2e-4b66-42a8-aa61-0b6e90d60e37 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:29.362765 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6817a6-3791-4798-8ae4-cd67dcae89cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:29.363440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6817a6-3791-4798-8ae4-cd67dcae89cb admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.363717 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6817a6-3791-4798-8ae4-cd67dcae89cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.364012 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6817a6-3791-4798-8ae4-cd67dcae89cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.364744 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6817a6-3791-4798-8ae4-cd67dcae89cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:29.366411 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6817a6-3791-4798-8ae4-cd67dcae89cb admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:29.377361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1244/2462] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:34:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:34:29.380643 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6817a6-3791-4798-8ae4-cd67dcae89cb admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:29.386008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1219/2463] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:34:29 2021] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:34:29.387088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48e70b-62ed-41a6-acca-9225e6841bc5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:29.390918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6817a6-3791-4798-8ae4-cd67dcae89cb admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:29.395753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6cf9-7f69-4e55-b2b8-e00f4ae211dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:29.396421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6cf9-7f69-4e55-b2b8-e00f4ae211dd admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.396705 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6cf9-7f69-4e55-b2b8-e00f4ae211dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.396981 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6cf9-7f69-4e55-b2b8-e00f4ae211dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.397719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea6cf9-7f69-4e55-b2b8-e00f4ae211dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:29.397961 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48e70b-62ed-41a6-acca-9225e6841bc5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:29.399290 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea6cf9-7f69-4e55-b2b8-e00f4ae211dd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:29.402816 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61d9da-b695-4246-b026-30fa9872115e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:29.403484 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61d9da-b695-4246-b026-30fa9872115e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.403793 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61d9da-b695-4246-b026-30fa9872115e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.404092 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61d9da-b695-4246-b026-30fa9872115e admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.406083 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61d9da-b695-4246-b026-30fa9872115e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:29.407652 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61d9da-b695-4246-b026-30fa9872115e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:29.409862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1245/2464] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:34:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:34:29.413951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6cf9-7f69-4e55-b2b8-e00f4ae211dd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:29.420931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1220/2465] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:34:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:34:29.422063 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61d9da-b695-4246-b026-30fa9872115e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:29.423659 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6cf9-7f69-4e55-b2b8-e00f4ae211dd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:29.428284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe4e25-2c74-41df-b512-f1f721dbc569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:29.432093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4e25-2c74-41df-b512-f1f721dbc569 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.432093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4e25-2c74-41df-b512-f1f721dbc569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.432093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4e25-2c74-41df-b512-f1f721dbc569 admin admin] PATH_INFO: `/v3/projects/2575d357a67341599504fe3761ab5e67/users/30047283bb6e4accb9e1e264aa21c9ba/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.432398 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61d9da-b695-4246-b026-30fa9872115e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:29.437342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd1adc-2709-471c-8280-0a804f2adeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:29.437991 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd1adc-2709-471c-8280-0a804f2adeff admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.438276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd1adc-2709-471c-8280-0a804f2adeff admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.438552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd1adc-2709-471c-8280-0a804f2adeff admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.439291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd1adc-2709-471c-8280-0a804f2adeff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:29.440895 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd1adc-2709-471c-8280-0a804f2adeff admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:29.444176 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe4e25-2c74-41df-b512-f1f721dbc569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2575d357a67341599504fe3761ab5e67, user_id=30047283bb6e4accb9e1e264aa21c9ba, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:29.446784 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe4e25-2c74-41df-b512-f1f721dbc569 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:29.455247 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1221/2466] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:34:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:34:29.456235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd1adc-2709-471c-8280-0a804f2adeff admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:29.465788 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd1adc-2709-471c-8280-0a804f2adeff admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:29.471255 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300a6d7-cf2c-4a85-822b-bf30e16457a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:29.472132 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300a6d7-cf2c-4a85-822b-bf30e16457a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.472419 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300a6d7-cf2c-4a85-822b-bf30e16457a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.472696 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300a6d7-cf2c-4a85-822b-bf30e16457a5 admin admin] PATH_INFO: `/v3/projects/700a9aa6afdf4de6b64d375544d7eb88/users/e1147a77b5da48f9a75cefa0ab0e6b87/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.487244 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300a6d7-cf2c-4a85-822b-bf30e16457a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=700a9aa6afdf4de6b64d375544d7eb88, user_id=e1147a77b5da48f9a75cefa0ab0e6b87, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:29.489911 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300a6d7-cf2c-4a85-822b-bf30e16457a5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:29.565998 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1246/2467] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:34:29 2021] PUT /identity/v3/projects/2575d357a67341599504fe3761ab5e67/users/30047283bb6e4accb9e1e264aa21c9ba/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:34:29.577018 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb038d4-ae74-4bc1-9251-e44769d153ca None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.578175 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb038d4-ae74-4bc1-9251-e44769d153ca None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.578462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb038d4-ae74-4bc1-9251-e44769d153ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.604855 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-2bb038d4-ae74-4bc1-9251-e44769d153ca None None] MFA Rules not processed for user `30047283bb6e4accb9e1e264aa21c9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:29.605814 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1222/2468] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:34:29 2021] PUT /identity/v3/projects/700a9aa6afdf4de6b64d375544d7eb88/users/e1147a77b5da48f9a75cefa0ab0e6b87/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:34:29.606299 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-2bb038d4-ae74-4bc1-9251-e44769d153ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:29.611188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fd5a4-29fb-4aba-a327-19e6950a450c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.611479 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fd5a4-29fb-4aba-a327-19e6950a450c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.611784 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fd5a4-29fb-4aba-a327-19e6950a450c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.630028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-2a4fd5a4-29fb-4aba-a327-19e6950a450c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:29.631242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2a4fd5a4-29fb-4aba-a327-19e6950a450c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:29.673587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1247/2469] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:29 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:34:29.683509 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb038d4-ae74-4bc1-9251-e44769d153ca None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:29.684793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-2bb038d4-ae74-4bc1-9251-e44769d153ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:29.691236 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1223/2470] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:34:29.701126 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fd5a4-29fb-4aba-a327-19e6950a450c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:29.703059 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2a4fd5a4-29fb-4aba-a327-19e6950a450c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:29.741815 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb038d4-ae74-4bc1-9251-e44769d153ca None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:29.745523 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357854e-be2b-4b51-8e28-a4054d2375f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:29.746173 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357854e-be2b-4b51-8e28-a4054d2375f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.746483 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357854e-be2b-4b51-8e28-a4054d2375f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.746758 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357854e-be2b-4b51-8e28-a4054d2375f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.755182 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357854e-be2b-4b51-8e28-a4054d2375f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:29.756645 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357854e-be2b-4b51-8e28-a4054d2375f2 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:29.760512 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fd5a4-29fb-4aba-a327-19e6950a450c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:29.764320 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87b3e8-37a1-4fdc-82b4-063d54808230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:29.765245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b3e8-37a1-4fdc-82b4-063d54808230 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:29.765404 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b3e8-37a1-4fdc-82b4-063d54808230 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:29.765675 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b3e8-37a1-4fdc-82b4-063d54808230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:29.768524 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1248/2471] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:29 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:34:29.775328 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87b3e8-37a1-4fdc-82b4-063d54808230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:29.776916 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87b3e8-37a1-4fdc-82b4-063d54808230 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:29.786871 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1224/2472] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:34:35.603380 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4e036-06b0-42b2-9b11-01a6ce36fd33 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:35.603987 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4e036-06b0-42b2-9b11-01a6ce36fd33 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:35.603987 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4e036-06b0-42b2-9b11-01a6ce36fd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:35.633503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-92f4e036-06b0-42b2-9b11-01a6ce36fd33 None None] MFA Rules not processed for user `e1147a77b5da48f9a75cefa0ab0e6b87`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:35.634603 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-92f4e036-06b0-42b2-9b11-01a6ce36fd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:35.707035 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1249/2473] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:35 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:34:35.711353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87b3e8-37a1-4fdc-82b4-063d54808230 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:35.724841 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87b3e8-37a1-4fdc-82b4-063d54808230 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:35.729956 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230a541-68d9-47c7-962d-a0e634bacb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:35.730740 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230a541-68d9-47c7-962d-a0e634bacb13 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:35.731154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230a541-68d9-47c7-962d-a0e634bacb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:35.731719 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230a541-68d9-47c7-962d-a0e634bacb13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:35.732765 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230a541-68d9-47c7-962d-a0e634bacb13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:35.735035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230a541-68d9-47c7-962d-a0e634bacb13 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:35.841364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1225/2474] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:34:35 2021] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:34:35.846929 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4e036-06b0-42b2-9b11-01a6ce36fd33 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:35.860069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4e036-06b0-42b2-9b11-01a6ce36fd33 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:35.937974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ca72f-ea97-44f2-b3ba-e9ecc43046b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:35.938654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ca72f-ea97-44f2-b3ba-e9ecc43046b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:35.938934 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ca72f-ea97-44f2-b3ba-e9ecc43046b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:35.939202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ca72f-ea97-44f2-b3ba-e9ecc43046b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:35.939943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ca72f-ea97-44f2-b3ba-e9ecc43046b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:35.942007 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ca72f-ea97-44f2-b3ba-e9ecc43046b3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:36.086063 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1250/2475] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:34:35 2021] POST /identity/v3/users => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:34:36.089746 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230a541-68d9-47c7-962d-a0e634bacb13 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:36.103115 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230a541-68d9-47c7-962d-a0e634bacb13 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:36.108630 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af399e0a-255f-4545-b1b5-90ad02ea9dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:36.109547 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af399e0a-255f-4545-b1b5-90ad02ea9dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:36.109832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af399e0a-255f-4545-b1b5-90ad02ea9dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:36.110105 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af399e0a-255f-4545-b1b5-90ad02ea9dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:36.110873 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af399e0a-255f-4545-b1b5-90ad02ea9dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:36.112712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af399e0a-255f-4545-b1b5-90ad02ea9dc5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:36.125301 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1226/2476] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:34:36 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:34:36.129693 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ca72f-ea97-44f2-b3ba-e9ecc43046b3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:36.141665 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ca72f-ea97-44f2-b3ba-e9ecc43046b3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:36.149367 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2e416-a19c-476c-92cc-8f3fdc63bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:36.150360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2e416-a19c-476c-92cc-8f3fdc63bcc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:36.150822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2e416-a19c-476c-92cc-8f3fdc63bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:36.151098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2e416-a19c-476c-92cc-8f3fdc63bcc3 admin admin] PATH_INFO: `/v3/projects/d74714cd6d7e4451ba7ba7c71b662cec/users/88b2a2bcb62241628a43421bbe10af82/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:36.172099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2e416-a19c-476c-92cc-8f3fdc63bcc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74714cd6d7e4451ba7ba7c71b662cec, user_id=88b2a2bcb62241628a43421bbe10af82, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:36.174965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2e416-a19c-476c-92cc-8f3fdc63bcc3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:36.344107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1251/2477] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:34:36 2021] PUT /identity/v3/projects/d74714cd6d7e4451ba7ba7c71b662cec/users/88b2a2bcb62241628a43421bbe10af82/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:34:36.348016 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af399e0a-255f-4545-b1b5-90ad02ea9dc5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:36.358002 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af399e0a-255f-4545-b1b5-90ad02ea9dc5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:36.414069 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bdae6-933f-40eb-b747-81fdd111114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:36.414985 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bdae6-933f-40eb-b747-81fdd111114c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:36.415344 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bdae6-933f-40eb-b747-81fdd111114c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:36.415762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bdae6-933f-40eb-b747-81fdd111114c admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:36.416579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bdae6-933f-40eb-b747-81fdd111114c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:36.418287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bdae6-933f-40eb-b747-81fdd111114c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:36.431268 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1227/2478] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:34:36 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:34:36.432263 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2e416-a19c-476c-92cc-8f3fdc63bcc3 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:36.443197 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2e416-a19c-476c-92cc-8f3fdc63bcc3 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:36.450145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98245455-3b26-4859-ad4b-13398f937073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:36.450145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98245455-3b26-4859-ad4b-13398f937073 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:36.450145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98245455-3b26-4859-ad4b-13398f937073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:36.450145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98245455-3b26-4859-ad4b-13398f937073 admin admin] PATH_INFO: `/v3/projects/d74714cd6d7e4451ba7ba7c71b662cec/users/88b2a2bcb62241628a43421bbe10af82/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:36.452307 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98245455-3b26-4859-ad4b-13398f937073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74714cd6d7e4451ba7ba7c71b662cec, user_id=88b2a2bcb62241628a43421bbe10af82, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:36.455232 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98245455-3b26-4859-ad4b-13398f937073 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:36.467527 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1252/2479] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:34:36 2021] PUT /identity/v3/projects/d74714cd6d7e4451ba7ba7c71b662cec/users/88b2a2bcb62241628a43421bbe10af82/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:34:42.112498 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bdae6-933f-40eb-b747-81fdd111114c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:42.124134 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bdae6-933f-40eb-b747-81fdd111114c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:42.187435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145da2e-9c95-4b3e-bb1a-709e91b726aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:42.188355 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145da2e-9c95-4b3e-bb1a-709e91b726aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:42.188634 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145da2e-9c95-4b3e-bb1a-709e91b726aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:42.188903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145da2e-9c95-4b3e-bb1a-709e91b726aa admin admin] PATH_INFO: `/v3/users/30047283bb6e4accb9e1e264aa21c9ba` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:42.190160 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145da2e-9c95-4b3e-bb1a-709e91b726aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=30047283bb6e4accb9e1e264aa21c9ba)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:42.192094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145da2e-9c95-4b3e-bb1a-709e91b726aa admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:42.406220 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e145da2e-9c95-4b3e-bb1a-709e91b726aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30047283bb6e4accb9e1e264aa21c9ba'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:42.416862 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e145da2e-9c95-4b3e-bb1a-709e91b726aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30047283bb6e4accb9e1e264aa21c9ba'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:42.417742 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e145da2e-9c95-4b3e-bb1a-709e91b726aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30047283bb6e4accb9e1e264aa21c9ba'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:42.431883 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e145da2e-9c95-4b3e-bb1a-709e91b726aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30047283bb6e4accb9e1e264aa21c9ba'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:42.509477 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-e145da2e-9c95-4b3e-bb1a-709e91b726aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30047283bb6e4accb9e1e264aa21c9ba'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:42.519116 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1228/2480] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:34:42 2021] DELETE /identity/v3/users/30047283bb6e4accb9e1e264aa21c9ba => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:34:42.524648 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d1901-61a3-408a-9c12-c31b3c7d0ffe None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:42.531963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d1901-61a3-408a-9c12-c31b3c7d0ffe None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:42.531963 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d1901-61a3-408a-9c12-c31b3c7d0ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:42.558482 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-de7d1901-61a3-408a-9c12-c31b3c7d0ffe None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:42.561208 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-de7d1901-61a3-408a-9c12-c31b3c7d0ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:42.648369 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1253/2481] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:34:42.669157 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145da2e-9c95-4b3e-bb1a-709e91b726aa admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:42.671156 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e145da2e-9c95-4b3e-bb1a-709e91b726aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:42.767777 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145da2e-9c95-4b3e-bb1a-709e91b726aa admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:42.806743 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe690e5-0844-49a9-9d37-5d4f439ca7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:42.807409 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe690e5-0844-49a9-9d37-5d4f439ca7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:42.807686 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe690e5-0844-49a9-9d37-5d4f439ca7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:42.808004 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe690e5-0844-49a9-9d37-5d4f439ca7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:42.813585 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b870-859b-4dba-9545-fbf1081b8c70 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:42.820836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b870-859b-4dba-9545-fbf1081b8c70 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:42.820836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b870-859b-4dba-9545-fbf1081b8c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:42.825110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe690e5-0844-49a9-9d37-5d4f439ca7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:42.827417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe690e5-0844-49a9-9d37-5d4f439ca7a1 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:42.842357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1229/2482] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:34:42.856193 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-15d3b870-859b-4dba-9545-fbf1081b8c70 None None] MFA Rules not processed for user `88b2a2bcb62241628a43421bbe10af82`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:42.859142 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-15d3b870-859b-4dba-9545-fbf1081b8c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:42.958633 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1254/2483] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:42 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:34:42.978401 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe690e5-0844-49a9-9d37-5d4f439ca7a1 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:42.987423 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2fe690e5-0844-49a9-9d37-5d4f439ca7a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:43.056140 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe690e5-0844-49a9-9d37-5d4f439ca7a1 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:43.056767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933ecab-1dae-4d85-8132-d23521b8246f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0998dd32ba8648cfb7f43797a9266d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:43.057414 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ecab-1dae-4d85-8132-d23521b8246f service glance] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:43.057690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ecab-1dae-4d85-8132-d23521b8246f service glance] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:43.057960 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ecab-1dae-4d85-8132-d23521b8246f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:43.059831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-5933ecab-1dae-4d85-8132-d23521b8246f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:43.132282 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933ecab-1dae-4d85-8132-d23521b8246f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:43.140391 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933ecab-1dae-4d85-8132-d23521b8246f service glance] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:43.147399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1230/2484] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:42 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:34:43.425510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3b870-859b-4dba-9545-fbf1081b8c70 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:43.431113 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-15d3b870-859b-4dba-9545-fbf1081b8c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:43.450770 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3b870-859b-4dba-9545-fbf1081b8c70 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:43.456569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:43.457366 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:43.457681 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:43.457900 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] PATH_INFO: `/v3/projects/2575d357a67341599504fe3761ab5e67` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:43.459120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2575d357a67341599504fe3761ab5e67)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:43.461062 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:43.514156 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89889733-b3be-4d1e-aada-b2d027d1c6d9 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:43.514457 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89889733-b3be-4d1e-aada-b2d027d1c6d9 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:43.514741 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89889733-b3be-4d1e-aada-b2d027d1c6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:43.534168 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-89889733-b3be-4d1e-aada-b2d027d1c6d9 None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:43.535466 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-89889733-b3be-4d1e-aada-b2d027d1c6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:43.591334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2575d357a67341599504fe3761ab5e67', 'request_id': 'req-af2a1923-3996-48c5-8fa1-ab3248f5486d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:43.600907 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1231/2485] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:34:43 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:34:43.668703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2575d357a67341599504fe3761ab5e67', 'request_id': 'req-af2a1923-3996-48c5-8fa1-ab3248f5486d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:43.678878 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2575d357a67341599504fe3761ab5e67', 'request_id': 'req-af2a1923-3996-48c5-8fa1-ab3248f5486d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:43.690686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] The token cache is being invalidate because project 2575d357a67341599504fe3761ab5e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:34:43.691048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:43.691864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:43.693405 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1255/2486] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:34:43 2021] DELETE /identity/v3/projects/2575d357a67341599504fe3761ab5e67 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:34:43.699312 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddd2c8-31ec-47ab-a194-00fceacd5488 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:43.699672 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddd2c8-31ec-47ab-a194-00fceacd5488 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:43.700068 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddd2c8-31ec-47ab-a194-00fceacd5488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:43.720510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-a7ddd2c8-31ec-47ab-a194-00fceacd5488 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:43.721196 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a7ddd2c8-31ec-47ab-a194-00fceacd5488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:43.765323 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:43.766781 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:43.789692 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1232/2487] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:34:43.796689 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84440cbb-fe51-4b17-98f9-748ed2ed68f3 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:43.796689 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84440cbb-fe51-4b17-98f9-748ed2ed68f3 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:43.796689 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84440cbb-fe51-4b17-98f9-748ed2ed68f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:43.818023 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-84440cbb-fe51-4b17-98f9-748ed2ed68f3 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:43.819351 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-84440cbb-fe51-4b17-98f9-748ed2ed68f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:43.831781 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1233/2488] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:34:43.842062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84440cbb-fe51-4b17-98f9-748ed2ed68f3 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:43.846001 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84440cbb-fe51-4b17-98f9-748ed2ed68f3 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:43.852036 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb8b75-25e3-4f4d-8617-292edc1337a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:43.852845 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb8b75-25e3-4f4d-8617-292edc1337a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:43.853209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb8b75-25e3-4f4d-8617-292edc1337a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:43.853596 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb8b75-25e3-4f4d-8617-292edc1337a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:43.854425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb8b75-25e3-4f4d-8617-292edc1337a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:34:43.854807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb8b75-25e3-4f4d-8617-292edc1337a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:43.856686 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb8b75-25e3-4f4d-8617-292edc1337a4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:43.861906 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a1923-3996-48c5-8fa1-ab3248f5486d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:43.871180 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec67d3-2784-4296-87d7-15d775525ee5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:43.871882 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec67d3-2784-4296-87d7-15d775525ee5 service swift] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:43.872169 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec67d3-2784-4296-87d7-15d775525ee5 service swift] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:43.872497 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec67d3-2784-4296-87d7-15d775525ee5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:43.873997 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1234/2489] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:34:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:34:43.876455 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-aaec67d3-2784-4296-87d7-15d775525ee5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:43.880024 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb8b75-25e3-4f4d-8617-292edc1337a4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:43.891311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb8b75-25e3-4f4d-8617-292edc1337a4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:43.896199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ae3c5-b98b-4e9d-a586-7826ec527616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:43.896964 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ae3c5-b98b-4e9d-a586-7826ec527616 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:43.897316 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ae3c5-b98b-4e9d-a586-7826ec527616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:43.897659 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ae3c5-b98b-4e9d-a586-7826ec527616 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:43.898434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ae3c5-b98b-4e9d-a586-7826ec527616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:43.900436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ae3c5-b98b-4e9d-a586-7826ec527616 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:43.940641 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec67d3-2784-4296-87d7-15d775525ee5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:43.942238 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec67d3-2784-4296-87d7-15d775525ee5 service swift] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:43.950836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1256/2490] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:34:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 01:34:44.026024 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1235/2491] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:34:43 2021] POST /identity/v3/projects => generated 399 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:34:44.031400 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec67d3-2784-4296-87d7-15d775525ee5 service swift] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:44.041376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec67d3-2784-4296-87d7-15d775525ee5 service swift] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:44.109440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08bb9a-9e97-4fb8-b3d0-900508e484a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:44.112075 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08bb9a-9e97-4fb8-b3d0-900508e484a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:44.112075 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08bb9a-9e97-4fb8-b3d0-900508e484a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:44.112075 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08bb9a-9e97-4fb8-b3d0-900508e484a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:44.112075 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08bb9a-9e97-4fb8-b3d0-900508e484a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:44.113508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08bb9a-9e97-4fb8-b3d0-900508e484a5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:44.268041 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1257/2492] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:34:44 2021] POST /identity/v3/users => generated 300 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:34:44.269633 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ae3c5-b98b-4e9d-a586-7826ec527616 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:44.283557 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ae3c5-b98b-4e9d-a586-7826ec527616 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:44.296359 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434baa99-734b-4fb6-8486-b0a1815f67ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:44.297058 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434baa99-734b-4fb6-8486-b0a1815f67ba admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:44.297353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434baa99-734b-4fb6-8486-b0a1815f67ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:44.297649 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434baa99-734b-4fb6-8486-b0a1815f67ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:44.300150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434baa99-734b-4fb6-8486-b0a1815f67ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:44.301792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434baa99-734b-4fb6-8486-b0a1815f67ba admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:44.325539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1236/2493] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:34:44 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:34:44.326916 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08bb9a-9e97-4fb8-b3d0-900508e484a5 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:44.343464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08bb9a-9e97-4fb8-b3d0-900508e484a5 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:44.350988 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b221f9b-082d-48a4-aec6-3a4511186285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:44.351918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b221f9b-082d-48a4-aec6-3a4511186285 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:44.352213 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b221f9b-082d-48a4-aec6-3a4511186285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:44.352494 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b221f9b-082d-48a4-aec6-3a4511186285 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:44.353318 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b221f9b-082d-48a4-aec6-3a4511186285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:44.358083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b221f9b-082d-48a4-aec6-3a4511186285 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:44.378684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1258/2494] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:34:44 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:34:44.385377 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434baa99-734b-4fb6-8486-b0a1815f67ba admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:44.393688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434baa99-734b-4fb6-8486-b0a1815f67ba admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:44.398658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41b2d2-45bc-4232-b95a-f034bbfcd119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:44.399644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41b2d2-45bc-4232-b95a-f034bbfcd119 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:44.399945 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41b2d2-45bc-4232-b95a-f034bbfcd119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:44.400213 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41b2d2-45bc-4232-b95a-f034bbfcd119 admin admin] PATH_INFO: `/v3/projects/d956b29d1d364ab2a1385462223afb80/users/e07510b4a3874a5595594c1c583d4997/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:44.417647 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41b2d2-45bc-4232-b95a-f034bbfcd119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d956b29d1d364ab2a1385462223afb80, user_id=e07510b4a3874a5595594c1c583d4997, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:44.421067 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41b2d2-45bc-4232-b95a-f034bbfcd119 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:44.549459 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1237/2495] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:34:44 2021] PUT /identity/v3/projects/d956b29d1d364ab2a1385462223afb80/users/e07510b4a3874a5595594c1c583d4997/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:34:44.559967 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72b8cf-438b-40e8-9ee3-5b20d5e477af None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:44.561419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72b8cf-438b-40e8-9ee3-5b20d5e477af None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:44.561918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72b8cf-438b-40e8-9ee3-5b20d5e477af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:44.597005 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-0c72b8cf-438b-40e8-9ee3-5b20d5e477af None None] MFA Rules not processed for user `e07510b4a3874a5595594c1c583d4997`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:44.599142 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-0c72b8cf-438b-40e8-9ee3-5b20d5e477af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:44.701832 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1259/2496] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:44 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:34:44.709503 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41b2d2-45bc-4232-b95a-f034bbfcd119 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:44.714005 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9a41b2d2-45bc-4232-b95a-f034bbfcd119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:44.832777 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41b2d2-45bc-4232-b95a-f034bbfcd119 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:44.837304 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397106db-2b2d-4c27-bad2-f928d722a289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:44.838675 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397106db-2b2d-4c27-bad2-f928d722a289 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:44.838675 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397106db-2b2d-4c27-bad2-f928d722a289 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:44.838875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397106db-2b2d-4c27-bad2-f928d722a289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:44.850873 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397106db-2b2d-4c27-bad2-f928d722a289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:44.852721 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397106db-2b2d-4c27-bad2-f928d722a289 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:44.892077 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1238/2497] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:44 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:34:54.650646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72b8cf-438b-40e8-9ee3-5b20d5e477af None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:54.717674 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72b8cf-438b-40e8-9ee3-5b20d5e477af None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:54.722496 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8a62b-bfde-4bf1-beb5-e00451856a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:54.723361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a62b-bfde-4bf1-beb5-e00451856a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:54.723638 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a62b-bfde-4bf1-beb5-e00451856a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:54.723979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a62b-bfde-4bf1-beb5-e00451856a32 admin admin] PATH_INFO: `/v3/users/e07510b4a3874a5595594c1c583d4997` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:54.725192 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8a62b-bfde-4bf1-beb5-e00451856a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e07510b4a3874a5595594c1c583d4997)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:54.727098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8a62b-bfde-4bf1-beb5-e00451856a32 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:55.032780 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-29d8a62b-bfde-4bf1-beb5-e00451856a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07510b4a3874a5595594c1c583d4997'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:55.032979 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dd3b0-9b3d-4a52-87a4-31a744466062 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:55.033447 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dd3b0-9b3d-4a52-87a4-31a744466062 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:55.033533 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-29d8a62b-bfde-4bf1-beb5-e00451856a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07510b4a3874a5595594c1c583d4997'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:55.033614 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dd3b0-9b3d-4a52-87a4-31a744466062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:55.047441 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-29d8a62b-bfde-4bf1-beb5-e00451856a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07510b4a3874a5595594c1c583d4997'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:55.051680 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-150dd3b0-9b3d-4a52-87a4-31a744466062 None None] MFA Rules not processed for user `e1147a77b5da48f9a75cefa0ab0e6b87`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:55.052944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-150dd3b0-9b3d-4a52-87a4-31a744466062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:55.054630 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-29d8a62b-bfde-4bf1-beb5-e00451856a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07510b4a3874a5595594c1c583d4997'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:55.109739 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1239/2498] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:55 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:34:55.176846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-29d8a62b-bfde-4bf1-beb5-e00451856a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07510b4a3874a5595594c1c583d4997'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:55.198190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1260/2499] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:34:54 2021] DELETE /identity/v3/users/e07510b4a3874a5595594c1c583d4997 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:34:55.198337 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166e50a-6bd5-46e1-b747-db2cb2886933 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:55.198337 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166e50a-6bd5-46e1-b747-db2cb2886933 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:55.198337 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166e50a-6bd5-46e1-b747-db2cb2886933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:55.208936 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-4166e50a-6bd5-46e1-b747-db2cb2886933 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:34:55.210204 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4166e50a-6bd5-46e1-b747-db2cb2886933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:55.271796 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1240/2500] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:34:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:34:55.283297 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8a62b-bfde-4bf1-beb5-e00451856a32 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:55.284825 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-29d8a62b-bfde-4bf1-beb5-e00451856a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:55.348257 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8a62b-bfde-4bf1-beb5-e00451856a32 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:55.352037 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42d255-c2e3-49c4-a2ba-2d8c8d619edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:55.352687 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42d255-c2e3-49c4-a2ba-2d8c8d619edd service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:55.352965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42d255-c2e3-49c4-a2ba-2d8c8d619edd service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:55.353239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42d255-c2e3-49c4-a2ba-2d8c8d619edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:55.365602 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42d255-c2e3-49c4-a2ba-2d8c8d619edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:55.367038 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42d255-c2e3-49c4-a2ba-2d8c8d619edd service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:55.376951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1261/2501] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:34:55.384801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166e50a-6bd5-46e1-b747-db2cb2886933 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:55.386192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4166e50a-6bd5-46e1-b747-db2cb2886933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:55.398357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166e50a-6bd5-46e1-b747-db2cb2886933 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:55.402283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9c179-fc10-459f-bf65-7dae5c42a930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:55.403089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9c179-fc10-459f-bf65-7dae5c42a930 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:55.403366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9c179-fc10-459f-bf65-7dae5c42a930 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:55.404231 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9c179-fc10-459f-bf65-7dae5c42a930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:55.406135 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-0fa9c179-fc10-459f-bf65-7dae5c42a930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:55.417923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9c179-fc10-459f-bf65-7dae5c42a930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:55.420471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9c179-fc10-459f-bf65-7dae5c42a930 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:55.429444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1241/2502] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:55 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:34:56.000424 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42d255-c2e3-49c4-a2ba-2d8c8d619edd service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:56.005888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-9d42d255-c2e3-49c4-a2ba-2d8c8d619edd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:56.009292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9c179-fc10-459f-bf65-7dae5c42a930 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:34:56.010688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-0fa9c179-fc10-459f-bf65-7dae5c42a930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:56.041839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9c179-fc10-459f-bf65-7dae5c42a930 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:56.047456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:56.048212 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:56.048487 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:56.048754 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] PATH_INFO: `/v3/projects/d956b29d1d364ab2a1385462223afb80` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:56.050081 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=d956b29d1d364ab2a1385462223afb80)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:56.051956 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:56.101149 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42d255-c2e3-49c4-a2ba-2d8c8d619edd service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:34:56.108862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fb53e-d574-4002-b0c6-ed12daf508ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa303a60fec4ac5aaeb96c6618b387e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:34:56.108862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fb53e-d574-4002-b0c6-ed12daf508ba service placement] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:34:56.108862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fb53e-d574-4002-b0c6-ed12daf508ba service placement] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:34:56.108862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fb53e-d574-4002-b0c6-ed12daf508ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:34:56.110443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1a8fb53e-d574-4002-b0c6-ed12daf508ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:34:56.122882 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fb53e-d574-4002-b0c6-ed12daf508ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:34:56.125125 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fb53e-d574-4002-b0c6-ed12daf508ba service placement] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:34:56.135476 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1262/2503] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:34:55 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:34:56.256909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd956b29d1d364ab2a1385462223afb80', 'request_id': 'req-84664ceb-e59b-4b20-8228-d59ed44f7dde'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:56.422789 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd956b29d1d364ab2a1385462223afb80', 'request_id': 'req-84664ceb-e59b-4b20-8228-d59ed44f7dde'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:56.428736 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd956b29d1d364ab2a1385462223afb80', 'request_id': 'req-84664ceb-e59b-4b20-8228-d59ed44f7dde'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:56.440560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] The token cache is being invalidate because project d956b29d1d364ab2a1385462223afb80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:34:56.440847 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:56.441616 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:34:56.443435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1242/2504] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:34:56 2021] DELETE /identity/v3/projects/d956b29d1d364ab2a1385462223afb80 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:35:00.112697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d9a31-f8d6-47a6-ae86-a7b2119e6b82 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:35:00.113145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d9a31-f8d6-47a6-ae86-a7b2119e6b82 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:35:00.113289 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d9a31-f8d6-47a6-ae86-a7b2119e6b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:35:00.130592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-a40d9a31-f8d6-47a6-ae86-a7b2119e6b82 None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:35:00.131804 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a40d9a31-f8d6-47a6-ae86-a7b2119e6b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:35:00.186550 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1263/2505] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:35:00 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:35:00.200390 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:35:00.201785 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:35:00.280193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84664ceb-e59b-4b20-8228-d59ed44f7dde admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:35:00.287075 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1936822-6d65-4630-be58-9dcb3d7558c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:35:00.288274 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1936822-6d65-4630-be58-9dcb3d7558c7 service swift] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:35:00.289334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1936822-6d65-4630-be58-9dcb3d7558c7 service swift] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:35:00.289842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1936822-6d65-4630-be58-9dcb3d7558c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:35:00.308995 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1936822-6d65-4630-be58-9dcb3d7558c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:35:00.308995 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1936822-6d65-4630-be58-9dcb3d7558c7 service swift] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:35:00.315112 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1243/2506] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:35:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 01:35:19.173261 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d9a31-f8d6-47a6-ae86-a7b2119e6b82 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:35:19.175414 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a40d9a31-f8d6-47a6-ae86-a7b2119e6b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:35:19.256958 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d9a31-f8d6-47a6-ae86-a7b2119e6b82 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:35:19.262926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad79658-8b23-448d-86c2-dbe587d62d46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:35:19.263612 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad79658-8b23-448d-86c2-dbe587d62d46 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:35:19.264000 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad79658-8b23-448d-86c2-dbe587d62d46 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:35:19.264283 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad79658-8b23-448d-86c2-dbe587d62d46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:35:19.266078 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-9ad79658-8b23-448d-86c2-dbe587d62d46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:35:19.278686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad79658-8b23-448d-86c2-dbe587d62d46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:35:19.280306 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad79658-8b23-448d-86c2-dbe587d62d46 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:35:19.293083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1264/2507] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:35:19 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:35:33.128108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cf9af-03f9-4f12-b6ce-72b380810c00 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:35:33.128624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cf9af-03f9-4f12-b6ce-72b380810c00 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:35:33.128624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cf9af-03f9-4f12-b6ce-72b380810c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:35:33.147162 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-108cf9af-03f9-4f12-b6ce-72b380810c00 None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:35:33.148671 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-108cf9af-03f9-4f12-b6ce-72b380810c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:35:33.156118 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1244/2508] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:35:33 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:35:33.169158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad79658-8b23-448d-86c2-dbe587d62d46 service nova] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:35:33.180987 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad79658-8b23-448d-86c2-dbe587d62d46 service nova] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:35:33.185970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9cb66-b09f-4da6-bf8c-60ca412fbfaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:35:33.186600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9cb66-b09f-4da6-bf8c-60ca412fbfaa service swift] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:35:33.186921 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9cb66-b09f-4da6-bf8c-60ca412fbfaa service swift] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:35:33.187176 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9cb66-b09f-4da6-bf8c-60ca412fbfaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:35:33.195701 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9cb66-b09f-4da6-bf8c-60ca412fbfaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:35:33.197481 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9cb66-b09f-4da6-bf8c-60ca412fbfaa service swift] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:35:33.206408 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1265/2509] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:35:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 01:35:35.540181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cf9af-03f9-4f12-b6ce-72b380810c00 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:35:35.546228 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-108cf9af-03f9-4f12-b6ce-72b380810c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:35:35.613538 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cf9af-03f9-4f12-b6ce-72b380810c00 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:35:35.617514 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216b5fd-8113-4b48-80d7-893288a549f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:35:35.618342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216b5fd-8113-4b48-80d7-893288a549f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:35:35.618692 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216b5fd-8113-4b48-80d7-893288a549f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:35:35.619199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216b5fd-8113-4b48-80d7-893288a549f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:35:35.621110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-7216b5fd-8113-4b48-80d7-893288a549f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:35:35.711400 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216b5fd-8113-4b48-80d7-893288a549f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:35:35.713379 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216b5fd-8113-4b48-80d7-893288a549f2 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:35:35.725124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1245/2510] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:35:35 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:35:38.475065 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9cb66-b09f-4da6-bf8c-60ca412fbfaa service swift] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:35:38.494729 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9cb66-b09f-4da6-bf8c-60ca412fbfaa service swift] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:35:38.501515 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2fce7-52e5-4356-8113-57aeeccb3639 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:35:38.502628 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2fce7-52e5-4356-8113-57aeeccb3639 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:35:38.503175 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2fce7-52e5-4356-8113-57aeeccb3639 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:35:38.503775 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2fce7-52e5-4356-8113-57aeeccb3639 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:35:38.507337 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-72b2fce7-52e5-4356-8113-57aeeccb3639 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:35:38.523828 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2fce7-52e5-4356-8113-57aeeccb3639 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:35:38.534215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2fce7-52e5-4356-8113-57aeeccb3639 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:35:38.551681 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1266/2511] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:35:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:35:53.877395 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7e2d9-fed9-4dda-bfd7-accba0b3ab6f None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:35:53.877864 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7e2d9-fed9-4dda-bfd7-accba0b3ab6f None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:35:53.877970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7e2d9-fed9-4dda-bfd7-accba0b3ab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:35:53.895916 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-77a7e2d9-fed9-4dda-bfd7-accba0b3ab6f None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:35:53.897242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-77a7e2d9-fed9-4dda-bfd7-accba0b3ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:35:53.904461 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1246/2512] 10.222.0.87 () {58 vars in 1009 bytes} [Fri Oct 29 01:35:53 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:35:53.917174 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2fce7-52e5-4356-8113-57aeeccb3639 service nova] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:35:53.928778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2fce7-52e5-4356-8113-57aeeccb3639 service nova] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:35:53.933685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3faa8-c386-46ed-b2f2-527387ca6421 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:35:53.934326 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3faa8-c386-46ed-b2f2-527387ca6421 service swift] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:35:53.934604 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3faa8-c386-46ed-b2f2-527387ca6421 service swift] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:35:53.934876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3faa8-c386-46ed-b2f2-527387ca6421 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:35:53.942791 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3faa8-c386-46ed-b2f2-527387ca6421 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:35:53.945152 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3faa8-c386-46ed-b2f2-527387ca6421 service swift] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:35:53.953050 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1267/2513] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:35:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 01:35:59.524311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7e2d9-fed9-4dda-bfd7-accba0b3ab6f None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:35:59.525732 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-77a7e2d9-fed9-4dda-bfd7-accba0b3ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:35:59.537594 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7e2d9-fed9-4dda-bfd7-accba0b3ab6f None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:35:59.541885 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfcb09-e23f-4474-b5a7-1169479a70c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:35:59.542595 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfcb09-e23f-4474-b5a7-1169479a70c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:35:59.542945 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfcb09-e23f-4474-b5a7-1169479a70c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:35:59.543266 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfcb09-e23f-4474-b5a7-1169479a70c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:35:59.545471 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-13bfcb09-e23f-4474-b5a7-1169479a70c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:35:59.612399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfcb09-e23f-4474-b5a7-1169479a70c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:35:59.614068 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfcb09-e23f-4474-b5a7-1169479a70c1 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:35:59.625509 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1247/2514] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:35:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:36:04.367535 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3faa8-c386-46ed-b2f2-527387ca6421 service swift] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:36:04.369465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a3c3faa8-c386-46ed-b2f2-527387ca6421 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:36:04.384578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3faa8-c386-46ed-b2f2-527387ca6421 service swift] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:36:04.389744 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8091849-4d32-4165-a39e-41af5330cdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:36:04.390952 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8091849-4d32-4165-a39e-41af5330cdb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:04.391360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8091849-4d32-4165-a39e-41af5330cdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:04.391580 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8091849-4d32-4165-a39e-41af5330cdb0 admin admin] PATH_INFO: `/v3/users/045dda1ff9b44334954c08e63fcd20c0` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:04.392845 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8091849-4d32-4165-a39e-41af5330cdb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=045dda1ff9b44334954c08e63fcd20c0)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:36:04.394789 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8091849-4d32-4165-a39e-41af5330cdb0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:36:04.626654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-e8091849-4d32-4165-a39e-41af5330cdb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '045dda1ff9b44334954c08e63fcd20c0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:36:04.627301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-e8091849-4d32-4165-a39e-41af5330cdb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '045dda1ff9b44334954c08e63fcd20c0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:36:04.749443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-e8091849-4d32-4165-a39e-41af5330cdb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '045dda1ff9b44334954c08e63fcd20c0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:36:04.749443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-e8091849-4d32-4165-a39e-41af5330cdb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '045dda1ff9b44334954c08e63fcd20c0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:36:05.123098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-e8091849-4d32-4165-a39e-41af5330cdb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '045dda1ff9b44334954c08e63fcd20c0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:36:05.129414 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1268/2515] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:36:04 2021] DELETE /identity/v3/users/045dda1ff9b44334954c08e63fcd20c0 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:36:05.406359 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfcb09-e23f-4474-b5a7-1169479a70c1 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:36:05.422316 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfcb09-e23f-4474-b5a7-1169479a70c1 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:36:05.488955 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316a8f5-663c-46e6-878b-e40b029ab133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:36:05.490783 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316a8f5-663c-46e6-878b-e40b029ab133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:05.490783 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316a8f5-663c-46e6-878b-e40b029ab133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:05.491096 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316a8f5-663c-46e6-878b-e40b029ab133 admin admin] PATH_INFO: `/v3/projects/c51a2093a0874d52a08f6e25489ba181` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:05.492270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316a8f5-663c-46e6-878b-e40b029ab133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51a2093a0874d52a08f6e25489ba181)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:36:05.494371 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316a8f5-663c-46e6-878b-e40b029ab133 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:36:05.618054 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3316a8f5-663c-46e6-878b-e40b029ab133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51a2093a0874d52a08f6e25489ba181', 'request_id': 'req-3316a8f5-663c-46e6-878b-e40b029ab133'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:36:05.696605 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3316a8f5-663c-46e6-878b-e40b029ab133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51a2093a0874d52a08f6e25489ba181', 'request_id': 'req-3316a8f5-663c-46e6-878b-e40b029ab133'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:36:05.702674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3316a8f5-663c-46e6-878b-e40b029ab133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51a2093a0874d52a08f6e25489ba181', 'request_id': 'req-3316a8f5-663c-46e6-878b-e40b029ab133'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:36:05.715207 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3316a8f5-663c-46e6-878b-e40b029ab133 admin admin] The token cache is being invalidate because project c51a2093a0874d52a08f6e25489ba181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:36:05.715480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3316a8f5-663c-46e6-878b-e40b029ab133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:36:05.716141 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3316a8f5-663c-46e6-878b-e40b029ab133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:36:05.717718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1248/2516] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:36:05 2021] DELETE /identity/v3/projects/c51a2093a0874d52a08f6e25489ba181 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:36:05.726089 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000b65e-2077-4d25-b6a4-3ed7ea1a0c73 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:05.726089 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000b65e-2077-4d25-b6a4-3ed7ea1a0c73 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:05.726089 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000b65e-2077-4d25-b6a4-3ed7ea1a0c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:05.745077 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8000b65e-2077-4d25-b6a4-3ed7ea1a0c73 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:36:05.748943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8000b65e-2077-4d25-b6a4-3ed7ea1a0c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:36:05.806875 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1269/2517] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:36:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:36:05.814612 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5da0-5eff-4cb0-b5df-9c637d8d4ad9 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:05.814897 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5da0-5eff-4cb0-b5df-9c637d8d4ad9 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:05.815168 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5da0-5eff-4cb0-b5df-9c637d8d4ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:05.835977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ec6d5da0-5eff-4cb0-b5df-9c637d8d4ad9 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:36:05.837275 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ec6d5da0-5eff-4cb0-b5df-9c637d8d4ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:36:05.846426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1249/2518] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:36:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:36:05.851329 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000b65e-2077-4d25-b6a4-3ed7ea1a0c73 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:36:05.860965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000b65e-2077-4d25-b6a4-3ed7ea1a0c73 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:36:05.865678 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda92b11-0797-4ae2-aeb2-44152ad414aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:36:05.866365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda92b11-0797-4ae2-aeb2-44152ad414aa admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:05.866651 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda92b11-0797-4ae2-aeb2-44152ad414aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:05.866926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda92b11-0797-4ae2-aeb2-44152ad414aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:05.867679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda92b11-0797-4ae2-aeb2-44152ad414aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:36:05.868027 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda92b11-0797-4ae2-aeb2-44152ad414aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:36:05.873466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda92b11-0797-4ae2-aeb2-44152ad414aa admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:36:05.881615 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1270/2519] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:36:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:36:05.885934 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d5da0-5eff-4cb0-b5df-9c637d8d4ad9 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:36:05.895063 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d5da0-5eff-4cb0-b5df-9c637d8d4ad9 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:36:05.900822 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde30193-373f-4fcd-b4d9-54c29d61fed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:36:05.901562 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde30193-373f-4fcd-b4d9-54c29d61fed4 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:05.901835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde30193-373f-4fcd-b4d9-54c29d61fed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:05.902104 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde30193-373f-4fcd-b4d9-54c29d61fed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:05.902878 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde30193-373f-4fcd-b4d9-54c29d61fed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:36:05.905029 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde30193-373f-4fcd-b4d9-54c29d61fed4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:36:06.010258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1250/2520] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:36:05 2021] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:36:06.014381 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda92b11-0797-4ae2-aeb2-44152ad414aa admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:36:06.025650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda92b11-0797-4ae2-aeb2-44152ad414aa admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:36:06.082008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1bd36-5ad5-4fde-8fe7-1c850c5fcfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:36:06.082693 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1bd36-5ad5-4fde-8fe7-1c850c5fcfcc admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:06.082974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1bd36-5ad5-4fde-8fe7-1c850c5fcfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:06.083835 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1bd36-5ad5-4fde-8fe7-1c850c5fcfcc admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:06.084621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1bd36-5ad5-4fde-8fe7-1c850c5fcfcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:36:06.087098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1bd36-5ad5-4fde-8fe7-1c850c5fcfcc admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:36:06.212345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1271/2521] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:36:06 2021] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:36:06.216404 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde30193-373f-4fcd-b4d9-54c29d61fed4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:36:06.226923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde30193-373f-4fcd-b4d9-54c29d61fed4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:36:06.231528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a71ed-0647-44d2-987c-8990da64592f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:36:06.232318 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a71ed-0647-44d2-987c-8990da64592f admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:06.232591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a71ed-0647-44d2-987c-8990da64592f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:06.232872 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a71ed-0647-44d2-987c-8990da64592f admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:06.233618 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a71ed-0647-44d2-987c-8990da64592f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:36:06.235204 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a71ed-0647-44d2-987c-8990da64592f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:36:06.245613 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1251/2522] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:36:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:36:06.249644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1bd36-5ad5-4fde-8fe7-1c850c5fcfcc admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:36:06.260790 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1bd36-5ad5-4fde-8fe7-1c850c5fcfcc admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:36:06.265807 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd25d2c-0fa1-4d5c-9889-265226bbf962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:36:06.266479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd25d2c-0fa1-4d5c-9889-265226bbf962 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:06.266769 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd25d2c-0fa1-4d5c-9889-265226bbf962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:06.267047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd25d2c-0fa1-4d5c-9889-265226bbf962 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:06.267835 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd25d2c-0fa1-4d5c-9889-265226bbf962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:36:06.269434 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd25d2c-0fa1-4d5c-9889-265226bbf962 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:36:06.282069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1272/2523] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:36:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:36:06.286302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a71ed-0647-44d2-987c-8990da64592f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:36:06.296912 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a71ed-0647-44d2-987c-8990da64592f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:36:06.303397 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9359aa-a6ce-49a5-bb28-7ebc105e56a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:36:06.304607 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9359aa-a6ce-49a5-bb28-7ebc105e56a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:06.305170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9359aa-a6ce-49a5-bb28-7ebc105e56a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:06.305517 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9359aa-a6ce-49a5-bb28-7ebc105e56a7 admin admin] PATH_INFO: `/v3/projects/b8778e689b6e42e2b16d49b3fe762ac6/users/3c7b600cfde24de9809afe2b55db97cf/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:06.323066 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9359aa-a6ce-49a5-bb28-7ebc105e56a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8778e689b6e42e2b16d49b3fe762ac6, user_id=3c7b600cfde24de9809afe2b55db97cf, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:36:06.326271 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9359aa-a6ce-49a5-bb28-7ebc105e56a7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:36:06.409246 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1252/2524] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:36:06 2021] PUT /identity/v3/projects/b8778e689b6e42e2b16d49b3fe762ac6/users/3c7b600cfde24de9809afe2b55db97cf/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:36:06.411644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478ae37-c537-4d56-a19f-bb98320f3ab4 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:06.412070 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478ae37-c537-4d56-a19f-bb98320f3ab4 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:06.412482 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478ae37-c537-4d56-a19f-bb98320f3ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:06.431645 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d478ae37-c537-4d56-a19f-bb98320f3ab4 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:36:06.432889 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d478ae37-c537-4d56-a19f-bb98320f3ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:36:06.492268 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1273/2525] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:36:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:36:06.502156 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9359aa-a6ce-49a5-bb28-7ebc105e56a7 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:36:06.503883 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ae9359aa-a6ce-49a5-bb28-7ebc105e56a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:36:06.559181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9359aa-a6ce-49a5-bb28-7ebc105e56a7 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:36:06.562828 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a493a5-4ca9-428b-8d55-b7001d579234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:36:06.563465 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a493a5-4ca9-428b-8d55-b7001d579234 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:06.563771 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a493a5-4ca9-428b-8d55-b7001d579234 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:06.564051 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a493a5-4ca9-428b-8d55-b7001d579234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:06.573684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a493a5-4ca9-428b-8d55-b7001d579234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:36:06.575087 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a493a5-4ca9-428b-8d55-b7001d579234 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:36:06.584688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1253/2526] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:36:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:36:08.262462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae82573-8e2b-40f9-ab95-eae51b2619f2 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:08.263062 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae82573-8e2b-40f9-ab95-eae51b2619f2 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:08.263062 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae82573-8e2b-40f9-ab95-eae51b2619f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:08.291555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-3ae82573-8e2b-40f9-ab95-eae51b2619f2 None None] MFA Rules not processed for user `3c7b600cfde24de9809afe2b55db97cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:36:08.292811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3ae82573-8e2b-40f9-ab95-eae51b2619f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:36:08.358342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1274/2527] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:36:08 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:36:08.371322 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a862c-c12c-44bf-b3b3-edba76e4d56e None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:08.371942 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a862c-c12c-44bf-b3b3-edba76e4d56e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:08.371942 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a862c-c12c-44bf-b3b3-edba76e4d56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:08.389732 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-6e2a862c-c12c-44bf-b3b3-edba76e4d56e None None] MFA Rules not processed for user `3c7b600cfde24de9809afe2b55db97cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:36:08.391124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6e2a862c-c12c-44bf-b3b3-edba76e4d56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:36:08.398699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1254/2528] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:36:08 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:36:08.409687 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae82573-8e2b-40f9-ab95-eae51b2619f2 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:36:08.411056 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3ae82573-8e2b-40f9-ab95-eae51b2619f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:36:08.480791 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae82573-8e2b-40f9-ab95-eae51b2619f2 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:36:08.486322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412327a-627c-4471-a557-5300333afeb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:36:08.486962 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412327a-627c-4471-a557-5300333afeb1 service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:08.487240 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412327a-627c-4471-a557-5300333afeb1 service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:08.487512 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412327a-627c-4471-a557-5300333afeb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:08.495412 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412327a-627c-4471-a557-5300333afeb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:36:08.497002 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412327a-627c-4471-a557-5300333afeb1 service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:36:08.505510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1275/2529] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:36:08 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:36:13.060801 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeccdb-3f1f-4333-bfb1-762debb04f37 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:13.061320 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeccdb-3f1f-4333-bfb1-762debb04f37 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:13.061320 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeccdb-3f1f-4333-bfb1-762debb04f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:13.081501 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-3cdeccdb-3f1f-4333-bfb1-762debb04f37 None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:36:13.082704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3cdeccdb-3f1f-4333-bfb1-762debb04f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:36:13.144278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1255/2530] 10.222.0.87 () {58 vars in 967 bytes} [Fri Oct 29 01:36:13 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:36:13.159577 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412327a-627c-4471-a557-5300333afeb1 service nova] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:36:13.161364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a412327a-627c-4471-a557-5300333afeb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:36:13.252353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412327a-627c-4471-a557-5300333afeb1 service nova] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:36:13.258120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1698cdb-b0c9-4bf6-9ca8-3e0546b7a958 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:36:13.258872 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1698cdb-b0c9-4bf6-9ca8-3e0546b7a958 service swift] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:13.259110 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1698cdb-b0c9-4bf6-9ca8-3e0546b7a958 service swift] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:13.259398 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1698cdb-b0c9-4bf6-9ca8-3e0546b7a958 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:13.269005 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1698cdb-b0c9-4bf6-9ca8-3e0546b7a958 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:36:13.272160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1698cdb-b0c9-4bf6-9ca8-3e0546b7a958 service swift] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:36:13.282009 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1276/2531] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:36:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 01:36:22.716985 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdeccdb-3f1f-4333-bfb1-762debb04f37 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:36:22.727277 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdeccdb-3f1f-4333-bfb1-762debb04f37 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:36:22.731385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a31623-0ca6-49a5-8018-f8b22ffe33fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:36:22.732080 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a31623-0ca6-49a5-8018-f8b22ffe33fe service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:22.732600 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a31623-0ca6-49a5-8018-f8b22ffe33fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:22.732820 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a31623-0ca6-49a5-8018-f8b22ffe33fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:22.734691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-06a31623-0ca6-49a5-8018-f8b22ffe33fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:36:22.745980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a31623-0ca6-49a5-8018-f8b22ffe33fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:36:22.747318 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a31623-0ca6-49a5-8018-f8b22ffe33fe service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:36:22.755700 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1256/2532] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:36:22 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:36:32.749302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a840b4c-0ea3-4410-b73d-cbd1a201af76 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:32.749921 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a840b4c-0ea3-4410-b73d-cbd1a201af76 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:32.750071 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a840b4c-0ea3-4410-b73d-cbd1a201af76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:32.770155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8a840b4c-0ea3-4410-b73d-cbd1a201af76 None None] MFA Rules not processed for user `3c7b600cfde24de9809afe2b55db97cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:36:32.771385 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8a840b4c-0ea3-4410-b73d-cbd1a201af76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:36:32.778440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1277/2533] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:36:32 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:36:41.047358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c057d2f-f0e1-43b7-ab7e-c382c37315b9 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:41.047941 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c057d2f-f0e1-43b7-ab7e-c382c37315b9 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:41.048053 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c057d2f-f0e1-43b7-ab7e-c382c37315b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:41.066588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-3c057d2f-f0e1-43b7-ab7e-c382c37315b9 None None] MFA Rules not processed for user `bef8571ef39b4efe8f510a28052e2b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:36:41.067884 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3c057d2f-f0e1-43b7-ab7e-c382c37315b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:36:41.123014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1257/2534] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:36:41 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:36:47.928555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68ba42-6398-4ba6-a123-60bc8e91885d None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:36:47.929207 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68ba42-6398-4ba6-a123-60bc8e91885d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:36:47.929207 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68ba42-6398-4ba6-a123-60bc8e91885d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:36:47.949031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-ee68ba42-6398-4ba6-a123-60bc8e91885d None None] MFA Rules not processed for user `3c7b600cfde24de9809afe2b55db97cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:36:47.950234 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-ee68ba42-6398-4ba6-a123-60bc8e91885d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:36:47.961309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1278/2535] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:36:47 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:14.733499 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c057d2f-f0e1-43b7-ab7e-c382c37315b9 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:14.734925 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3c057d2f-f0e1-43b7-ab7e-c382c37315b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:14.747383 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c057d2f-f0e1-43b7-ab7e-c382c37315b9 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:14.751078 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8df04-05ec-4035-a052-956b41059e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:14.751773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8df04-05ec-4035-a052-956b41059e2b service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:14.752056 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8df04-05ec-4035-a052-956b41059e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:14.752327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8df04-05ec-4035-a052-956b41059e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:14.754104 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c1a8df04-05ec-4035-a052-956b41059e2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:14.766959 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8df04-05ec-4035-a052-956b41059e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:14.768418 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8df04-05ec-4035-a052-956b41059e2b service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:14.778178 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1258/2536] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:37:18.558143 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68ba42-6398-4ba6-a123-60bc8e91885d None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:18.564869 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-ee68ba42-6398-4ba6-a123-60bc8e91885d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:18.667359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68ba42-6398-4ba6-a123-60bc8e91885d None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:18.675177 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a4e06-0c4b-4850-a6f2-8601ef3eb117 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa303a60fec4ac5aaeb96c6618b387e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:18.676375 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a4e06-0c4b-4850-a6f2-8601ef3eb117 service placement] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:18.676854 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a4e06-0c4b-4850-a6f2-8601ef3eb117 service placement] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:18.677332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a4e06-0c4b-4850-a6f2-8601ef3eb117 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:18.680294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-699a4e06-0c4b-4850-a6f2-8601ef3eb117 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:18.701206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a4e06-0c4b-4850-a6f2-8601ef3eb117 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:18.704082 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a4e06-0c4b-4850-a6f2-8601ef3eb117 service placement] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:18.726957 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1279/2537] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:18 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:37:19.116302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8df04-05ec-4035-a052-956b41059e2b service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:19.117924 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c1a8df04-05ec-4035-a052-956b41059e2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:19.134636 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8df04-05ec-4035-a052-956b41059e2b service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:19.141105 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68488d99-fd58-40d8-9d12-6f7ff652dc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:19.141975 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68488d99-fd58-40d8-9d12-6f7ff652dc42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:19.142547 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68488d99-fd58-40d8-9d12-6f7ff652dc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:19.142826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68488d99-fd58-40d8-9d12-6f7ff652dc42 admin admin] PATH_INFO: `/v3/users/78823bdcff4e45d8ab82558b434f188d` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:19.144153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68488d99-fd58-40d8-9d12-6f7ff652dc42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78823bdcff4e45d8ab82558b434f188d)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:19.147216 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68488d99-fd58-40d8-9d12-6f7ff652dc42 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:19.436134 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-68488d99-fd58-40d8-9d12-6f7ff652dc42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78823bdcff4e45d8ab82558b434f188d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:19.444018 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-68488d99-fd58-40d8-9d12-6f7ff652dc42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78823bdcff4e45d8ab82558b434f188d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:19.444715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-68488d99-fd58-40d8-9d12-6f7ff652dc42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78823bdcff4e45d8ab82558b434f188d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:19.456521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-68488d99-fd58-40d8-9d12-6f7ff652dc42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78823bdcff4e45d8ab82558b434f188d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:19.535072 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-68488d99-fd58-40d8-9d12-6f7ff652dc42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78823bdcff4e45d8ab82558b434f188d'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:19.541494 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1259/2538] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:37:19 2021] DELETE /identity/v3/users/78823bdcff4e45d8ab82558b434f188d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:19.740985 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad442f-dd2a-4e53-ab2d-af30973b0a92 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:19.744404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad442f-dd2a-4e53-ab2d-af30973b0a92 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:19.744404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad442f-dd2a-4e53-ab2d-af30973b0a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:19.759860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-bdad442f-dd2a-4e53-ab2d-af30973b0a92 None None] MFA Rules not processed for user `3c7b600cfde24de9809afe2b55db97cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:19.761120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-bdad442f-dd2a-4e53-ab2d-af30973b0a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:19.808173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68488d99-fd58-40d8-9d12-6f7ff652dc42 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:19.810070 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-68488d99-fd58-40d8-9d12-6f7ff652dc42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:19.820122 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1280/2539] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:19 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:37:19.914435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68488d99-fd58-40d8-9d12-6f7ff652dc42 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:19.920001 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69feab9-e7ca-4a17-a235-2c85100b1214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:19.920868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69feab9-e7ca-4a17-a235-2c85100b1214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:19.921145 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69feab9-e7ca-4a17-a235-2c85100b1214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:19.921507 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69feab9-e7ca-4a17-a235-2c85100b1214 admin admin] PATH_INFO: `/v3/projects/413ce1a7d8504d0b9f656d9e623f9005` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:19.922762 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69feab9-e7ca-4a17-a235-2c85100b1214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=413ce1a7d8504d0b9f656d9e623f9005)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:19.924720 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69feab9-e7ca-4a17-a235-2c85100b1214 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:20.070467 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-c69feab9-e7ca-4a17-a235-2c85100b1214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413ce1a7d8504d0b9f656d9e623f9005', 'request_id': 'req-c69feab9-e7ca-4a17-a235-2c85100b1214'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:20.208565 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-c69feab9-e7ca-4a17-a235-2c85100b1214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413ce1a7d8504d0b9f656d9e623f9005', 'request_id': 'req-c69feab9-e7ca-4a17-a235-2c85100b1214'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:20.214576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-c69feab9-e7ca-4a17-a235-2c85100b1214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413ce1a7d8504d0b9f656d9e623f9005', 'request_id': 'req-c69feab9-e7ca-4a17-a235-2c85100b1214'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:20.226898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-c69feab9-e7ca-4a17-a235-2c85100b1214 admin admin] The token cache is being invalidate because project 413ce1a7d8504d0b9f656d9e623f9005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:37:20.227181 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-c69feab9-e7ca-4a17-a235-2c85100b1214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:20.227845 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-c69feab9-e7ca-4a17-a235-2c85100b1214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:20.229366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1260/2540] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:37:19 2021] DELETE /identity/v3/projects/413ce1a7d8504d0b9f656d9e623f9005 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:37:20.235478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41254e-0ace-498b-80fb-e8cc3eee4dff None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:20.236026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41254e-0ace-498b-80fb-e8cc3eee4dff None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:20.236752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41254e-0ace-498b-80fb-e8cc3eee4dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:20.263953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8d41254e-0ace-498b-80fb-e8cc3eee4dff None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:20.265940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8d41254e-0ace-498b-80fb-e8cc3eee4dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:20.363778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1281/2541] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:37:20.367478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6775b5-3246-419e-b2e9-b468ae0e3b12 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:20.367786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6775b5-3246-419e-b2e9-b468ae0e3b12 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:20.368091 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6775b5-3246-419e-b2e9-b468ae0e3b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:20.388056 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-5e6775b5-3246-419e-b2e9-b468ae0e3b12 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:20.389266 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-5e6775b5-3246-419e-b2e9-b468ae0e3b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:20.398365 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1261/2542] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:20.402840 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41254e-0ace-498b-80fb-e8cc3eee4dff None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:20.413111 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41254e-0ace-498b-80fb-e8cc3eee4dff None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:20.418043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaa7ea-abf5-482c-9a7d-f119b211320f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:20.418793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaa7ea-abf5-482c-9a7d-f119b211320f admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:20.419072 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaa7ea-abf5-482c-9a7d-f119b211320f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:20.419363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaa7ea-abf5-482c-9a7d-f119b211320f admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:20.420239 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaa7ea-abf5-482c-9a7d-f119b211320f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:37:20.422253 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaa7ea-abf5-482c-9a7d-f119b211320f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:20.422253 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaa7ea-abf5-482c-9a7d-f119b211320f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:20.435093 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1282/2543] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:37:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:37:20.439957 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6775b5-3246-419e-b2e9-b468ae0e3b12 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:20.450826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6775b5-3246-419e-b2e9-b468ae0e3b12 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:20.456010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fda0d9-c428-4aae-ab08-f5c089ab8160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:20.456690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fda0d9-c428-4aae-ab08-f5c089ab8160 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:20.456965 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fda0d9-c428-4aae-ab08-f5c089ab8160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:20.457231 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fda0d9-c428-4aae-ab08-f5c089ab8160 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:20.459033 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fda0d9-c428-4aae-ab08-f5c089ab8160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:20.461009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fda0d9-c428-4aae-ab08-f5c089ab8160 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:20.561056 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1262/2544] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:37:20 2021] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:37:20.565133 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaa7ea-abf5-482c-9a7d-f119b211320f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:20.576042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaa7ea-abf5-482c-9a7d-f119b211320f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:20.659336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6340-d885-4f76-9d0c-6dd9ea623443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:20.660060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6340-d885-4f76-9d0c-6dd9ea623443 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:20.660343 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6340-d885-4f76-9d0c-6dd9ea623443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:20.660672 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6340-d885-4f76-9d0c-6dd9ea623443 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:20.661805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a6340-d885-4f76-9d0c-6dd9ea623443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:20.664411 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a6340-d885-4f76-9d0c-6dd9ea623443 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:20.773294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1283/2545] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:37:20 2021] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:37:20.777573 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fda0d9-c428-4aae-ab08-f5c089ab8160 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:20.788874 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fda0d9-c428-4aae-ab08-f5c089ab8160 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:20.794009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099ef12-b0fd-4e8d-aa65-f102744d14b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:20.794781 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099ef12-b0fd-4e8d-aa65-f102744d14b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:20.795119 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099ef12-b0fd-4e8d-aa65-f102744d14b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:20.795449 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099ef12-b0fd-4e8d-aa65-f102744d14b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:20.797888 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099ef12-b0fd-4e8d-aa65-f102744d14b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:20.798276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099ef12-b0fd-4e8d-aa65-f102744d14b5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:20.811929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1263/2546] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:20 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:20.816765 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6340-d885-4f76-9d0c-6dd9ea623443 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:20.829126 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6340-d885-4f76-9d0c-6dd9ea623443 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:20.835813 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41889eaf-274d-49cb-b1a8-2e2a0eb3151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:20.836827 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41889eaf-274d-49cb-b1a8-2e2a0eb3151e admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:20.837117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41889eaf-274d-49cb-b1a8-2e2a0eb3151e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:20.837388 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41889eaf-274d-49cb-b1a8-2e2a0eb3151e admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:20.838339 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41889eaf-274d-49cb-b1a8-2e2a0eb3151e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:20.840224 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41889eaf-274d-49cb-b1a8-2e2a0eb3151e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:20.853560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1284/2547] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:20 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:20.858048 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099ef12-b0fd-4e8d-aa65-f102744d14b5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:20.879014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099ef12-b0fd-4e8d-aa65-f102744d14b5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:20.885281 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33471c-27f9-41e1-bf3f-7f4d6583ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:20.886171 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33471c-27f9-41e1-bf3f-7f4d6583ab92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:20.886452 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33471c-27f9-41e1-bf3f-7f4d6583ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:20.886726 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33471c-27f9-41e1-bf3f-7f4d6583ab92 admin admin] PATH_INFO: `/v3/projects/2bb108b588ea4deb8b655020e1e6950a/users/70cc6573c4414145b0e42626399f6039/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:20.903868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33471c-27f9-41e1-bf3f-7f4d6583ab92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb108b588ea4deb8b655020e1e6950a, user_id=70cc6573c4414145b0e42626399f6039, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:20.906634 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33471c-27f9-41e1-bf3f-7f4d6583ab92 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:21.033129 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1264/2548] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:20 2021] PUT /identity/v3/projects/2bb108b588ea4deb8b655020e1e6950a/users/70cc6573c4414145b0e42626399f6039/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:21.044606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61dce8-4602-404e-886e-de5e05358a0a None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:21.044797 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61dce8-4602-404e-886e-de5e05358a0a None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:21.045047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61dce8-4602-404e-886e-de5e05358a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:21.075411 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-4c61dce8-4602-404e-886e-de5e05358a0a None None] MFA Rules not processed for user `70cc6573c4414145b0e42626399f6039`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:21.076748 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4c61dce8-4602-404e-886e-de5e05358a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:21.148083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1285/2549] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:21 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:21.152865 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33471c-27f9-41e1-bf3f-7f4d6583ab92 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:21.214605 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33471c-27f9-41e1-bf3f-7f4d6583ab92 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:21.219707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c1e83-c703-4973-98e5-b2fbc926f8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:21.220426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c1e83-c703-4973-98e5-b2fbc926f8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:21.220730 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c1e83-c703-4973-98e5-b2fbc926f8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:21.221007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c1e83-c703-4973-98e5-b2fbc926f8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:21.221758 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c1e83-c703-4973-98e5-b2fbc926f8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:21.224780 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c1e83-c703-4973-98e5-b2fbc926f8f6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:21.435006 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1265/2550] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:37:21 2021] POST /identity/v3/projects => generated 381 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:21.439152 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61dce8-4602-404e-886e-de5e05358a0a None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:21.450192 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61dce8-4602-404e-886e-de5e05358a0a None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:21.506495 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233399f3-9e27-4460-82fa-6d22ce6472b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:21.507201 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233399f3-9e27-4460-82fa-6d22ce6472b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:21.507480 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233399f3-9e27-4460-82fa-6d22ce6472b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:21.507777 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233399f3-9e27-4460-82fa-6d22ce6472b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:21.508490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233399f3-9e27-4460-82fa-6d22ce6472b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:21.510423 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233399f3-9e27-4460-82fa-6d22ce6472b8 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:21.608355 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1286/2551] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:37:21 2021] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:21.612462 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c1e83-c703-4973-98e5-b2fbc926f8f6 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:21.622958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c1e83-c703-4973-98e5-b2fbc926f8f6 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:21.627702 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ceb440-e607-4a52-a769-3fe6ccc50918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:21.628383 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ceb440-e607-4a52-a769-3fe6ccc50918 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:21.628667 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ceb440-e607-4a52-a769-3fe6ccc50918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:21.628936 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ceb440-e607-4a52-a769-3fe6ccc50918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:21.629695 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ceb440-e607-4a52-a769-3fe6ccc50918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:21.631282 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ceb440-e607-4a52-a769-3fe6ccc50918 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:21.641946 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1266/2552] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:21.651849 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233399f3-9e27-4460-82fa-6d22ce6472b8 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:21.664046 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233399f3-9e27-4460-82fa-6d22ce6472b8 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:21.668984 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d185f31-20d7-41e5-b8fa-943cfa57683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:21.674595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d185f31-20d7-41e5-b8fa-943cfa57683e admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:21.674595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d185f31-20d7-41e5-b8fa-943cfa57683e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:21.674595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d185f31-20d7-41e5-b8fa-943cfa57683e admin admin] PATH_INFO: `/v3/projects/8d28724b2adc4ccbbcd50d5d3d99cb20/users/d94425032f2140d6a0868dad86cccae5/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:21.687947 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d185f31-20d7-41e5-b8fa-943cfa57683e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d28724b2adc4ccbbcd50d5d3d99cb20, user_id=d94425032f2140d6a0868dad86cccae5, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:21.693409 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d185f31-20d7-41e5-b8fa-943cfa57683e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:21.801826 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1287/2553] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:21 2021] PUT /identity/v3/projects/8d28724b2adc4ccbbcd50d5d3d99cb20/users/d94425032f2140d6a0868dad86cccae5/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:21.806008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ceb440-e607-4a52-a769-3fe6ccc50918 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:21.816317 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ceb440-e607-4a52-a769-3fe6ccc50918 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:21.874411 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534851fa-4a22-4c0a-92ee-dbf8d3eb09a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:21.875085 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534851fa-4a22-4c0a-92ee-dbf8d3eb09a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:21.875367 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534851fa-4a22-4c0a-92ee-dbf8d3eb09a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:21.875636 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534851fa-4a22-4c0a-92ee-dbf8d3eb09a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:21.876411 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534851fa-4a22-4c0a-92ee-dbf8d3eb09a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:21.877996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534851fa-4a22-4c0a-92ee-dbf8d3eb09a7 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:21.888735 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1267/2554] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:21 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:21.893241 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d185f31-20d7-41e5-b8fa-943cfa57683e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:21.905396 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d185f31-20d7-41e5-b8fa-943cfa57683e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:21.910113 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6020dd-3beb-49a1-b4d9-148f35edcf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:21.911540 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6020dd-3beb-49a1-b4d9-148f35edcf57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:21.911864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6020dd-3beb-49a1-b4d9-148f35edcf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:21.912150 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6020dd-3beb-49a1-b4d9-148f35edcf57 admin admin] PATH_INFO: `/v3/projects/8d28724b2adc4ccbbcd50d5d3d99cb20/users/d94425032f2140d6a0868dad86cccae5/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:21.914236 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6020dd-3beb-49a1-b4d9-148f35edcf57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d28724b2adc4ccbbcd50d5d3d99cb20, user_id=d94425032f2140d6a0868dad86cccae5, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:21.916942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6020dd-3beb-49a1-b4d9-148f35edcf57 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:21.929582 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1288/2555] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:21 2021] PUT /identity/v3/projects/8d28724b2adc4ccbbcd50d5d3d99cb20/users/d94425032f2140d6a0868dad86cccae5/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:21.942809 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dc59d-a2ef-4407-ad30-0b1648f3b979 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:21.943000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dc59d-a2ef-4407-ad30-0b1648f3b979 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:21.943272 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dc59d-a2ef-4407-ad30-0b1648f3b979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:21.972699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-3b8dc59d-a2ef-4407-ad30-0b1648f3b979 None None] MFA Rules not processed for user `d94425032f2140d6a0868dad86cccae5`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:21.974732 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3b8dc59d-a2ef-4407-ad30-0b1648f3b979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:22.046952 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1268/2556] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:21 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:22.052778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6020dd-3beb-49a1-b4d9-148f35edcf57 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:22.114381 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6020dd-3beb-49a1-b4d9-148f35edcf57 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:22.119264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6386e3-60ca-42e4-a4a1-ce3d286cc8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:22.120361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6386e3-60ca-42e4-a4a1-ce3d286cc8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:22.120851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6386e3-60ca-42e4-a4a1-ce3d286cc8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:22.121131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6386e3-60ca-42e4-a4a1-ce3d286cc8cd admin admin] PATH_INFO: `/v3/users/70cc6573c4414145b0e42626399f6039` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:22.122377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6386e3-60ca-42e4-a4a1-ce3d286cc8cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=70cc6573c4414145b0e42626399f6039)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:22.124325 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6386e3-60ca-42e4-a4a1-ce3d286cc8cd admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:22.330265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3d6386e3-60ca-42e4-a4a1-ce3d286cc8cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70cc6573c4414145b0e42626399f6039'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:22.330931 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3d6386e3-60ca-42e4-a4a1-ce3d286cc8cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70cc6573c4414145b0e42626399f6039'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:22.348857 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3d6386e3-60ca-42e4-a4a1-ce3d286cc8cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70cc6573c4414145b0e42626399f6039'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:22.356592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3d6386e3-60ca-42e4-a4a1-ce3d286cc8cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70cc6573c4414145b0e42626399f6039'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:22.427320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3d6386e3-60ca-42e4-a4a1-ce3d286cc8cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70cc6573c4414145b0e42626399f6039'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:22.433993 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1289/2557] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:37:22 2021] DELETE /identity/v3/users/70cc6573c4414145b0e42626399f6039 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:22.438669 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3b09-46cc-40cb-9c58-9426bf893543 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:22.439211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3b09-46cc-40cb-9c58-9426bf893543 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:22.439211 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3b09-46cc-40cb-9c58-9426bf893543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:22.458202 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-aabe3b09-46cc-40cb-9c58-9426bf893543 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:22.459366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-aabe3b09-46cc-40cb-9c58-9426bf893543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:22.518674 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1269/2558] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:22.529030 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6386e3-60ca-42e4-a4a1-ce3d286cc8cd admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:22.530447 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3d6386e3-60ca-42e4-a4a1-ce3d286cc8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:22.589685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6386e3-60ca-42e4-a4a1-ce3d286cc8cd admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:22.593288 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc9691-523b-44cb-9221-74a2dd456c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:22.593939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc9691-523b-44cb-9221-74a2dd456c8f service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:22.594218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc9691-523b-44cb-9221-74a2dd456c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:22.594485 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc9691-523b-44cb-9221-74a2dd456c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:22.604530 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc9691-523b-44cb-9221-74a2dd456c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:22.605974 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc9691-523b-44cb-9221-74a2dd456c8f service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:22.617232 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1290/2559] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:37:23.144635 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe3b09-46cc-40cb-9c58-9426bf893543 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:23.146704 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-aabe3b09-46cc-40cb-9c58-9426bf893543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:23.159036 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe3b09-46cc-40cb-9c58-9426bf893543 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:23.165148 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:23.166012 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:23.166294 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:23.166568 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] PATH_INFO: `/v3/projects/2bb108b588ea4deb8b655020e1e6950a` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:23.167834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb108b588ea4deb8b655020e1e6950a)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:23.169722 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:23.282821 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb108b588ea4deb8b655020e1e6950a', 'request_id': 'req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:23.398350 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb108b588ea4deb8b655020e1e6950a', 'request_id': 'req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:23.408087 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb108b588ea4deb8b655020e1e6950a', 'request_id': 'req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:23.422824 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] The token cache is being invalidate because project 2bb108b588ea4deb8b655020e1e6950a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:37:23.423115 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:23.424812 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:23.429397 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1270/2560] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:37:23 2021] DELETE /identity/v3/projects/2bb108b588ea4deb8b655020e1e6950a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:23.433650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc9691-523b-44cb-9221-74a2dd456c8f service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:23.445215 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc9691-523b-44cb-9221-74a2dd456c8f service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:23.514248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c501f69-75d9-4ac1-be53-a1bf2cbea888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:23.516642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501f69-75d9-4ac1-be53-a1bf2cbea888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:23.516642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501f69-75d9-4ac1-be53-a1bf2cbea888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:23.516642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501f69-75d9-4ac1-be53-a1bf2cbea888 admin admin] PATH_INFO: `/v3/users/d94425032f2140d6a0868dad86cccae5` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:23.517753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c501f69-75d9-4ac1-be53-a1bf2cbea888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94425032f2140d6a0868dad86cccae5)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:23.519159 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c501f69-75d9-4ac1-be53-a1bf2cbea888 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:23.726785 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3c501f69-75d9-4ac1-be53-a1bf2cbea888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94425032f2140d6a0868dad86cccae5'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:23.727886 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3c501f69-75d9-4ac1-be53-a1bf2cbea888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94425032f2140d6a0868dad86cccae5'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:23.740686 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3c501f69-75d9-4ac1-be53-a1bf2cbea888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94425032f2140d6a0868dad86cccae5'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:23.748102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3c501f69-75d9-4ac1-be53-a1bf2cbea888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94425032f2140d6a0868dad86cccae5'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:23.830510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-3c501f69-75d9-4ac1-be53-a1bf2cbea888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94425032f2140d6a0868dad86cccae5'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:23.837933 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1291/2561] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:37:23 2021] DELETE /identity/v3/users/d94425032f2140d6a0868dad86cccae5 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:24.352643 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:24.354977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:24.387810 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2655fd-dd8d-4b93-a43f-cea62599a7d3 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:24.501336 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a975c53-7d9f-423a-9861-be743a2b021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:24.502931 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975c53-7d9f-423a-9861-be743a2b021e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:24.503218 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975c53-7d9f-423a-9861-be743a2b021e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:24.503498 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975c53-7d9f-423a-9861-be743a2b021e admin admin] PATH_INFO: `/v3/projects/8d28724b2adc4ccbbcd50d5d3d99cb20` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:24.505873 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a975c53-7d9f-423a-9861-be743a2b021e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d28724b2adc4ccbbcd50d5d3d99cb20)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:24.507834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a975c53-7d9f-423a-9861-be743a2b021e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:24.662239 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3a975c53-7d9f-423a-9861-be743a2b021e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d28724b2adc4ccbbcd50d5d3d99cb20', 'request_id': 'req-3a975c53-7d9f-423a-9861-be743a2b021e'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:24.815919 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3a975c53-7d9f-423a-9861-be743a2b021e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d28724b2adc4ccbbcd50d5d3d99cb20', 'request_id': 'req-3a975c53-7d9f-423a-9861-be743a2b021e'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:24.827150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3a975c53-7d9f-423a-9861-be743a2b021e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d28724b2adc4ccbbcd50d5d3d99cb20', 'request_id': 'req-3a975c53-7d9f-423a-9861-be743a2b021e'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:24.844271 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3a975c53-7d9f-423a-9861-be743a2b021e admin admin] The token cache is being invalidate because project 8d28724b2adc4ccbbcd50d5d3d99cb20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:37:24.844806 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3a975c53-7d9f-423a-9861-be743a2b021e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:24.845733 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3a975c53-7d9f-423a-9861-be743a2b021e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:24.847712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1271/2562] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:37:24 2021] DELETE /identity/v3/projects/8d28724b2adc4ccbbcd50d5d3d99cb20 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:24.854046 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739caf57-2fad-47cf-bf22-bf0cb4500376 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:24.854831 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739caf57-2fad-47cf-bf22-bf0cb4500376 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:24.854831 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739caf57-2fad-47cf-bf22-bf0cb4500376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:24.890006 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-739caf57-2fad-47cf-bf22-bf0cb4500376 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:24.893978 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-739caf57-2fad-47cf-bf22-bf0cb4500376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:24.985114 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1292/2563] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:24.994558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a05f-0fa3-4e97-85d3-84f1e50dfb6a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:24.994944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a05f-0fa3-4e97-85d3-84f1e50dfb6a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:24.995264 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a05f-0fa3-4e97-85d3-84f1e50dfb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:25.019371 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-af17a05f-0fa3-4e97-85d3-84f1e50dfb6a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:25.021401 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-af17a05f-0fa3-4e97-85d3-84f1e50dfb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:25.030555 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1272/2564] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:25.035096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739caf57-2fad-47cf-bf22-bf0cb4500376 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:25.046194 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739caf57-2fad-47cf-bf22-bf0cb4500376 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:25.051827 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3118f5b-37f5-497d-be12-74cef78b6ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:25.052861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118f5b-37f5-497d-be12-74cef78b6ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:25.053137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118f5b-37f5-497d-be12-74cef78b6ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:25.053620 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118f5b-37f5-497d-be12-74cef78b6ce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:25.054440 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3118f5b-37f5-497d-be12-74cef78b6ce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:37:25.054806 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3118f5b-37f5-497d-be12-74cef78b6ce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:25.056572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3118f5b-37f5-497d-be12-74cef78b6ce9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:25.071310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1293/2565] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:37:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:37:25.076038 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17a05f-0fa3-4e97-85d3-84f1e50dfb6a None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:25.087864 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17a05f-0fa3-4e97-85d3-84f1e50dfb6a None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:25.094754 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29fee0-002a-49e6-b1cc-704ac03a5d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:25.095437 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29fee0-002a-49e6-b1cc-704ac03a5d43 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:25.095814 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29fee0-002a-49e6-b1cc-704ac03a5d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:25.096910 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29fee0-002a-49e6-b1cc-704ac03a5d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:25.096910 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29fee0-002a-49e6-b1cc-704ac03a5d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:25.099799 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29fee0-002a-49e6-b1cc-704ac03a5d43 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:25.212364 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1273/2566] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:37:25 2021] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:25.218201 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3118f5b-37f5-497d-be12-74cef78b6ce9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:25.230599 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3118f5b-37f5-497d-be12-74cef78b6ce9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:25.302069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4dfbc-9b71-49c6-9b3b-dd165ce9be10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:25.307029 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4dfbc-9b71-49c6-9b3b-dd165ce9be10 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:25.307029 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4dfbc-9b71-49c6-9b3b-dd165ce9be10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:25.307029 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4dfbc-9b71-49c6-9b3b-dd165ce9be10 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:25.307029 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4dfbc-9b71-49c6-9b3b-dd165ce9be10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:25.307029 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4dfbc-9b71-49c6-9b3b-dd165ce9be10 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:25.413915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1294/2567] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:37:25 2021] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:37:25.415663 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29fee0-002a-49e6-b1cc-704ac03a5d43 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:25.431423 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29fee0-002a-49e6-b1cc-704ac03a5d43 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:25.438867 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aedffc-bd5b-4535-97dc-7e66825226fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:25.440185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aedffc-bd5b-4535-97dc-7e66825226fe admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:25.440702 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aedffc-bd5b-4535-97dc-7e66825226fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:25.441276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aedffc-bd5b-4535-97dc-7e66825226fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:25.442478 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aedffc-bd5b-4535-97dc-7e66825226fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:25.445031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aedffc-bd5b-4535-97dc-7e66825226fe admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:25.464500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1274/2568] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:25 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:25.469226 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4dfbc-9b71-49c6-9b3b-dd165ce9be10 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:25.487184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4dfbc-9b71-49c6-9b3b-dd165ce9be10 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:25.498842 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a89da-55ca-4ff2-beb9-34e84d196daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:25.499962 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a89da-55ca-4ff2-beb9-34e84d196daf admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:25.500420 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a89da-55ca-4ff2-beb9-34e84d196daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:25.501225 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a89da-55ca-4ff2-beb9-34e84d196daf admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:25.501951 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a89da-55ca-4ff2-beb9-34e84d196daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:25.503948 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a89da-55ca-4ff2-beb9-34e84d196daf admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:25.517007 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1295/2569] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:25 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:25.522297 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aedffc-bd5b-4535-97dc-7e66825226fe admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:25.536274 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aedffc-bd5b-4535-97dc-7e66825226fe admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:25.544402 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad787b-076c-44c8-ac23-5db7054532e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:25.545770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad787b-076c-44c8-ac23-5db7054532e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:25.546205 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad787b-076c-44c8-ac23-5db7054532e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:25.546653 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad787b-076c-44c8-ac23-5db7054532e8 admin admin] PATH_INFO: `/v3/projects/8d1cc053e35149e8896546a37423b938/users/0a1bc4a70287468e9815bd70d926b045/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:25.571446 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad787b-076c-44c8-ac23-5db7054532e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1cc053e35149e8896546a37423b938, user_id=0a1bc4a70287468e9815bd70d926b045, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:25.576368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad787b-076c-44c8-ac23-5db7054532e8 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:25.663166 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1275/2570] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:25 2021] PUT /identity/v3/projects/8d1cc053e35149e8896546a37423b938/users/0a1bc4a70287468e9815bd70d926b045/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:37:25.674904 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e897a-0784-4615-ad64-e2ca9f05aae5 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:25.675244 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e897a-0784-4615-ad64-e2ca9f05aae5 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:25.675529 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e897a-0784-4615-ad64-e2ca9f05aae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:25.708742 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-902e897a-0784-4615-ad64-e2ca9f05aae5 None None] MFA Rules not processed for user `0a1bc4a70287468e9815bd70d926b045`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:25.710869 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-902e897a-0784-4615-ad64-e2ca9f05aae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:25.783221 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1296/2571] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:25 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:37:25.789184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad787b-076c-44c8-ac23-5db7054532e8 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:25.856770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad787b-076c-44c8-ac23-5db7054532e8 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:25.861918 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6e234-d1e8-4616-8d15-134788fe6003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:25.862599 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6e234-d1e8-4616-8d15-134788fe6003 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:25.863035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6e234-d1e8-4616-8d15-134788fe6003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:25.863200 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6e234-d1e8-4616-8d15-134788fe6003 admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:25.864533 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6e234-d1e8-4616-8d15-134788fe6003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:25.871875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6e234-d1e8-4616-8d15-134788fe6003 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:25.987057 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1276/2572] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:37:25 2021] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:37:25.994646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e897a-0784-4615-ad64-e2ca9f05aae5 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:26.013180 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e897a-0784-4615-ad64-e2ca9f05aae5 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:26.104468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b345d-32f4-49f9-a7b3-e8d771a5a1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:26.105764 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b345d-32f4-49f9-a7b3-e8d771a5a1ee admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:26.106439 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b345d-32f4-49f9-a7b3-e8d771a5a1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:26.106911 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b345d-32f4-49f9-a7b3-e8d771a5a1ee admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:26.108263 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b345d-32f4-49f9-a7b3-e8d771a5a1ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:26.111819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b345d-32f4-49f9-a7b3-e8d771a5a1ee admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:26.255943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1297/2573] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:37:25 2021] POST /identity/v3/users => generated 299 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:26.257262 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6e234-d1e8-4616-8d15-134788fe6003 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:26.268147 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6e234-d1e8-4616-8d15-134788fe6003 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:26.273382 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a418fb-6e89-46fa-adb7-41be66bfd3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:26.280755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a418fb-6e89-46fa-adb7-41be66bfd3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:26.280755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a418fb-6e89-46fa-adb7-41be66bfd3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:26.280755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a418fb-6e89-46fa-adb7-41be66bfd3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:26.280755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a418fb-6e89-46fa-adb7-41be66bfd3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:26.280755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a418fb-6e89-46fa-adb7-41be66bfd3f6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:26.292086 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1277/2574] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:26 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:37:26.297443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b345d-32f4-49f9-a7b3-e8d771a5a1ee admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:26.314982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b345d-32f4-49f9-a7b3-e8d771a5a1ee admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:26.321291 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3948ce-3e38-4e6a-8de4-9ff605d1683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:26.323190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3948ce-3e38-4e6a-8de4-9ff605d1683d admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:26.323685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3948ce-3e38-4e6a-8de4-9ff605d1683d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:26.324273 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3948ce-3e38-4e6a-8de4-9ff605d1683d admin admin] PATH_INFO: `/v3/projects/d66756b79ef649989f073812bed60eed/users/83e9f82125f541f7bb5c9c5ffba08141/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:26.354291 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3948ce-3e38-4e6a-8de4-9ff605d1683d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66756b79ef649989f073812bed60eed, user_id=83e9f82125f541f7bb5c9c5ffba08141, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:26.359200 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3948ce-3e38-4e6a-8de4-9ff605d1683d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:26.455666 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1298/2575] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:26 2021] PUT /identity/v3/projects/d66756b79ef649989f073812bed60eed/users/83e9f82125f541f7bb5c9c5ffba08141/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:26.461069 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a418fb-6e89-46fa-adb7-41be66bfd3f6 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:26.472484 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a418fb-6e89-46fa-adb7-41be66bfd3f6 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:26.547594 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04480c03-c1dc-4079-a46c-a982756df360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:26.548444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04480c03-c1dc-4079-a46c-a982756df360 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:26.548816 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04480c03-c1dc-4079-a46c-a982756df360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:26.549246 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04480c03-c1dc-4079-a46c-a982756df360 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:26.550256 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04480c03-c1dc-4079-a46c-a982756df360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:26.552918 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04480c03-c1dc-4079-a46c-a982756df360 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:26.564528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1278/2576] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:26 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:37:26.569799 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3948ce-3e38-4e6a-8de4-9ff605d1683d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:26.581544 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3948ce-3e38-4e6a-8de4-9ff605d1683d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:26.587839 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e10e11-ef1c-4a5d-859d-d2424d1f0fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:26.588773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e10e11-ef1c-4a5d-859d-d2424d1f0fee admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:26.589055 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e10e11-ef1c-4a5d-859d-d2424d1f0fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:26.589330 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e10e11-ef1c-4a5d-859d-d2424d1f0fee admin admin] PATH_INFO: `/v3/projects/d66756b79ef649989f073812bed60eed/users/83e9f82125f541f7bb5c9c5ffba08141/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:26.592084 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e10e11-ef1c-4a5d-859d-d2424d1f0fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66756b79ef649989f073812bed60eed, user_id=83e9f82125f541f7bb5c9c5ffba08141, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:26.594750 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e10e11-ef1c-4a5d-859d-d2424d1f0fee admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:26.606823 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1299/2577] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:26 2021] PUT /identity/v3/projects/d66756b79ef649989f073812bed60eed/users/83e9f82125f541f7bb5c9c5ffba08141/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:37:26.619349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd693b5-9678-46b3-8743-d976c255c527 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:26.619833 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd693b5-9678-46b3-8743-d976c255c527 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:26.620235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd693b5-9678-46b3-8743-d976c255c527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:26.668875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-2bd693b5-9678-46b3-8743-d976c255c527 None None] MFA Rules not processed for user `83e9f82125f541f7bb5c9c5ffba08141`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:26.671097 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-2bd693b5-9678-46b3-8743-d976c255c527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:26.771632 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1279/2578] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:26 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:37:26.786269 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e10e11-ef1c-4a5d-859d-d2424d1f0fee admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:26.789351 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-65e10e11-ef1c-4a5d-859d-d2424d1f0fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:26.892682 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e10e11-ef1c-4a5d-859d-d2424d1f0fee admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:26.899896 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9c2f3-bdf6-4a38-b5a3-1276c60cceea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:26.901042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9c2f3-bdf6-4a38-b5a3-1276c60cceea service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:26.901553 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9c2f3-bdf6-4a38-b5a3-1276c60cceea service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:26.902058 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9c2f3-bdf6-4a38-b5a3-1276c60cceea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:26.920369 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9c2f3-bdf6-4a38-b5a3-1276c60cceea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:26.922805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9c2f3-bdf6-4a38-b5a3-1276c60cceea service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:26.937549 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1300/2579] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:26 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:37:26.983079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd693b5-9678-46b3-8743-d976c255c527 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:27.058412 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd693b5-9678-46b3-8743-d976c255c527 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:27.069374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1d68c-559d-443e-9ca6-a0a70aabffc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:27.070472 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1d68c-559d-443e-9ca6-a0a70aabffc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:27.070929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1d68c-559d-443e-9ca6-a0a70aabffc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:27.071522 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1d68c-559d-443e-9ca6-a0a70aabffc0 admin admin] PATH_INFO: `/v3/users/0a1bc4a70287468e9815bd70d926b045` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:27.075917 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1d68c-559d-443e-9ca6-a0a70aabffc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a1bc4a70287468e9815bd70d926b045)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:27.081341 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1d68c-559d-443e-9ca6-a0a70aabffc0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:27.309732 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-fab1d68c-559d-443e-9ca6-a0a70aabffc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a1bc4a70287468e9815bd70d926b045'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:27.328631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-fab1d68c-559d-443e-9ca6-a0a70aabffc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a1bc4a70287468e9815bd70d926b045'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:27.330037 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-fab1d68c-559d-443e-9ca6-a0a70aabffc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a1bc4a70287468e9815bd70d926b045'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:27.357539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-fab1d68c-559d-443e-9ca6-a0a70aabffc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a1bc4a70287468e9815bd70d926b045'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:27.425028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-fab1d68c-559d-443e-9ca6-a0a70aabffc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a1bc4a70287468e9815bd70d926b045'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:27.434691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1280/2580] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:37:26 2021] DELETE /identity/v3/users/0a1bc4a70287468e9815bd70d926b045 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:37:27.441567 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0bee5-3e8e-487b-b3de-685e97ec177c None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:27.442884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0bee5-3e8e-487b-b3de-685e97ec177c None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:27.442884 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0bee5-3e8e-487b-b3de-685e97ec177c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:27.467196 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-aca0bee5-3e8e-487b-b3de-685e97ec177c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:27.469085 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-aca0bee5-3e8e-487b-b3de-685e97ec177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:27.598637 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1301/2581] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:27.615366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1d68c-559d-443e-9ca6-a0a70aabffc0 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:27.619890 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-fab1d68c-559d-443e-9ca6-a0a70aabffc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:27.744035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1d68c-559d-443e-9ca6-a0a70aabffc0 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:27.750900 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047edb05-3ac6-4c05-aacf-a90b1364528b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:27.752297 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047edb05-3ac6-4c05-aacf-a90b1364528b service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:27.752793 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047edb05-3ac6-4c05-aacf-a90b1364528b service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:27.753292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047edb05-3ac6-4c05-aacf-a90b1364528b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:27.773031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047edb05-3ac6-4c05-aacf-a90b1364528b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:27.776805 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047edb05-3ac6-4c05-aacf-a90b1364528b service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:27.795504 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1281/2582] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:37:28.356068 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0bee5-3e8e-487b-b3de-685e97ec177c None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:28.357861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-aca0bee5-3e8e-487b-b3de-685e97ec177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:28.378692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0bee5-3e8e-487b-b3de-685e97ec177c None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:28.401180 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:28.402623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:28.403334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:28.403830 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] PATH_INFO: `/v3/projects/8d1cc053e35149e8896546a37423b938` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:28.412081 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1cc053e35149e8896546a37423b938)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:28.420813 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:28.595679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1cc053e35149e8896546a37423b938', 'request_id': 'req-cb49ba4e-7498-40bc-af17-cec6226359c0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:28.699999 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1cc053e35149e8896546a37423b938', 'request_id': 'req-cb49ba4e-7498-40bc-af17-cec6226359c0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:28.710953 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1cc053e35149e8896546a37423b938', 'request_id': 'req-cb49ba4e-7498-40bc-af17-cec6226359c0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:28.736519 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] The token cache is being invalidate because project 8d1cc053e35149e8896546a37423b938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:37:28.737067 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:28.738167 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:28.742328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1302/2583] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:37:28 2021] DELETE /identity/v3/projects/8d1cc053e35149e8896546a37423b938 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:28.748098 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047edb05-3ac6-4c05-aacf-a90b1364528b service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:28.770227 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047edb05-3ac6-4c05-aacf-a90b1364528b service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:28.881743 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedd055-aaa8-45e7-8ab8-da7674b816b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:28.883385 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedd055-aaa8-45e7-8ab8-da7674b816b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:28.883927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedd055-aaa8-45e7-8ab8-da7674b816b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:28.884457 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedd055-aaa8-45e7-8ab8-da7674b816b3 admin admin] PATH_INFO: `/v3/users/83e9f82125f541f7bb5c9c5ffba08141` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:28.886894 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedd055-aaa8-45e7-8ab8-da7674b816b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e9f82125f541f7bb5c9c5ffba08141)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:28.889254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedd055-aaa8-45e7-8ab8-da7674b816b3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:29.088705 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-0eedd055-aaa8-45e7-8ab8-da7674b816b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e9f82125f541f7bb5c9c5ffba08141'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:29.100501 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-0eedd055-aaa8-45e7-8ab8-da7674b816b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e9f82125f541f7bb5c9c5ffba08141'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:29.101412 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-0eedd055-aaa8-45e7-8ab8-da7674b816b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e9f82125f541f7bb5c9c5ffba08141'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:29.123655 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-0eedd055-aaa8-45e7-8ab8-da7674b816b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e9f82125f541f7bb5c9c5ffba08141'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:29.210044 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-0eedd055-aaa8-45e7-8ab8-da7674b816b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e9f82125f541f7bb5c9c5ffba08141'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:29.217625 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1282/2584] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:37:28 2021] DELETE /identity/v3/users/83e9f82125f541f7bb5c9c5ffba08141 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:37:29.735998 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:29.737627 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:29.759765 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49ba4e-7498-40bc-af17-cec6226359c0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:29.865512 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:29.867143 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:29.867720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:29.868165 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a admin admin] PATH_INFO: `/v3/projects/d66756b79ef649989f073812bed60eed` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:29.876138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66756b79ef649989f073812bed60eed)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:29.876138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:30.075071 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66756b79ef649989f073812bed60eed', 'request_id': 'req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:30.139184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66756b79ef649989f073812bed60eed', 'request_id': 'req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:30.147706 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66756b79ef649989f073812bed60eed', 'request_id': 'req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:30.161300 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a admin admin] The token cache is being invalidate because project d66756b79ef649989f073812bed60eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:37:30.161662 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:30.162450 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-8360bbf8-c530-4bcc-85b2-da6fa7f77c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:30.164107 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1303/2585] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:37:29 2021] DELETE /identity/v3/projects/d66756b79ef649989f073812bed60eed => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:30.172713 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534510e1-5700-48e4-bc3f-eadfdf019b85 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:30.173623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534510e1-5700-48e4-bc3f-eadfdf019b85 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:30.174139 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534510e1-5700-48e4-bc3f-eadfdf019b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:30.198424 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-534510e1-5700-48e4-bc3f-eadfdf019b85 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:30.200229 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-534510e1-5700-48e4-bc3f-eadfdf019b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:30.277292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1283/2586] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:37:30.285693 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd05a5-ca41-4e4d-8d8c-d440d6054a15 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:30.286034 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd05a5-ca41-4e4d-8d8c-d440d6054a15 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:30.286555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd05a5-ca41-4e4d-8d8c-d440d6054a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:30.307854 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-51fd05a5-ca41-4e4d-8d8c-d440d6054a15 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:30.309084 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-51fd05a5-ca41-4e4d-8d8c-d440d6054a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:30.318541 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1304/2587] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:37:30.323000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534510e1-5700-48e4-bc3f-eadfdf019b85 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:30.334559 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534510e1-5700-48e4-bc3f-eadfdf019b85 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:30.340028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d1223-6d5c-4e36-8912-3dff9ace2fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:30.340842 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1223-6d5c-4e36-8912-3dff9ace2fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:30.341226 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1223-6d5c-4e36-8912-3dff9ace2fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:30.341591 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1223-6d5c-4e36-8912-3dff9ace2fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:30.342436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d1223-6d5c-4e36-8912-3dff9ace2fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:37:30.342852 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d1223-6d5c-4e36-8912-3dff9ace2fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:30.344685 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d1223-6d5c-4e36-8912-3dff9ace2fc2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:30.357694 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1284/2588] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:37:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:37:30.364911 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd05a5-ca41-4e4d-8d8c-d440d6054a15 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:30.380059 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd05a5-ca41-4e4d-8d8c-d440d6054a15 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:30.385074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324e00e-fa35-4c2d-9b65-4d2e4fdb5b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:30.385773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324e00e-fa35-4c2d-9b65-4d2e4fdb5b8a admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:30.386051 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324e00e-fa35-4c2d-9b65-4d2e4fdb5b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:30.386321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324e00e-fa35-4c2d-9b65-4d2e4fdb5b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:30.387033 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324e00e-fa35-4c2d-9b65-4d2e4fdb5b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:30.388967 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324e00e-fa35-4c2d-9b65-4d2e4fdb5b8a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:30.523572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1305/2589] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:37:30 2021] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:30.528480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d1223-6d5c-4e36-8912-3dff9ace2fc2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:30.538855 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d1223-6d5c-4e36-8912-3dff9ace2fc2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:30.601035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440bb7b-eb4a-4356-80e2-abbb78a86fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:30.601888 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440bb7b-eb4a-4356-80e2-abbb78a86fed admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:30.602236 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440bb7b-eb4a-4356-80e2-abbb78a86fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:30.602555 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440bb7b-eb4a-4356-80e2-abbb78a86fed admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:30.603408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440bb7b-eb4a-4356-80e2-abbb78a86fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:30.605648 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440bb7b-eb4a-4356-80e2-abbb78a86fed admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:30.797461 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1285/2590] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:37:30 2021] POST /identity/v3/users => generated 294 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:30.804583 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324e00e-fa35-4c2d-9b65-4d2e4fdb5b8a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:30.822532 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324e00e-fa35-4c2d-9b65-4d2e4fdb5b8a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:30.829466 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dfced-2256-41ec-a276-469647d36088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:30.835887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dfced-2256-41ec-a276-469647d36088 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:30.835887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dfced-2256-41ec-a276-469647d36088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:30.835887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dfced-2256-41ec-a276-469647d36088 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:30.835887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5dfced-2256-41ec-a276-469647d36088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:30.835887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5dfced-2256-41ec-a276-469647d36088 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:30.848313 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1306/2591] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:30 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:37:30.852543 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440bb7b-eb4a-4356-80e2-abbb78a86fed admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:30.866301 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440bb7b-eb4a-4356-80e2-abbb78a86fed admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:30.876008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4c75e-563f-4f62-88b1-1cde8ac36472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:30.877263 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4c75e-563f-4f62-88b1-1cde8ac36472 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:30.877862 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4c75e-563f-4f62-88b1-1cde8ac36472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:30.878461 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4c75e-563f-4f62-88b1-1cde8ac36472 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:30.880140 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4c75e-563f-4f62-88b1-1cde8ac36472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:30.882777 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4c75e-563f-4f62-88b1-1cde8ac36472 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:30.903323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1286/2592] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:30 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:30.908004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dfced-2256-41ec-a276-469647d36088 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:30.918761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dfced-2256-41ec-a276-469647d36088 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:30.925479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648e8b9-dc70-4583-ae34-8638f05d70cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:30.932858 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e8b9-dc70-4583-ae34-8638f05d70cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:30.932858 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e8b9-dc70-4583-ae34-8638f05d70cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:30.932858 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e8b9-dc70-4583-ae34-8638f05d70cb admin admin] PATH_INFO: `/v3/projects/6b09e6c729644e34846ca5ce574ac56d/users/b0103ad737964ba48533600b0fe56270/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:30.956139 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648e8b9-dc70-4583-ae34-8638f05d70cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b09e6c729644e34846ca5ce574ac56d, user_id=b0103ad737964ba48533600b0fe56270, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:30.962369 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648e8b9-dc70-4583-ae34-8638f05d70cb admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:31.044625 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1307/2593] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:30 2021] PUT /identity/v3/projects/6b09e6c729644e34846ca5ce574ac56d/users/b0103ad737964ba48533600b0fe56270/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:37:31.057731 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c7219-9329-4e81-8877-312e63b3f961 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:31.058062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c7219-9329-4e81-8877-312e63b3f961 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:31.058500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c7219-9329-4e81-8877-312e63b3f961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:31.089637 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-fa4c7219-9329-4e81-8877-312e63b3f961 None None] MFA Rules not processed for user `b0103ad737964ba48533600b0fe56270`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:31.090952 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-fa4c7219-9329-4e81-8877-312e63b3f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:31.168877 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1287/2594] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:31 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:37:31.174198 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648e8b9-dc70-4583-ae34-8638f05d70cb admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:31.253738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648e8b9-dc70-4583-ae34-8638f05d70cb admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:31.261527 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cd7b3-e7a2-4103-9c87-e7e893810230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:31.262591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cd7b3-e7a2-4103-9c87-e7e893810230 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:31.263043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cd7b3-e7a2-4103-9c87-e7e893810230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:31.263498 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cd7b3-e7a2-4103-9c87-e7e893810230 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:31.264755 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cd7b3-e7a2-4103-9c87-e7e893810230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:31.268217 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cd7b3-e7a2-4103-9c87-e7e893810230 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:31.372808 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1308/2595] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:37:31 2021] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:31.375813 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c7219-9329-4e81-8877-312e63b3f961 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:31.388761 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c7219-9329-4e81-8877-312e63b3f961 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:31.455666 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7830709-3a4c-4cfd-9582-a065bbe4e0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:31.456580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7830709-3a4c-4cfd-9582-a065bbe4e0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:31.457002 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7830709-3a4c-4cfd-9582-a065bbe4e0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:31.458696 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7830709-3a4c-4cfd-9582-a065bbe4e0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:31.459209 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7830709-3a4c-4cfd-9582-a065bbe4e0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:31.461344 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7830709-3a4c-4cfd-9582-a065bbe4e0d0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:31.551413 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1288/2596] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:37:31 2021] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:37:31.552932 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cd7b3-e7a2-4103-9c87-e7e893810230 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:31.567844 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cd7b3-e7a2-4103-9c87-e7e893810230 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:31.575425 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48b7c2-d398-4a43-8d30-65350c2e9ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:31.576275 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48b7c2-d398-4a43-8d30-65350c2e9ffa admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:31.576654 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48b7c2-d398-4a43-8d30-65350c2e9ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:31.577172 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48b7c2-d398-4a43-8d30-65350c2e9ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:31.578353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48b7c2-d398-4a43-8d30-65350c2e9ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:31.581155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48b7c2-d398-4a43-8d30-65350c2e9ffa admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:31.600752 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1309/2597] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:31 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:37:31.602108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7830709-3a4c-4cfd-9582-a065bbe4e0d0 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:31.614188 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7830709-3a4c-4cfd-9582-a065bbe4e0d0 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:31.622814 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7f6bd-62db-4f33-bfef-f9f08960ea4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:31.623556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7f6bd-62db-4f33-bfef-f9f08960ea4d admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:31.624064 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7f6bd-62db-4f33-bfef-f9f08960ea4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:31.624341 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7f6bd-62db-4f33-bfef-f9f08960ea4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:31.628249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7f6bd-62db-4f33-bfef-f9f08960ea4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:31.628249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7f6bd-62db-4f33-bfef-f9f08960ea4d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:31.638622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1289/2598] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:31 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:37:31.644692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48b7c2-d398-4a43-8d30-65350c2e9ffa admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:31.661908 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48b7c2-d398-4a43-8d30-65350c2e9ffa admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:31.662429 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63934b0-e803-48fe-b20a-bd7ae51e185d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:31.663332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63934b0-e803-48fe-b20a-bd7ae51e185d admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:31.663604 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63934b0-e803-48fe-b20a-bd7ae51e185d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:31.663912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63934b0-e803-48fe-b20a-bd7ae51e185d admin admin] PATH_INFO: `/v3/projects/feec3dfe26ce49329178789104503f32/users/4a9ce9811a6d450eb61186e9a02b8e95/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:31.680703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63934b0-e803-48fe-b20a-bd7ae51e185d admin admin] RBAC: Authorizing `identity:create_grant(project_id=feec3dfe26ce49329178789104503f32, user_id=4a9ce9811a6d450eb61186e9a02b8e95, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:31.683343 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63934b0-e803-48fe-b20a-bd7ae51e185d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:31.798074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1310/2599] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:31 2021] PUT /identity/v3/projects/feec3dfe26ce49329178789104503f32/users/4a9ce9811a6d450eb61186e9a02b8e95/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:37:31.816982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6cb00-0b3e-4aef-94dd-d1215434d287 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:31.817487 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6cb00-0b3e-4aef-94dd-d1215434d287 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:31.817990 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6cb00-0b3e-4aef-94dd-d1215434d287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:31.858618 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-e3e6cb00-0b3e-4aef-94dd-d1215434d287 None None] MFA Rules not processed for user `4a9ce9811a6d450eb61186e9a02b8e95`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:31.859943 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e3e6cb00-0b3e-4aef-94dd-d1215434d287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:31.944993 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1290/2600] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:31 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:31.951668 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63934b0-e803-48fe-b20a-bd7ae51e185d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:32.032261 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63934b0-e803-48fe-b20a-bd7ae51e185d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:32.038995 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270ec2f-581a-4186-ad74-097f94a81db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:32.040169 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ec2f-581a-4186-ad74-097f94a81db2 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:32.040742 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ec2f-581a-4186-ad74-097f94a81db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:32.041226 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ec2f-581a-4186-ad74-097f94a81db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:32.042471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270ec2f-581a-4186-ad74-097f94a81db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:32.045488 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270ec2f-581a-4186-ad74-097f94a81db2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:32.146778 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1311/2601] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:37:31 2021] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:37:32.151108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6cb00-0b3e-4aef-94dd-d1215434d287 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:32.163095 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6cb00-0b3e-4aef-94dd-d1215434d287 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:32.223810 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55e604-e0cd-4e37-91bb-fbf8096e5b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:32.224487 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55e604-e0cd-4e37-91bb-fbf8096e5b0f admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:32.224763 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55e604-e0cd-4e37-91bb-fbf8096e5b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:32.225035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55e604-e0cd-4e37-91bb-fbf8096e5b0f admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:32.225759 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55e604-e0cd-4e37-91bb-fbf8096e5b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:32.227656 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55e604-e0cd-4e37-91bb-fbf8096e5b0f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:32.335932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1291/2602] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:37:32 2021] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:32.340083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270ec2f-581a-4186-ad74-097f94a81db2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:32.356703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270ec2f-581a-4186-ad74-097f94a81db2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:32.356703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1221b75-e1c7-4a60-9290-2783243c2247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:32.356703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1221b75-e1c7-4a60-9290-2783243c2247 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:32.356703 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1221b75-e1c7-4a60-9290-2783243c2247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:32.357279 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1221b75-e1c7-4a60-9290-2783243c2247 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:32.357657 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1221b75-e1c7-4a60-9290-2783243c2247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:32.359257 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1221b75-e1c7-4a60-9290-2783243c2247 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:32.371030 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1312/2603] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:32.375400 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55e604-e0cd-4e37-91bb-fbf8096e5b0f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:32.386263 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55e604-e0cd-4e37-91bb-fbf8096e5b0f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:32.390995 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34147098-0c44-4f4a-8bc7-37ef6e53323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:32.391920 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34147098-0c44-4f4a-8bc7-37ef6e53323e admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:32.392221 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34147098-0c44-4f4a-8bc7-37ef6e53323e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:32.392500 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34147098-0c44-4f4a-8bc7-37ef6e53323e admin admin] PATH_INFO: `/v3/projects/72e02f2dbeeb40e1a6de0b87435ba9f2/users/a60ac921bd244388aeafd92bddda7679/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:32.408184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34147098-0c44-4f4a-8bc7-37ef6e53323e admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e02f2dbeeb40e1a6de0b87435ba9f2, user_id=a60ac921bd244388aeafd92bddda7679, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:32.412115 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34147098-0c44-4f4a-8bc7-37ef6e53323e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:32.501259 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1292/2604] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:32 2021] PUT /identity/v3/projects/72e02f2dbeeb40e1a6de0b87435ba9f2/users/a60ac921bd244388aeafd92bddda7679/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:32.506611 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1221b75-e1c7-4a60-9290-2783243c2247 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:32.516622 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1221b75-e1c7-4a60-9290-2783243c2247 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:32.572355 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e86d89-9d99-4d8e-aa37-3a76332c82d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:32.573035 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e86d89-9d99-4d8e-aa37-3a76332c82d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:32.573319 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e86d89-9d99-4d8e-aa37-3a76332c82d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:32.573599 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e86d89-9d99-4d8e-aa37-3a76332c82d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:32.574357 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e86d89-9d99-4d8e-aa37-3a76332c82d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:32.576064 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e86d89-9d99-4d8e-aa37-3a76332c82d6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:32.587227 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1313/2605] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:32 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:32.591417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34147098-0c44-4f4a-8bc7-37ef6e53323e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:32.606011 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34147098-0c44-4f4a-8bc7-37ef6e53323e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:32.610898 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b928f-ad6a-467f-8747-916260cf4e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:32.611719 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b928f-ad6a-467f-8747-916260cf4e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:32.612032 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b928f-ad6a-467f-8747-916260cf4e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:32.612309 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b928f-ad6a-467f-8747-916260cf4e70 admin admin] PATH_INFO: `/v3/projects/72e02f2dbeeb40e1a6de0b87435ba9f2/users/a60ac921bd244388aeafd92bddda7679/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:32.614365 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b928f-ad6a-467f-8747-916260cf4e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e02f2dbeeb40e1a6de0b87435ba9f2, user_id=a60ac921bd244388aeafd92bddda7679, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:32.617029 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b928f-ad6a-467f-8747-916260cf4e70 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:32.628090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1293/2606] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:32 2021] PUT /identity/v3/projects/72e02f2dbeeb40e1a6de0b87435ba9f2/users/a60ac921bd244388aeafd92bddda7679/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:32.639211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c43ab-20c5-4ef4-8959-116c09909e32 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:32.639521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c43ab-20c5-4ef4-8959-116c09909e32 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:32.639850 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c43ab-20c5-4ef4-8959-116c09909e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:32.673221 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-8a6c43ab-20c5-4ef4-8959-116c09909e32 None None] MFA Rules not processed for user `a60ac921bd244388aeafd92bddda7679`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:32.673221 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8a6c43ab-20c5-4ef4-8959-116c09909e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:32.740714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1314/2607] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:32 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:32.750636 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b928f-ad6a-467f-8747-916260cf4e70 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:32.752368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e27b928f-ad6a-467f-8747-916260cf4e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:32.813285 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b928f-ad6a-467f-8747-916260cf4e70 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:32.818469 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bcd1a-0d2a-42b5-8921-bcf0ae741334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:32.819127 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bcd1a-0d2a-42b5-8921-bcf0ae741334 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:32.819414 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bcd1a-0d2a-42b5-8921-bcf0ae741334 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:32.819711 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bcd1a-0d2a-42b5-8921-bcf0ae741334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:32.829749 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bcd1a-0d2a-42b5-8921-bcf0ae741334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:32.831426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bcd1a-0d2a-42b5-8921-bcf0ae741334 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:32.842560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1294/2608] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:32 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:37:33.982444 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c43ab-20c5-4ef4-8959-116c09909e32 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:33.984009 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-8a6c43ab-20c5-4ef4-8959-116c09909e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:33.997876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c43ab-20c5-4ef4-8959-116c09909e32 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:34.002132 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9904a-47ef-47f7-8322-4b2bf399d9df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:34.002789 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9904a-47ef-47f7-8322-4b2bf399d9df service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:34.003069 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9904a-47ef-47f7-8322-4b2bf399d9df service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:34.003343 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9904a-47ef-47f7-8322-4b2bf399d9df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:34.061620 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9904a-47ef-47f7-8322-4b2bf399d9df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:34.063161 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9904a-47ef-47f7-8322-4b2bf399d9df service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:34.080474 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1315/2609] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:33 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:37:36.552424 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8264f8-c545-4a79-940d-2bfd6578148c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:36.553008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8264f8-c545-4a79-940d-2bfd6578148c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:36.553008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8264f8-c545-4a79-940d-2bfd6578148c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:36.573041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-ff8264f8-c545-4a79-940d-2bfd6578148c None None] MFA Rules not processed for user `28ed9da4224549d1a2efd82998c8a500`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:36.574192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ff8264f8-c545-4a79-940d-2bfd6578148c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:36.630267 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1295/2610] 10.222.0.87 () {58 vars in 967 bytes} [Fri Oct 29 01:37:36 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:37:36.772738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9904a-47ef-47f7-8322-4b2bf399d9df service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:36.774429 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-19a9904a-47ef-47f7-8322-4b2bf399d9df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:36.863203 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9904a-47ef-47f7-8322-4b2bf399d9df service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:36.866307 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b330a-bb83-4d4b-886c-eafcb4e737dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9153b864b44f5dbbfd6f33ddb253c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:36.867214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b330a-bb83-4d4b-886c-eafcb4e737dd service swift] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:36.867659 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b330a-bb83-4d4b-886c-eafcb4e737dd service swift] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:36.868121 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b330a-bb83-4d4b-886c-eafcb4e737dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:36.882443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b330a-bb83-4d4b-886c-eafcb4e737dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:36.884099 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b330a-bb83-4d4b-886c-eafcb4e737dd service swift] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:36.893547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1316/2611] 10.222.0.87 () {60 vars in 1384 bytes} [Fri Oct 29 01:37:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 01:37:39.479608 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8264f8-c545-4a79-940d-2bfd6578148c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:39.491862 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8264f8-c545-4a79-940d-2bfd6578148c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:39.495643 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34def8af-76ff-472f-bc03-6b7ce03d2b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:39.496319 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def8af-76ff-472f-bc03-6b7ce03d2b40 service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:39.496606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def8af-76ff-472f-bc03-6b7ce03d2b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:39.496876 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def8af-76ff-472f-bc03-6b7ce03d2b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:39.554353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34def8af-76ff-472f-bc03-6b7ce03d2b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:39.555706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34def8af-76ff-472f-bc03-6b7ce03d2b40 service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:39.565277 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1296/2612] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:39 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:37:44.318712 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b330a-bb83-4d4b-886c-eafcb4e737dd service swift] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:44.396781 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b330a-bb83-4d4b-886c-eafcb4e737dd service swift] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:44.401798 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03798e-7d78-4b92-871e-a8d9941c8228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:44.402809 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03798e-7d78-4b92-871e-a8d9941c8228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:44.403192 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03798e-7d78-4b92-871e-a8d9941c8228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:44.403567 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03798e-7d78-4b92-871e-a8d9941c8228 admin admin] PATH_INFO: `/v3/users/b0103ad737964ba48533600b0fe56270` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:44.404978 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03798e-7d78-4b92-871e-a8d9941c8228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0103ad737964ba48533600b0fe56270)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:44.407129 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03798e-7d78-4b92-871e-a8d9941c8228 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:44.635667 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9a03798e-7d78-4b92-871e-a8d9941c8228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0103ad737964ba48533600b0fe56270'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:44.636365 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9a03798e-7d78-4b92-871e-a8d9941c8228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0103ad737964ba48533600b0fe56270'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:44.650007 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9a03798e-7d78-4b92-871e-a8d9941c8228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0103ad737964ba48533600b0fe56270'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:44.657201 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9a03798e-7d78-4b92-871e-a8d9941c8228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0103ad737964ba48533600b0fe56270'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:44.735712 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9a03798e-7d78-4b92-871e-a8d9941c8228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0103ad737964ba48533600b0fe56270'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:44.746730 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1317/2613] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:37:44 2021] DELETE /identity/v3/users/b0103ad737964ba48533600b0fe56270 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:44.748251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfd598-0f15-413d-8dbe-96cc001fddf9 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:44.748728 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfd598-0f15-413d-8dbe-96cc001fddf9 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:44.748856 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfd598-0f15-413d-8dbe-96cc001fddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:44.769552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-f3dfd598-0f15-413d-8dbe-96cc001fddf9 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:44.769552 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-f3dfd598-0f15-413d-8dbe-96cc001fddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:44.835701 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1297/2614] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:44.846042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03798e-7d78-4b92-871e-a8d9941c8228 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:44.847599 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-9a03798e-7d78-4b92-871e-a8d9941c8228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:44.916045 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03798e-7d78-4b92-871e-a8d9941c8228 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:44.919883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc960ab-e666-4ee3-8202-67fe0f7281d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:44.920744 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc960ab-e666-4ee3-8202-67fe0f7281d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:44.921119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc960ab-e666-4ee3-8202-67fe0f7281d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:44.921492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc960ab-e666-4ee3-8202-67fe0f7281d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:44.931818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc960ab-e666-4ee3-8202-67fe0f7281d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:44.933376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc960ab-e666-4ee3-8202-67fe0f7281d7 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:44.944897 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1318/2615] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:37:45.496914 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfd598-0f15-413d-8dbe-96cc001fddf9 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:45.500800 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-f3dfd598-0f15-413d-8dbe-96cc001fddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:45.512239 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfd598-0f15-413d-8dbe-96cc001fddf9 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:45.524810 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:45.525684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:45.525963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:45.526235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] PATH_INFO: `/v3/projects/6b09e6c729644e34846ca5ce574ac56d` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:45.528309 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b09e6c729644e34846ca5ce574ac56d)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:45.530192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:45.703626 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b09e6c729644e34846ca5ce574ac56d', 'request_id': 'req-16ebbe11-48aa-4c68-b112-6117ab2b75d5'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:45.798932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b09e6c729644e34846ca5ce574ac56d', 'request_id': 'req-16ebbe11-48aa-4c68-b112-6117ab2b75d5'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:45.800970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b09e6c729644e34846ca5ce574ac56d', 'request_id': 'req-16ebbe11-48aa-4c68-b112-6117ab2b75d5'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:45.812948 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] The token cache is being invalidate because project 6b09e6c729644e34846ca5ce574ac56d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:37:45.813270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:45.813892 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:45.815473 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1298/2616] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:37:45 2021] DELETE /identity/v3/projects/6b09e6c729644e34846ca5ce574ac56d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:45.820942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc960ab-e666-4ee3-8202-67fe0f7281d7 service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:45.831323 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc960ab-e666-4ee3-8202-67fe0f7281d7 service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:45.890971 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bbec4-4cbe-4112-a4f6-8bc46230b190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:45.891940 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bbec4-4cbe-4112-a4f6-8bc46230b190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:45.892226 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bbec4-4cbe-4112-a4f6-8bc46230b190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:45.892502 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bbec4-4cbe-4112-a4f6-8bc46230b190 admin admin] PATH_INFO: `/v3/users/4a9ce9811a6d450eb61186e9a02b8e95` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:45.893907 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bbec4-4cbe-4112-a4f6-8bc46230b190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a9ce9811a6d450eb61186e9a02b8e95)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:45.896032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bbec4-4cbe-4112-a4f6-8bc46230b190 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:46.155592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-141bbec4-4cbe-4112-a4f6-8bc46230b190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a9ce9811a6d450eb61186e9a02b8e95'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:46.157578 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-141bbec4-4cbe-4112-a4f6-8bc46230b190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a9ce9811a6d450eb61186e9a02b8e95'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:46.176494 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-141bbec4-4cbe-4112-a4f6-8bc46230b190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a9ce9811a6d450eb61186e9a02b8e95'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:46.186563 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-141bbec4-4cbe-4112-a4f6-8bc46230b190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a9ce9811a6d450eb61186e9a02b8e95'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:46.243558 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-141bbec4-4cbe-4112-a4f6-8bc46230b190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a9ce9811a6d450eb61186e9a02b8e95'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:46.262201 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1319/2617] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:37:45 2021] DELETE /identity/v3/users/4a9ce9811a6d450eb61186e9a02b8e95 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:46.873432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:46.875834 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:46.898476 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebbe11-48aa-4c68-b112-6117ab2b75d5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:46.962565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bbec4-4cbe-4112-a4f6-8bc46230b190 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:46.964513 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-141bbec4-4cbe-4112-a4f6-8bc46230b190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:46.968779 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:46.969888 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:46.970172 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:46.970444 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] PATH_INFO: `/v3/projects/feec3dfe26ce49329178789104503f32` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:46.971807 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feec3dfe26ce49329178789104503f32)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:46.974585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:46.981613 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bbec4-4cbe-4112-a4f6-8bc46230b190 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:46.986055 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd78d4-a711-4490-a7ff-a93ee2d01a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:46.986968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd78d4-a711-4490-a7ff-a93ee2d01a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:46.987248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd78d4-a711-4490-a7ff-a93ee2d01a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:46.987524 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd78d4-a711-4490-a7ff-a93ee2d01a25 admin admin] PATH_INFO: `/v3/users/e1147a77b5da48f9a75cefa0ab0e6b87` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:46.989756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd78d4-a711-4490-a7ff-a93ee2d01a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1147a77b5da48f9a75cefa0ab0e6b87)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:46.991688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd78d4-a711-4490-a7ff-a93ee2d01a25 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:47.090928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feec3dfe26ce49329178789104503f32', 'request_id': 'req-39816818-8c19-4f43-bcb8-1360a8507bc6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.212806 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feec3dfe26ce49329178789104503f32', 'request_id': 'req-39816818-8c19-4f43-bcb8-1360a8507bc6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.219232 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feec3dfe26ce49329178789104503f32', 'request_id': 'req-39816818-8c19-4f43-bcb8-1360a8507bc6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.227334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-d8bd78d4-a711-4490-a7ff-a93ee2d01a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1147a77b5da48f9a75cefa0ab0e6b87'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.228219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-d8bd78d4-a711-4490-a7ff-a93ee2d01a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1147a77b5da48f9a75cefa0ab0e6b87'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.243420 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] The token cache is being invalidate because project feec3dfe26ce49329178789104503f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:37:47.244034 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.244772 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-d8bd78d4-a711-4490-a7ff-a93ee2d01a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1147a77b5da48f9a75cefa0ab0e6b87'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.245131 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.248407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1299/2618] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:37:46 2021] DELETE /identity/v3/projects/feec3dfe26ce49329178789104503f32 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:47.252067 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-d8bd78d4-a711-4490-a7ff-a93ee2d01a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1147a77b5da48f9a75cefa0ab0e6b87'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.252863 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:47.254477 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:47.324016 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-d8bd78d4-a711-4490-a7ff-a93ee2d01a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1147a77b5da48f9a75cefa0ab0e6b87'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.324372 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39816818-8c19-4f43-bcb8-1360a8507bc6 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:47.329561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c4a02-69d7-4885-a627-09a23f99a5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:47.333463 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1320/2619] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:37:46 2021] DELETE /identity/v3/users/e1147a77b5da48f9a75cefa0ab0e6b87 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:47.333631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c4a02-69d7-4885-a627-09a23f99a5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:47.333631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c4a02-69d7-4885-a627-09a23f99a5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:47.333631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c4a02-69d7-4885-a627-09a23f99a5a4 admin admin] PATH_INFO: `/v3/users/a60ac921bd244388aeafd92bddda7679` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:47.333631 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c4a02-69d7-4885-a627-09a23f99a5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60ac921bd244388aeafd92bddda7679)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:47.335369 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c4a02-69d7-4885-a627-09a23f99a5a4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:47.550291 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-885c4a02-69d7-4885-a627-09a23f99a5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60ac921bd244388aeafd92bddda7679'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.557537 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-885c4a02-69d7-4885-a627-09a23f99a5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60ac921bd244388aeafd92bddda7679'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.558416 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-885c4a02-69d7-4885-a627-09a23f99a5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60ac921bd244388aeafd92bddda7679'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.570945 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-885c4a02-69d7-4885-a627-09a23f99a5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60ac921bd244388aeafd92bddda7679'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.617321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd78d4-a711-4490-a7ff-a93ee2d01a25 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:47.619442 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d8bd78d4-a711-4490-a7ff-a93ee2d01a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:47.647535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-885c4a02-69d7-4885-a627-09a23f99a5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60ac921bd244388aeafd92bddda7679'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:47.655036 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1300/2620] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:37:47 2021] DELETE /identity/v3/users/a60ac921bd244388aeafd92bddda7679 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:37:47.740109 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd78d4-a711-4490-a7ff-a93ee2d01a25 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:47.814064 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:47.814926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:47.815297 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:47.815646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] PATH_INFO: `/v3/projects/700a9aa6afdf4de6b64d375544d7eb88` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:47.817553 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=700a9aa6afdf4de6b64d375544d7eb88)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:47.819457 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:47.973455 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '700a9aa6afdf4de6b64d375544d7eb88', 'request_id': 'req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.049210 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '700a9aa6afdf4de6b64d375544d7eb88', 'request_id': 'req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.056340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '700a9aa6afdf4de6b64d375544d7eb88', 'request_id': 'req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.068376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] The token cache is being invalidate because project 700a9aa6afdf4de6b64d375544d7eb88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:37:48.068667 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.069329 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.070972 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1321/2621] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:37:47 2021] DELETE /identity/v3/projects/700a9aa6afdf4de6b64d375544d7eb88 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:48.075076 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c4a02-69d7-4885-a627-09a23f99a5a4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:48.076597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-885c4a02-69d7-4885-a627-09a23f99a5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:48.090604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c4a02-69d7-4885-a627-09a23f99a5a4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:48.162038 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456275b-c196-4bc4-ab1c-5033bc278a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:48.162967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456275b-c196-4bc4-ab1c-5033bc278a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:48.163400 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456275b-c196-4bc4-ab1c-5033bc278a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:48.163676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456275b-c196-4bc4-ab1c-5033bc278a00 admin admin] PATH_INFO: `/v3/users/88b2a2bcb62241628a43421bbe10af82` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:48.165057 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456275b-c196-4bc4-ab1c-5033bc278a00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b2a2bcb62241628a43421bbe10af82)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:48.167120 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456275b-c196-4bc4-ab1c-5033bc278a00 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:48.188793 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:48.195219 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:48.211761 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff25b0-5e9e-4ebf-9df9-0bfd6a479368 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:48.226683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b77853-2666-4e73-b821-ead26863f916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:48.229048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b77853-2666-4e73-b821-ead26863f916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:48.229406 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b77853-2666-4e73-b821-ead26863f916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:48.229751 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b77853-2666-4e73-b821-ead26863f916 admin admin] PATH_INFO: `/v3/projects/72e02f2dbeeb40e1a6de0b87435ba9f2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:48.231135 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b77853-2666-4e73-b821-ead26863f916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e02f2dbeeb40e1a6de0b87435ba9f2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:48.233185 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b77853-2666-4e73-b821-ead26863f916 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:48.418669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-13b77853-2666-4e73-b821-ead26863f916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e02f2dbeeb40e1a6de0b87435ba9f2', 'request_id': 'req-13b77853-2666-4e73-b821-ead26863f916'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.419264 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2456275b-c196-4bc4-ab1c-5033bc278a00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b2a2bcb62241628a43421bbe10af82'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.427299 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2456275b-c196-4bc4-ab1c-5033bc278a00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b2a2bcb62241628a43421bbe10af82'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.428091 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2456275b-c196-4bc4-ab1c-5033bc278a00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b2a2bcb62241628a43421bbe10af82'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.441210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2456275b-c196-4bc4-ab1c-5033bc278a00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b2a2bcb62241628a43421bbe10af82'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.483714 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-13b77853-2666-4e73-b821-ead26863f916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e02f2dbeeb40e1a6de0b87435ba9f2', 'request_id': 'req-13b77853-2666-4e73-b821-ead26863f916'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.489960 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-13b77853-2666-4e73-b821-ead26863f916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e02f2dbeeb40e1a6de0b87435ba9f2', 'request_id': 'req-13b77853-2666-4e73-b821-ead26863f916'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.502047 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-13b77853-2666-4e73-b821-ead26863f916 admin admin] The token cache is being invalidate because project 72e02f2dbeeb40e1a6de0b87435ba9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:37:48.502334 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-13b77853-2666-4e73-b821-ead26863f916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.503017 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-13b77853-2666-4e73-b821-ead26863f916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.505489 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1322/2622] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:37:48 2021] DELETE /identity/v3/projects/72e02f2dbeeb40e1a6de0b87435ba9f2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:48.512316 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5930-d1e0-4cb5-82fb-2695d32c21ac None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:48.512601 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5930-d1e0-4cb5-82fb-2695d32c21ac None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:48.512883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5930-d1e0-4cb5-82fb-2695d32c21ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:48.540256 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-75ac5930-d1e0-4cb5-82fb-2695d32c21ac None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:48.541464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-75ac5930-d1e0-4cb5-82fb-2695d32c21ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:48.552151 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-2456275b-c196-4bc4-ab1c-5033bc278a00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b2a2bcb62241628a43421bbe10af82'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:48.558993 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1301/2623] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:37:48 2021] DELETE /identity/v3/users/88b2a2bcb62241628a43421bbe10af82 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:48.604790 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1323/2624] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:37:48.613740 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0c481-c35e-4318-9c52-b1e53dbb28e8 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:48.614053 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0c481-c35e-4318-9c52-b1e53dbb28e8 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:48.614382 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0c481-c35e-4318-9c52-b1e53dbb28e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:48.632694 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-47a0c481-c35e-4318-9c52-b1e53dbb28e8 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:48.633906 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-47a0c481-c35e-4318-9c52-b1e53dbb28e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:48.701435 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1302/2625] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:48.706044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac5930-d1e0-4cb5-82fb-2695d32c21ac None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:48.715955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac5930-d1e0-4cb5-82fb-2695d32c21ac None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:48.723989 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2956ec-93c4-4625-9d94-5747d1121abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:48.724702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2956ec-93c4-4625-9d94-5747d1121abb admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:48.727257 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2956ec-93c4-4625-9d94-5747d1121abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:48.727257 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2956ec-93c4-4625-9d94-5747d1121abb admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:48.727257 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2956ec-93c4-4625-9d94-5747d1121abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:37:48.727257 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2956ec-93c4-4625-9d94-5747d1121abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:48.728342 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2956ec-93c4-4625-9d94-5747d1121abb admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:48.741946 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1324/2626] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:37:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:37:48.746470 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0c481-c35e-4318-9c52-b1e53dbb28e8 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:48.756647 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0c481-c35e-4318-9c52-b1e53dbb28e8 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:48.761496 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b9a76-da43-4af1-9aa1-d360d990861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:48.762150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b9a76-da43-4af1-9aa1-d360d990861a admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:48.762432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b9a76-da43-4af1-9aa1-d360d990861a admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:48.762706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b9a76-da43-4af1-9aa1-d360d990861a admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:48.763413 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b9a76-da43-4af1-9aa1-d360d990861a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:48.765352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b9a76-da43-4af1-9aa1-d360d990861a admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:48.822890 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2956ec-93c4-4625-9d94-5747d1121abb admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:48.824758 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-cc2956ec-93c4-4625-9d94-5747d1121abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:48.840849 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2956ec-93c4-4625-9d94-5747d1121abb admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:48.846753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:48.848417 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:48.848629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:48.848937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] PATH_INFO: `/v3/projects/d74714cd6d7e4451ba7ba7c71b662cec` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:48.850211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74714cd6d7e4451ba7ba7c71b662cec)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:48.852139 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:48.861930 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1303/2627] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:37:48 2021] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:48.863911 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b9a76-da43-4af1-9aa1-d360d990861a admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:48.943119 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b9a76-da43-4af1-9aa1-d360d990861a admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:48.947883 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e296fd-b93e-4bfa-bbb7-e51370495fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:48.957366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e296fd-b93e-4bfa-bbb7-e51370495fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:48.957366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e296fd-b93e-4bfa-bbb7-e51370495fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:48.957366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e296fd-b93e-4bfa-bbb7-e51370495fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:48.957366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e296fd-b93e-4bfa-bbb7-e51370495fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:48.957366 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e296fd-b93e-4bfa-bbb7-e51370495fd4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:48.987849 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74714cd6d7e4451ba7ba7c71b662cec', 'request_id': 'req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:49.027642 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1304/2628] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:37:48 2021] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:37:49.031658 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e296fd-b93e-4bfa-bbb7-e51370495fd4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:49.042331 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e296fd-b93e-4bfa-bbb7-e51370495fd4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:49.043591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74714cd6d7e4451ba7ba7c71b662cec', 'request_id': 'req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:49.049521 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74714cd6d7e4451ba7ba7c71b662cec', 'request_id': 'req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:49.062120 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] The token cache is being invalidate because project d74714cd6d7e4451ba7ba7c71b662cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:37:49.062557 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:49.063270 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:49.065419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1325/2629] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:37:48 2021] DELETE /identity/v3/projects/d74714cd6d7e4451ba7ba7c71b662cec => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:37:49.111193 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc482d-9d5b-44f6-a471-123c357f8f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:49.111939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc482d-9d5b-44f6-a471-123c357f8f9e admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:49.112190 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc482d-9d5b-44f6-a471-123c357f8f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:49.112507 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc482d-9d5b-44f6-a471-123c357f8f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:49.113833 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc482d-9d5b-44f6-a471-123c357f8f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:49.115488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc482d-9d5b-44f6-a471-123c357f8f9e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:49.127519 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1305/2630] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:49 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:37:49.132532 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:49.134151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:49.148719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f0f58-6f3e-49eb-ba7c-371a2104eb6c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:49.153987 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe071ea-3c5c-4630-bdaf-fc2e0e353db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:49.154990 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe071ea-3c5c-4630-bdaf-fc2e0e353db5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:49.155340 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe071ea-3c5c-4630-bdaf-fc2e0e353db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:49.155692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe071ea-3c5c-4630-bdaf-fc2e0e353db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:49.156598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe071ea-3c5c-4630-bdaf-fc2e0e353db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:49.158359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe071ea-3c5c-4630-bdaf-fc2e0e353db5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:49.173851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1326/2631] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:49 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:49.183247 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc482d-9d5b-44f6-a471-123c357f8f9e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:49.196699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc482d-9d5b-44f6-a471-123c357f8f9e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:49.202311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884ea60-be0b-47d1-8540-ee78477bb9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:49.203305 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ea60-be0b-47d1-8540-ee78477bb9de admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:49.203853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ea60-be0b-47d1-8540-ee78477bb9de admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:49.215958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ea60-be0b-47d1-8540-ee78477bb9de admin admin] PATH_INFO: `/v3/projects/18ff7c7c6e2e496aa857aea23c29e2b2/users/1fc921a54e7744f587405fa21b82ef47/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:49.224804 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884ea60-be0b-47d1-8540-ee78477bb9de admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ff7c7c6e2e496aa857aea23c29e2b2, user_id=1fc921a54e7744f587405fa21b82ef47, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:49.227555 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884ea60-be0b-47d1-8540-ee78477bb9de admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:49.387687 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1306/2632] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:49 2021] PUT /identity/v3/projects/18ff7c7c6e2e496aa857aea23c29e2b2/users/1fc921a54e7744f587405fa21b82ef47/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:49.397190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bef2a-53c6-4077-92bf-183869112f43 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:49.397476 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bef2a-53c6-4077-92bf-183869112f43 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:49.397755 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bef2a-53c6-4077-92bf-183869112f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:49.424522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-1c6bef2a-53c6-4077-92bf-183869112f43 None None] MFA Rules not processed for user `1fc921a54e7744f587405fa21b82ef47`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:49.426386 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1c6bef2a-53c6-4077-92bf-183869112f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:49.493759 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1327/2633] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:49 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:49.498536 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884ea60-be0b-47d1-8540-ee78477bb9de admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:49.567507 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884ea60-be0b-47d1-8540-ee78477bb9de admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:49.572245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c0762-cf01-4ef6-b2d6-41ecef102d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:49.572891 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c0762-cf01-4ef6-b2d6-41ecef102d6b admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:49.574338 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c0762-cf01-4ef6-b2d6-41ecef102d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:49.574338 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c0762-cf01-4ef6-b2d6-41ecef102d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:49.574338 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c0762-cf01-4ef6-b2d6-41ecef102d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:49.575996 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c0762-cf01-4ef6-b2d6-41ecef102d6b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:49.656683 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1307/2634] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:37:49 2021] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:37:49.668924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bef2a-53c6-4077-92bf-183869112f43 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:49.680772 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bef2a-53c6-4077-92bf-183869112f43 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:49.738702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21698e98-ab3a-4104-b343-f83c5e4868a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:49.739396 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698e98-ab3a-4104-b343-f83c5e4868a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:49.739670 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698e98-ab3a-4104-b343-f83c5e4868a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:49.739973 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698e98-ab3a-4104-b343-f83c5e4868a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:49.740697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21698e98-ab3a-4104-b343-f83c5e4868a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:49.742615 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21698e98-ab3a-4104-b343-f83c5e4868a1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:49.850178 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1328/2635] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:37:49 2021] POST /identity/v3/users => generated 301 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:49.854433 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c0762-cf01-4ef6-b2d6-41ecef102d6b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:49.866410 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c0762-cf01-4ef6-b2d6-41ecef102d6b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:49.871491 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23208a9a-58a1-4876-bcf9-5b8b0124bda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:49.872510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23208a9a-58a1-4876-bcf9-5b8b0124bda9 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:49.872831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23208a9a-58a1-4876-bcf9-5b8b0124bda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:49.873114 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23208a9a-58a1-4876-bcf9-5b8b0124bda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:49.873852 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23208a9a-58a1-4876-bcf9-5b8b0124bda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:49.875433 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23208a9a-58a1-4876-bcf9-5b8b0124bda9 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:49.889930 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1308/2636] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:49 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:37:49.893285 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21698e98-ab3a-4104-b343-f83c5e4868a1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:49.903522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21698e98-ab3a-4104-b343-f83c5e4868a1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:49.908250 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb72f4-fb5b-43e4-a070-b585064bcdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:49.909131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb72f4-fb5b-43e4-a070-b585064bcdc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:49.909411 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb72f4-fb5b-43e4-a070-b585064bcdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:49.909685 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb72f4-fb5b-43e4-a070-b585064bcdc2 admin admin] PATH_INFO: `/v3/projects/dfc15d32e5d145d98a93c7d6a4b1e9e4/users/628d167538b94cf3bb76a650fe0c00e2/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:49.924730 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb72f4-fb5b-43e4-a070-b585064bcdc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc15d32e5d145d98a93c7d6a4b1e9e4, user_id=628d167538b94cf3bb76a650fe0c00e2, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:49.928105 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb72f4-fb5b-43e4-a070-b585064bcdc2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:50.027807 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1329/2637] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:49 2021] PUT /identity/v3/projects/dfc15d32e5d145d98a93c7d6a4b1e9e4/users/628d167538b94cf3bb76a650fe0c00e2/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:50.031832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23208a9a-58a1-4876-bcf9-5b8b0124bda9 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:50.043164 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23208a9a-58a1-4876-bcf9-5b8b0124bda9 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:50.107772 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73c06f-2aa8-4461-a304-164d1e5c96cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:50.108370 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73c06f-2aa8-4461-a304-164d1e5c96cf admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:50.108650 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73c06f-2aa8-4461-a304-164d1e5c96cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:50.108923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73c06f-2aa8-4461-a304-164d1e5c96cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:50.109673 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73c06f-2aa8-4461-a304-164d1e5c96cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:50.111257 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73c06f-2aa8-4461-a304-164d1e5c96cf admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:50.122839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1309/2638] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:50 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:50.127173 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb72f4-fb5b-43e4-a070-b585064bcdc2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:50.137854 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb72f4-fb5b-43e4-a070-b585064bcdc2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:50.142687 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37847418-6c07-4d07-99ae-fa127f97343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:50.143592 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37847418-6c07-4d07-99ae-fa127f97343e admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:50.144042 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37847418-6c07-4d07-99ae-fa127f97343e admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:50.144475 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37847418-6c07-4d07-99ae-fa127f97343e admin admin] PATH_INFO: `/v3/projects/dfc15d32e5d145d98a93c7d6a4b1e9e4/users/628d167538b94cf3bb76a650fe0c00e2/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:50.146604 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37847418-6c07-4d07-99ae-fa127f97343e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc15d32e5d145d98a93c7d6a4b1e9e4, user_id=628d167538b94cf3bb76a650fe0c00e2, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:50.149314 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37847418-6c07-4d07-99ae-fa127f97343e admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:50.162754 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1330/2639] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:50 2021] PUT /identity/v3/projects/dfc15d32e5d145d98a93c7d6a4b1e9e4/users/628d167538b94cf3bb76a650fe0c00e2/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:50.181601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e24087-10c1-4b0b-ab7d-548b4f80224c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:50.181944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e24087-10c1-4b0b-ab7d-548b4f80224c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:50.182358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e24087-10c1-4b0b-ab7d-548b4f80224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:50.208949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-b2e24087-10c1-4b0b-ab7d-548b4f80224c None None] MFA Rules not processed for user `628d167538b94cf3bb76a650fe0c00e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:50.210151 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b2e24087-10c1-4b0b-ab7d-548b4f80224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:50.279134 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1310/2640] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:50 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:50.289991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37847418-6c07-4d07-99ae-fa127f97343e admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:50.292083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-37847418-6c07-4d07-99ae-fa127f97343e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:50.352492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37847418-6c07-4d07-99ae-fa127f97343e admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:50.357472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324731b3-ff96-40c1-bb76-54c3e3061cc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:50.358190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324731b3-ff96-40c1-bb76-54c3e3061cc1 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:50.358421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324731b3-ff96-40c1-bb76-54c3e3061cc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:50.358698 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324731b3-ff96-40c1-bb76-54c3e3061cc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:50.369748 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324731b3-ff96-40c1-bb76-54c3e3061cc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:50.371195 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324731b3-ff96-40c1-bb76-54c3e3061cc1 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:50.391564 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1331/2641] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:50 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:37:50.528484 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e24087-10c1-4b0b-ab7d-548b4f80224c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:50.596770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e24087-10c1-4b0b-ab7d-548b4f80224c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:50.602436 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d8750-2e0e-4351-9c6b-d14529b09e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:50.603326 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8750-2e0e-4351-9c6b-d14529b09e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:50.603598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8750-2e0e-4351-9c6b-d14529b09e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:50.603899 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8750-2e0e-4351-9c6b-d14529b09e84 admin admin] PATH_INFO: `/v3/users/1fc921a54e7744f587405fa21b82ef47` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:50.605150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d8750-2e0e-4351-9c6b-d14529b09e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc921a54e7744f587405fa21b82ef47)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:50.607107 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d8750-2e0e-4351-9c6b-d14529b09e84 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:50.821588 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-073d8750-2e0e-4351-9c6b-d14529b09e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc921a54e7744f587405fa21b82ef47'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:50.828420 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-073d8750-2e0e-4351-9c6b-d14529b09e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc921a54e7744f587405fa21b82ef47'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:50.829117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-073d8750-2e0e-4351-9c6b-d14529b09e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc921a54e7744f587405fa21b82ef47'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:50.841900 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-073d8750-2e0e-4351-9c6b-d14529b09e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc921a54e7744f587405fa21b82ef47'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:50.934706 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-073d8750-2e0e-4351-9c6b-d14529b09e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc921a54e7744f587405fa21b82ef47'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:50.941740 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1311/2642] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:37:50 2021] DELETE /identity/v3/users/1fc921a54e7744f587405fa21b82ef47 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:50.946596 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1572b4-e0aa-43aa-a85e-9b76c3002aa7 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:50.946914 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1572b4-e0aa-43aa-a85e-9b76c3002aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:50.947189 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1572b4-e0aa-43aa-a85e-9b76c3002aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:50.966131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-4a1572b4-e0aa-43aa-a85e-9b76c3002aa7 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:50.967345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4a1572b4-e0aa-43aa-a85e-9b76c3002aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:51.027757 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1332/2643] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:51.038417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d8750-2e0e-4351-9c6b-d14529b09e84 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:51.039851 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-073d8750-2e0e-4351-9c6b-d14529b09e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:51.096833 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d8750-2e0e-4351-9c6b-d14529b09e84 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:51.100671 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0e4b0-2fff-4515-816f-4fbeed9c1782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:51.101312 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e4b0-2fff-4515-816f-4fbeed9c1782 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:51.101589 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e4b0-2fff-4515-816f-4fbeed9c1782 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:51.101857 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e4b0-2fff-4515-816f-4fbeed9c1782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:51.110817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0e4b0-2fff-4515-816f-4fbeed9c1782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:51.112249 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0e4b0-2fff-4515-816f-4fbeed9c1782 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:51.121809 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1312/2644] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:37:51.583605 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1572b4-e0aa-43aa-a85e-9b76c3002aa7 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:51.585134 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4a1572b4-e0aa-43aa-a85e-9b76c3002aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:51.600450 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1572b4-e0aa-43aa-a85e-9b76c3002aa7 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:51.606135 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:51.607333 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:51.607697 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:51.608113 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] PATH_INFO: `/v3/projects/18ff7c7c6e2e496aa857aea23c29e2b2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:51.610233 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18ff7c7c6e2e496aa857aea23c29e2b2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:51.615097 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:51.724683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18ff7c7c6e2e496aa857aea23c29e2b2', 'request_id': 'req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:51.797741 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18ff7c7c6e2e496aa857aea23c29e2b2', 'request_id': 'req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:51.804422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18ff7c7c6e2e496aa857aea23c29e2b2', 'request_id': 'req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:51.821032 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] The token cache is being invalidate because project 18ff7c7c6e2e496aa857aea23c29e2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:37:51.821327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:51.821970 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:51.823512 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1333/2645] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:37:51 2021] DELETE /identity/v3/projects/18ff7c7c6e2e496aa857aea23c29e2b2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:51.827557 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0e4b0-2fff-4515-816f-4fbeed9c1782 service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:51.838701 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0e4b0-2fff-4515-816f-4fbeed9c1782 service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:51.896311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed879d-1366-402d-ba9a-985475d58a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:51.897177 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed879d-1366-402d-ba9a-985475d58a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:51.901531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed879d-1366-402d-ba9a-985475d58a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:51.901531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed879d-1366-402d-ba9a-985475d58a8f admin admin] PATH_INFO: `/v3/users/628d167538b94cf3bb76a650fe0c00e2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:51.901531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed879d-1366-402d-ba9a-985475d58a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=628d167538b94cf3bb76a650fe0c00e2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:51.901531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed879d-1366-402d-ba9a-985475d58a8f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:52.111393 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-47ed879d-1366-402d-ba9a-985475d58a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '628d167538b94cf3bb76a650fe0c00e2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:52.120381 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-47ed879d-1366-402d-ba9a-985475d58a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '628d167538b94cf3bb76a650fe0c00e2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:52.121205 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-47ed879d-1366-402d-ba9a-985475d58a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '628d167538b94cf3bb76a650fe0c00e2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:52.139368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-47ed879d-1366-402d-ba9a-985475d58a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '628d167538b94cf3bb76a650fe0c00e2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:52.252874 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-47ed879d-1366-402d-ba9a-985475d58a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '628d167538b94cf3bb76a650fe0c00e2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:52.260773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1313/2646] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:37:51 2021] DELETE /identity/v3/users/628d167538b94cf3bb76a650fe0c00e2 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:52.659780 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:52.666145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:52.682982 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b5f8-8d7c-4a1d-8659-fc8068b3ea51 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:52.747049 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:52.747958 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:52.748387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:52.748672 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c admin admin] PATH_INFO: `/v3/projects/dfc15d32e5d145d98a93c7d6a4b1e9e4` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:52.749988 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc15d32e5d145d98a93c7d6a4b1e9e4)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:52.751935 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:52.874732 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc15d32e5d145d98a93c7d6a4b1e9e4', 'request_id': 'req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:52.944272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc15d32e5d145d98a93c7d6a4b1e9e4', 'request_id': 'req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:52.950189 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc15d32e5d145d98a93c7d6a4b1e9e4', 'request_id': 'req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:52.962734 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c admin admin] The token cache is being invalidate because project dfc15d32e5d145d98a93c7d6a4b1e9e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:37:52.964922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:52.964922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-109ce866-95c2-4fc7-8d9e-fa0ebd85ef8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:52.965349 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1334/2647] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:37:52 2021] DELETE /identity/v3/projects/dfc15d32e5d145d98a93c7d6a4b1e9e4 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:52.971480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0d468-87b5-4f7f-ab29-534e14067dee None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:52.971830 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0d468-87b5-4f7f-ab29-534e14067dee None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:52.972770 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0d468-87b5-4f7f-ab29-534e14067dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:52.992623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-19b0d468-87b5-4f7f-ab29-534e14067dee None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:52.994000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-19b0d468-87b5-4f7f-ab29-534e14067dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:53.058217 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1314/2648] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:53.066912 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2963592-89d3-4f6d-9a24-68654d61ee86 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:53.067222 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2963592-89d3-4f6d-9a24-68654d61ee86 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:53.067525 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2963592-89d3-4f6d-9a24-68654d61ee86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:53.086832 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-d2963592-89d3-4f6d-9a24-68654d61ee86 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:53.088119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-d2963592-89d3-4f6d-9a24-68654d61ee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:53.096073 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1335/2649] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:53.101301 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0d468-87b5-4f7f-ab29-534e14067dee None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:53.111774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0d468-87b5-4f7f-ab29-534e14067dee None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:53.117753 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f31093-442a-4257-abf0-7de6a8775a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:53.118417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f31093-442a-4257-abf0-7de6a8775a27 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:53.118709 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f31093-442a-4257-abf0-7de6a8775a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:53.119013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f31093-442a-4257-abf0-7de6a8775a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:53.119717 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f31093-442a-4257-abf0-7de6a8775a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:37:53.120123 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f31093-442a-4257-abf0-7de6a8775a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:53.121707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f31093-442a-4257-abf0-7de6a8775a27 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:53.134888 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1315/2650] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:37:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:37:53.139231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2963592-89d3-4f6d-9a24-68654d61ee86 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:53.148701 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2963592-89d3-4f6d-9a24-68654d61ee86 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:53.153479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663c784-0358-45e9-a9bc-147dafe18608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:53.154139 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c784-0358-45e9-a9bc-147dafe18608 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:53.154419 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c784-0358-45e9-a9bc-147dafe18608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:53.154692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c784-0358-45e9-a9bc-147dafe18608 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:53.155399 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663c784-0358-45e9-a9bc-147dafe18608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:53.157323 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663c784-0358-45e9-a9bc-147dafe18608 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:53.256355 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1336/2651] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:37:53 2021] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:53.260657 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f31093-442a-4257-abf0-7de6a8775a27 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:53.270389 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f31093-442a-4257-abf0-7de6a8775a27 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:53.381013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c79d26-f0d3-497e-b1e4-79d25ba184d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:53.381013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79d26-f0d3-497e-b1e4-79d25ba184d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:53.381013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79d26-f0d3-497e-b1e4-79d25ba184d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:53.381013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79d26-f0d3-497e-b1e4-79d25ba184d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:53.381553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c79d26-f0d3-497e-b1e4-79d25ba184d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:53.381553 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c79d26-f0d3-497e-b1e4-79d25ba184d6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:53.523826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1316/2652] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:37:53 2021] POST /identity/v3/users => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:53.527934 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663c784-0358-45e9-a9bc-147dafe18608 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:53.538319 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663c784-0358-45e9-a9bc-147dafe18608 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:53.542820 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3272d8-6e46-4f1a-9db0-3869ca908cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:53.543481 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3272d8-6e46-4f1a-9db0-3869ca908cde admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:53.543789 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3272d8-6e46-4f1a-9db0-3869ca908cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:53.544061 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3272d8-6e46-4f1a-9db0-3869ca908cde admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:53.544828 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3272d8-6e46-4f1a-9db0-3869ca908cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:53.546402 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3272d8-6e46-4f1a-9db0-3869ca908cde admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:53.557802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1337/2653] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:53.561910 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c79d26-f0d3-497e-b1e4-79d25ba184d6 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:53.572748 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c79d26-f0d3-497e-b1e4-79d25ba184d6 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:53.578521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae6428-5290-4aa7-befb-03f6eb706a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:53.578521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae6428-5290-4aa7-befb-03f6eb706a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:53.578521 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae6428-5290-4aa7-befb-03f6eb706a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:53.578928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae6428-5290-4aa7-befb-03f6eb706a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:53.579470 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae6428-5290-4aa7-befb-03f6eb706a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:53.581360 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae6428-5290-4aa7-befb-03f6eb706a35 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:53.592139 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1317/2654] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:53.596231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3272d8-6e46-4f1a-9db0-3869ca908cde admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:53.606352 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3272d8-6e46-4f1a-9db0-3869ca908cde admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:53.610955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73d0c2-df29-44c5-a8de-080f3b7e6ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:53.611851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73d0c2-df29-44c5-a8de-080f3b7e6ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:53.612134 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73d0c2-df29-44c5-a8de-080f3b7e6ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:53.612926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73d0c2-df29-44c5-a8de-080f3b7e6ff0 admin admin] PATH_INFO: `/v3/projects/6c4db3e3154e45c5a7fa2af29a062c89/users/c2c606e7a6b04c0e9ba264117a658eb1/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:53.628147 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73d0c2-df29-44c5-a8de-080f3b7e6ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4db3e3154e45c5a7fa2af29a062c89, user_id=c2c606e7a6b04c0e9ba264117a658eb1, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:53.631394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73d0c2-df29-44c5-a8de-080f3b7e6ff0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:53.732645 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1338/2655] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:53 2021] PUT /identity/v3/projects/6c4db3e3154e45c5a7fa2af29a062c89/users/c2c606e7a6b04c0e9ba264117a658eb1/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:53.743684 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d616f-4a49-40bf-9b30-0eab4054e4fb None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:53.744014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d616f-4a49-40bf-9b30-0eab4054e4fb None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:53.744292 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d616f-4a49-40bf-9b30-0eab4054e4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:53.771238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-c57d616f-4a49-40bf-9b30-0eab4054e4fb None None] MFA Rules not processed for user `c2c606e7a6b04c0e9ba264117a658eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:53.772491 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c57d616f-4a49-40bf-9b30-0eab4054e4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:53.837356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1318/2656] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:53 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:53.841868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73d0c2-df29-44c5-a8de-080f3b7e6ff0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:53.907581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73d0c2-df29-44c5-a8de-080f3b7e6ff0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:53.913343 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385241-24cd-4dfa-ac6f-26f908adb10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:53.914008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385241-24cd-4dfa-ac6f-26f908adb10d admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:53.914293 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385241-24cd-4dfa-ac6f-26f908adb10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:53.914605 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385241-24cd-4dfa-ac6f-26f908adb10d admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:53.915293 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385241-24cd-4dfa-ac6f-26f908adb10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:53.917598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385241-24cd-4dfa-ac6f-26f908adb10d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:54.002565 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1339/2657] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:37:53 2021] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:54.007485 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d616f-4a49-40bf-9b30-0eab4054e4fb None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:54.019446 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d616f-4a49-40bf-9b30-0eab4054e4fb None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:54.076602 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a52f64-7136-4858-8187-3e704cc1e51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:54.077167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52f64-7136-4858-8187-3e704cc1e51b admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:54.077456 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52f64-7136-4858-8187-3e704cc1e51b admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:54.078809 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52f64-7136-4858-8187-3e704cc1e51b admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:54.078809 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a52f64-7136-4858-8187-3e704cc1e51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:54.080597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a52f64-7136-4858-8187-3e704cc1e51b admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:54.184560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1319/2658] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:37:54 2021] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:37:54.188702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385241-24cd-4dfa-ac6f-26f908adb10d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:54.199818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385241-24cd-4dfa-ac6f-26f908adb10d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:54.206438 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a8fca-a14a-487d-b726-a50b39b4488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:54.207332 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a8fca-a14a-487d-b726-a50b39b4488a admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:54.207613 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a8fca-a14a-487d-b726-a50b39b4488a admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:54.207918 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a8fca-a14a-487d-b726-a50b39b4488a admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:54.208688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a8fca-a14a-487d-b726-a50b39b4488a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:54.210307 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a8fca-a14a-487d-b726-a50b39b4488a admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:54.224322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1340/2659] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:54 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:54.228741 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a52f64-7136-4858-8187-3e704cc1e51b admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:54.242729 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a52f64-7136-4858-8187-3e704cc1e51b admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:54.256430 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f9e30-f413-4972-895c-c09cbac7e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:54.257929 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f9e30-f413-4972-895c-c09cbac7e218 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:54.258441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f9e30-f413-4972-895c-c09cbac7e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:54.258702 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f9e30-f413-4972-895c-c09cbac7e218 admin admin] PATH_INFO: `/v3/projects/879a61afee274262b92bc0712ca5fc91/users/27e49352c90d4927903cb43e6f0f67b2/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:54.277379 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f9e30-f413-4972-895c-c09cbac7e218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879a61afee274262b92bc0712ca5fc91, user_id=27e49352c90d4927903cb43e6f0f67b2, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:54.280330 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f9e30-f413-4972-895c-c09cbac7e218 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:54.351171 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1320/2660] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:54 2021] PUT /identity/v3/projects/879a61afee274262b92bc0712ca5fc91/users/27e49352c90d4927903cb43e6f0f67b2/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:54.355252 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a8fca-a14a-487d-b726-a50b39b4488a admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:54.366433 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a8fca-a14a-487d-b726-a50b39b4488a admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:54.444819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26f904-6c22-4d9b-9550-bba1c9232a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:54.445648 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26f904-6c22-4d9b-9550-bba1c9232a10 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:54.446030 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26f904-6c22-4d9b-9550-bba1c9232a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:54.446404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26f904-6c22-4d9b-9550-bba1c9232a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:54.447278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26f904-6c22-4d9b-9550-bba1c9232a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:54.449086 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26f904-6c22-4d9b-9550-bba1c9232a10 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:54.462482 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1341/2661] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:54 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:54.467386 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f9e30-f413-4972-895c-c09cbac7e218 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:54.479295 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f9e30-f413-4972-895c-c09cbac7e218 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:54.484949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db89e8-754d-400d-86b5-2d56873b7b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:54.486081 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db89e8-754d-400d-86b5-2d56873b7b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:54.486434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db89e8-754d-400d-86b5-2d56873b7b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:54.486806 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db89e8-754d-400d-86b5-2d56873b7b01 admin admin] PATH_INFO: `/v3/projects/879a61afee274262b92bc0712ca5fc91/users/27e49352c90d4927903cb43e6f0f67b2/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:54.489284 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db89e8-754d-400d-86b5-2d56873b7b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879a61afee274262b92bc0712ca5fc91, user_id=27e49352c90d4927903cb43e6f0f67b2, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:54.492037 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db89e8-754d-400d-86b5-2d56873b7b01 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:54.509031 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1321/2662] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:54 2021] PUT /identity/v3/projects/879a61afee274262b92bc0712ca5fc91/users/27e49352c90d4927903cb43e6f0f67b2/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:37:54.521276 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed51393-8a97-43d4-b08f-47a1f4800591 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:54.521556 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed51393-8a97-43d4-b08f-47a1f4800591 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:54.521867 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed51393-8a97-43d4-b08f-47a1f4800591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:54.548694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-4ed51393-8a97-43d4-b08f-47a1f4800591 None None] MFA Rules not processed for user `27e49352c90d4927903cb43e6f0f67b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:54.550103 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-4ed51393-8a97-43d4-b08f-47a1f4800591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:54.618264 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1342/2663] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:54 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:54.629560 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db89e8-754d-400d-86b5-2d56873b7b01 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:54.631280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e1db89e8-754d-400d-86b5-2d56873b7b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:54.688302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db89e8-754d-400d-86b5-2d56873b7b01 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:54.692903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10550f25-4beb-440f-9125-ead0e98e4ffb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:54.693549 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10550f25-4beb-440f-9125-ead0e98e4ffb service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:54.693831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10550f25-4beb-440f-9125-ead0e98e4ffb service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:54.694105 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10550f25-4beb-440f-9125-ead0e98e4ffb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:54.704432 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10550f25-4beb-440f-9125-ead0e98e4ffb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:54.707044 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10550f25-4beb-440f-9125-ead0e98e4ffb service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:54.717339 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1322/2664] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:54 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:37:54.870575 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed51393-8a97-43d4-b08f-47a1f4800591 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:54.880862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed51393-8a97-43d4-b08f-47a1f4800591 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:54.884490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412bb0b-76ce-4a01-9d0e-570aee316b27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:54.885133 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412bb0b-76ce-4a01-9d0e-570aee316b27 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:54.885408 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412bb0b-76ce-4a01-9d0e-570aee316b27 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:54.885679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412bb0b-76ce-4a01-9d0e-570aee316b27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:54.941597 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412bb0b-76ce-4a01-9d0e-570aee316b27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:54.943046 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412bb0b-76ce-4a01-9d0e-570aee316b27 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:54.952066 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1343/2665] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:54 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:37:55.497491 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10550f25-4beb-440f-9125-ead0e98e4ffb service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:55.567080 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10550f25-4beb-440f-9125-ead0e98e4ffb service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:55.571745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64676-3225-45b7-94f1-edfc17d7b62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:55.572617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64676-3225-45b7-94f1-edfc17d7b62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:55.572901 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64676-3225-45b7-94f1-edfc17d7b62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:55.573241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64676-3225-45b7-94f1-edfc17d7b62c admin admin] PATH_INFO: `/v3/users/c2c606e7a6b04c0e9ba264117a658eb1` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:55.574443 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d64676-3225-45b7-94f1-edfc17d7b62c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c606e7a6b04c0e9ba264117a658eb1)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:55.576388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d64676-3225-45b7-94f1-edfc17d7b62c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:55.779212 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-23d64676-3225-45b7-94f1-edfc17d7b62c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c606e7a6b04c0e9ba264117a658eb1'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:55.786712 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-23d64676-3225-45b7-94f1-edfc17d7b62c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c606e7a6b04c0e9ba264117a658eb1'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:55.787423 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-23d64676-3225-45b7-94f1-edfc17d7b62c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c606e7a6b04c0e9ba264117a658eb1'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:55.800356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-23d64676-3225-45b7-94f1-edfc17d7b62c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c606e7a6b04c0e9ba264117a658eb1'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:55.883198 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-23d64676-3225-45b7-94f1-edfc17d7b62c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c606e7a6b04c0e9ba264117a658eb1'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:55.889711 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1323/2666] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:37:55 2021] DELETE /identity/v3/users/c2c606e7a6b04c0e9ba264117a658eb1 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:55.894922 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36db99b-c615-4992-9851-00da692923dc None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:55.895462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36db99b-c615-4992-9851-00da692923dc None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:55.895462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36db99b-c615-4992-9851-00da692923dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:55.913716 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-c36db99b-c615-4992-9851-00da692923dc None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:55.916089 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c36db99b-c615-4992-9851-00da692923dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:55.982491 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1344/2667] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:55.995010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64676-3225-45b7-94f1-edfc17d7b62c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:55.997252 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-23d64676-3225-45b7-94f1-edfc17d7b62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:56.059638 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64676-3225-45b7-94f1-edfc17d7b62c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:56.063426 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a93db-ef0e-4120-b5fd-3823b81c520e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:56.064119 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a93db-ef0e-4120-b5fd-3823b81c520e service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:56.064422 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a93db-ef0e-4120-b5fd-3823b81c520e service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:56.064702 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a93db-ef0e-4120-b5fd-3823b81c520e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:56.074969 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a93db-ef0e-4120-b5fd-3823b81c520e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:56.076621 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a93db-ef0e-4120-b5fd-3823b81c520e service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:56.100156 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1324/2668] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:37:56.542718 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36db99b-c615-4992-9851-00da692923dc None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:56.544214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c36db99b-c615-4992-9851-00da692923dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:56.558633 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36db99b-c615-4992-9851-00da692923dc None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:56.563581 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:56.564511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:56.564749 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:56.565815 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] PATH_INFO: `/v3/projects/6c4db3e3154e45c5a7fa2af29a062c89` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:56.567461 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4db3e3154e45c5a7fa2af29a062c89)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:56.569563 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:56.679481 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4db3e3154e45c5a7fa2af29a062c89', 'request_id': 'req-17b71893-a54b-410d-bf3a-37bd3bd1defa'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:56.757749 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4db3e3154e45c5a7fa2af29a062c89', 'request_id': 'req-17b71893-a54b-410d-bf3a-37bd3bd1defa'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:56.763668 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4db3e3154e45c5a7fa2af29a062c89', 'request_id': 'req-17b71893-a54b-410d-bf3a-37bd3bd1defa'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:56.776280 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] The token cache is being invalidate because project 6c4db3e3154e45c5a7fa2af29a062c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:37:56.776704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:56.777359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:56.778899 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1345/2669] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:37:56 2021] DELETE /identity/v3/projects/6c4db3e3154e45c5a7fa2af29a062c89 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:56.782903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a93db-ef0e-4120-b5fd-3823b81c520e service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:56.792518 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a93db-ef0e-4120-b5fd-3823b81c520e service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:56.853515 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd884a-fb2f-4ac9-8e34-5020299808ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:56.856352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd884a-fb2f-4ac9-8e34-5020299808ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:56.856352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd884a-fb2f-4ac9-8e34-5020299808ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:56.856352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd884a-fb2f-4ac9-8e34-5020299808ae admin admin] PATH_INFO: `/v3/users/27e49352c90d4927903cb43e6f0f67b2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:56.857441 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd884a-fb2f-4ac9-8e34-5020299808ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e49352c90d4927903cb43e6f0f67b2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:56.859961 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd884a-fb2f-4ac9-8e34-5020299808ae admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:57.066159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d5dd884a-fb2f-4ac9-8e34-5020299808ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e49352c90d4927903cb43e6f0f67b2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:57.072935 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d5dd884a-fb2f-4ac9-8e34-5020299808ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e49352c90d4927903cb43e6f0f67b2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:57.073598 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d5dd884a-fb2f-4ac9-8e34-5020299808ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e49352c90d4927903cb43e6f0f67b2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:57.085871 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d5dd884a-fb2f-4ac9-8e34-5020299808ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e49352c90d4927903cb43e6f0f67b2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:57.192686 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-d5dd884a-fb2f-4ac9-8e34-5020299808ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e49352c90d4927903cb43e6f0f67b2'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:57.199013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1325/2670] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:37:56 2021] DELETE /identity/v3/users/27e49352c90d4927903cb43e6f0f67b2 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:57.649779 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:57.651541 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:57.668405 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b71893-a54b-410d-bf3a-37bd3bd1defa admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:57.726478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238d79e-a930-4775-ba33-3068a2f1107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:57.727368 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238d79e-a930-4775-ba33-3068a2f1107c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:57.727652 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238d79e-a930-4775-ba33-3068a2f1107c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:57.727956 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238d79e-a930-4775-ba33-3068a2f1107c admin admin] PATH_INFO: `/v3/projects/879a61afee274262b92bc0712ca5fc91` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:57.729155 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238d79e-a930-4775-ba33-3068a2f1107c admin admin] RBAC: Authorizing `identity:delete_project(project_id=879a61afee274262b92bc0712ca5fc91)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:57.731037 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238d79e-a930-4775-ba33-3068a2f1107c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:57.835837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2238d79e-a930-4775-ba33-3068a2f1107c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879a61afee274262b92bc0712ca5fc91', 'request_id': 'req-2238d79e-a930-4775-ba33-3068a2f1107c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:57.898536 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2238d79e-a930-4775-ba33-3068a2f1107c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879a61afee274262b92bc0712ca5fc91', 'request_id': 'req-2238d79e-a930-4775-ba33-3068a2f1107c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:57.904267 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2238d79e-a930-4775-ba33-3068a2f1107c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879a61afee274262b92bc0712ca5fc91', 'request_id': 'req-2238d79e-a930-4775-ba33-3068a2f1107c'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:57.916538 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2238d79e-a930-4775-ba33-3068a2f1107c admin admin] The token cache is being invalidate because project 879a61afee274262b92bc0712ca5fc91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:37:57.916815 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2238d79e-a930-4775-ba33-3068a2f1107c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:57.917538 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-2238d79e-a930-4775-ba33-3068a2f1107c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:37:57.919078 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1346/2671] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:37:57 2021] DELETE /identity/v3/projects/879a61afee274262b92bc0712ca5fc91 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:57.926791 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaf213-4e3a-4719-b247-60ffefe00b0c None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:57.927399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaf213-4e3a-4719-b247-60ffefe00b0c None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:57.927399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaf213-4e3a-4719-b247-60ffefe00b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:57.945185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-0cdaf213-4e3a-4719-b247-60ffefe00b0c None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:57.946376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-0cdaf213-4e3a-4719-b247-60ffefe00b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:58.006214 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1326/2672] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:58.014738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a219-e766-4b58-a93a-fbcfb8dd8209 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:58.015022 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a219-e766-4b58-a93a-fbcfb8dd8209 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:58.015296 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a219-e766-4b58-a93a-fbcfb8dd8209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:58.034923 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-5a73a219-e766-4b58-a93a-fbcfb8dd8209 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:58.036206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-5a73a219-e766-4b58-a93a-fbcfb8dd8209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:58.043988 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1347/2673] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:58.048221 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaf213-4e3a-4719-b247-60ffefe00b0c None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:58.058001 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaf213-4e3a-4719-b247-60ffefe00b0c None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:58.062604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a7a4c-98a0-4419-b407-830eaa0fe3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:58.063245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a7a4c-98a0-4419-b407-830eaa0fe3ff admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:58.063520 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a7a4c-98a0-4419-b407-830eaa0fe3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:58.063823 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a7a4c-98a0-4419-b407-830eaa0fe3ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:58.064580 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a7a4c-98a0-4419-b407-830eaa0fe3ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:37:58.064880 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a7a4c-98a0-4419-b407-830eaa0fe3ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:58.067245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a7a4c-98a0-4419-b407-830eaa0fe3ff admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:58.083871 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1327/2674] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:37:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:37:58.085126 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73a219-e766-4b58-a93a-fbcfb8dd8209 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:58.094716 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73a219-e766-4b58-a93a-fbcfb8dd8209 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:58.100568 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30825ab7-8840-456a-b263-31102c8f0015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:58.101230 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30825ab7-8840-456a-b263-31102c8f0015 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:58.101510 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30825ab7-8840-456a-b263-31102c8f0015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:58.101780 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30825ab7-8840-456a-b263-31102c8f0015 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:58.102490 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30825ab7-8840-456a-b263-31102c8f0015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:58.104947 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30825ab7-8840-456a-b263-31102c8f0015 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:58.231598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1348/2675] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:37:58 2021] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:58.241698 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a7a4c-98a0-4419-b407-830eaa0fe3ff admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:58.252382 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a7a4c-98a0-4419-b407-830eaa0fe3ff admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:58.309392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504b094-55c8-49d5-a5fd-1d1c4af8aa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:58.310057 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504b094-55c8-49d5-a5fd-1d1c4af8aa37 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:58.310334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504b094-55c8-49d5-a5fd-1d1c4af8aa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:58.310604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504b094-55c8-49d5-a5fd-1d1c4af8aa37 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:58.311388 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504b094-55c8-49d5-a5fd-1d1c4af8aa37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:58.313287 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504b094-55c8-49d5-a5fd-1d1c4af8aa37 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:58.467623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1328/2676] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:37:58 2021] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:58.468925 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30825ab7-8840-456a-b263-31102c8f0015 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:58.480057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30825ab7-8840-456a-b263-31102c8f0015 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:58.484896 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e3a41-792a-4b1e-837e-3a3c16ec0239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:58.485683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e3a41-792a-4b1e-837e-3a3c16ec0239 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:58.485965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e3a41-792a-4b1e-837e-3a3c16ec0239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:58.486236 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e3a41-792a-4b1e-837e-3a3c16ec0239 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:58.486971 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e3a41-792a-4b1e-837e-3a3c16ec0239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:58.489556 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e3a41-792a-4b1e-837e-3a3c16ec0239 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:58.500321 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1349/2677] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:58 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:58.505902 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504b094-55c8-49d5-a5fd-1d1c4af8aa37 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:58.516792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504b094-55c8-49d5-a5fd-1d1c4af8aa37 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:58.522826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746f003-2379-487a-b65c-790870c580fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:58.523601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746f003-2379-487a-b65c-790870c580fb admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:58.523905 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746f003-2379-487a-b65c-790870c580fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:58.524173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746f003-2379-487a-b65c-790870c580fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:58.524911 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746f003-2379-487a-b65c-790870c580fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:58.526662 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746f003-2379-487a-b65c-790870c580fb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:58.538581 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1329/2678] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:58 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:58.542328 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e3a41-792a-4b1e-837e-3a3c16ec0239 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:58.553437 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e3a41-792a-4b1e-837e-3a3c16ec0239 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:58.558131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc6aac-0bd3-4dba-ab7f-9ec96865e4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:58.559009 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc6aac-0bd3-4dba-ab7f-9ec96865e4be admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:58.559286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc6aac-0bd3-4dba-ab7f-9ec96865e4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:58.559556 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc6aac-0bd3-4dba-ab7f-9ec96865e4be admin admin] PATH_INFO: `/v3/projects/7cc100b68e914fa2a48f3122fd2581fa/users/7e1af52ff1cd4432a9bb2b173747d519/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:58.574719 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc6aac-0bd3-4dba-ab7f-9ec96865e4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc100b68e914fa2a48f3122fd2581fa, user_id=7e1af52ff1cd4432a9bb2b173747d519, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:58.577387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc6aac-0bd3-4dba-ab7f-9ec96865e4be admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:58.665133 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1350/2679] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:58 2021] PUT /identity/v3/projects/7cc100b68e914fa2a48f3122fd2581fa/users/7e1af52ff1cd4432a9bb2b173747d519/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:58.677018 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e940a-5708-41ce-a9fc-b78fa5933c54 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:58.677306 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e940a-5708-41ce-a9fc-b78fa5933c54 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:58.677585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e940a-5708-41ce-a9fc-b78fa5933c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:58.705431 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-857e940a-5708-41ce-a9fc-b78fa5933c54 None None] MFA Rules not processed for user `7e1af52ff1cd4432a9bb2b173747d519`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:58.707139 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-857e940a-5708-41ce-a9fc-b78fa5933c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:58.768356 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1330/2680] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:58 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:37:58.773662 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc6aac-0bd3-4dba-ab7f-9ec96865e4be admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:58.839959 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc6aac-0bd3-4dba-ab7f-9ec96865e4be admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:58.844688 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b2ae7-c0eb-4c4d-b2de-06e8b9b3470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:58.845354 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b2ae7-c0eb-4c4d-b2de-06e8b9b3470f admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:58.845631 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b2ae7-c0eb-4c4d-b2de-06e8b9b3470f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:58.845906 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b2ae7-c0eb-4c4d-b2de-06e8b9b3470f admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:58.846669 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b2ae7-c0eb-4c4d-b2de-06e8b9b3470f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:58.849286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b2ae7-c0eb-4c4d-b2de-06e8b9b3470f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:58.964391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1351/2681] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:37:58 2021] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:37:58.968421 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e940a-5708-41ce-a9fc-b78fa5933c54 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:58.980149 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e940a-5708-41ce-a9fc-b78fa5933c54 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:59.037612 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7c8fa-5962-4f4e-ad9c-193d97652893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:59.038379 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7c8fa-5962-4f4e-ad9c-193d97652893 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:59.038662 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7c8fa-5962-4f4e-ad9c-193d97652893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:59.038962 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7c8fa-5962-4f4e-ad9c-193d97652893 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:59.039715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7c8fa-5962-4f4e-ad9c-193d97652893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:59.041690 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7c8fa-5962-4f4e-ad9c-193d97652893 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:59.183347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1331/2682] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:37:58 2021] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:37:59.187530 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b2ae7-c0eb-4c4d-b2de-06e8b9b3470f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:59.199613 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b2ae7-c0eb-4c4d-b2de-06e8b9b3470f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:59.204644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e05f8-ab51-48b0-b41a-cf5e49ec3a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:59.205787 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e05f8-ab51-48b0-b41a-cf5e49ec3a5c admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:59.206738 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e05f8-ab51-48b0-b41a-cf5e49ec3a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:59.207022 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e05f8-ab51-48b0-b41a-cf5e49ec3a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:59.208211 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e05f8-ab51-48b0-b41a-cf5e49ec3a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:59.210138 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e05f8-ab51-48b0-b41a-cf5e49ec3a5c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:59.221852 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1352/2683] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:59 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:37:59.225977 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7c8fa-5962-4f4e-ad9c-193d97652893 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:59.244795 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7c8fa-5962-4f4e-ad9c-193d97652893 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:59.250817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f2e2c-265b-4395-ae81-f64c79a3d531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:59.251982 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f2e2c-265b-4395-ae81-f64c79a3d531 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:59.252359 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f2e2c-265b-4395-ae81-f64c79a3d531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:59.253340 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f2e2c-265b-4395-ae81-f64c79a3d531 admin admin] PATH_INFO: `/v3/projects/6e5f576af38c49bb920afb46c73b9d7d/users/50d7c5b6445b440bb55e686901b3efd6/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:59.272556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f2e2c-265b-4395-ae81-f64c79a3d531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5f576af38c49bb920afb46c73b9d7d, user_id=50d7c5b6445b440bb55e686901b3efd6, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:59.275208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f2e2c-265b-4395-ae81-f64c79a3d531 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:59.408458 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1332/2684] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:59 2021] PUT /identity/v3/projects/6e5f576af38c49bb920afb46c73b9d7d/users/50d7c5b6445b440bb55e686901b3efd6/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:59.409757 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e05f8-ab51-48b0-b41a-cf5e49ec3a5c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:59.420538 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e05f8-ab51-48b0-b41a-cf5e49ec3a5c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:59.482284 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c305e2-d78b-49bd-9e89-0fc93dd954d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:59.482957 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c305e2-d78b-49bd-9e89-0fc93dd954d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:59.483237 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c305e2-d78b-49bd-9e89-0fc93dd954d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:59.483638 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c305e2-d78b-49bd-9e89-0fc93dd954d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:59.484450 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c305e2-d78b-49bd-9e89-0fc93dd954d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:59.486039 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c305e2-d78b-49bd-9e89-0fc93dd954d3 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:59.506887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1353/2685] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:37:59 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:37:59.511777 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f2e2c-265b-4395-ae81-f64c79a3d531 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:59.524900 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f2e2c-265b-4395-ae81-f64c79a3d531 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:59.530417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d685c-b596-40ee-b61d-0f1161241ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:59.531323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d685c-b596-40ee-b61d-0f1161241ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:59.531606 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d685c-b596-40ee-b61d-0f1161241ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:59.531944 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d685c-b596-40ee-b61d-0f1161241ca4 admin admin] PATH_INFO: `/v3/projects/6e5f576af38c49bb920afb46c73b9d7d/users/50d7c5b6445b440bb55e686901b3efd6/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:59.534013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d685c-b596-40ee-b61d-0f1161241ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5f576af38c49bb920afb46c73b9d7d, user_id=50d7c5b6445b440bb55e686901b3efd6, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:59.537876 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d685c-b596-40ee-b61d-0f1161241ca4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:59.551238 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1333/2686] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:37:59 2021] PUT /identity/v3/projects/6e5f576af38c49bb920afb46c73b9d7d/users/50d7c5b6445b440bb55e686901b3efd6/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:37:59.570106 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d0fe-2e23-4582-9d6e-007c814a5801 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:59.570262 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d0fe-2e23-4582-9d6e-007c814a5801 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:59.570760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d0fe-2e23-4582-9d6e-007c814a5801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:59.606232 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-5089d0fe-2e23-4582-9d6e-007c814a5801 None None] MFA Rules not processed for user `50d7c5b6445b440bb55e686901b3efd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:37:59.607539 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-5089d0fe-2e23-4582-9d6e-007c814a5801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:59.693545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1354/2687] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:37:59 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:37:59.702546 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d685c-b596-40ee-b61d-0f1161241ca4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:37:59.705428 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-028d685c-b596-40ee-b61d-0f1161241ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:37:59.769155 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d685c-b596-40ee-b61d-0f1161241ca4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:37:59.773391 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edbce3-8b32-4df4-9bcb-6a34be4f40ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:37:59.774062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edbce3-8b32-4df4-9bcb-6a34be4f40ab service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:37:59.774349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edbce3-8b32-4df4-9bcb-6a34be4f40ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:37:59.774623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edbce3-8b32-4df4-9bcb-6a34be4f40ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:37:59.832081 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edbce3-8b32-4df4-9bcb-6a34be4f40ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:37:59.833509 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edbce3-8b32-4df4-9bcb-6a34be4f40ab service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:37:59.842488 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1334/2688] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:37:59 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:38:02.978787 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089d0fe-2e23-4582-9d6e-007c814a5801 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:03.048210 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089d0fe-2e23-4582-9d6e-007c814a5801 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:03.053480 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba469a2d-2d04-41c1-8785-1dc2a326f533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:03.054360 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba469a2d-2d04-41c1-8785-1dc2a326f533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:03.055084 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba469a2d-2d04-41c1-8785-1dc2a326f533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:03.055084 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba469a2d-2d04-41c1-8785-1dc2a326f533 admin admin] PATH_INFO: `/v3/users/7e1af52ff1cd4432a9bb2b173747d519` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:03.056225 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba469a2d-2d04-41c1-8785-1dc2a326f533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1af52ff1cd4432a9bb2b173747d519)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:03.058160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba469a2d-2d04-41c1-8785-1dc2a326f533 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:03.374124 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ba469a2d-2d04-41c1-8785-1dc2a326f533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1af52ff1cd4432a9bb2b173747d519'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:03.374805 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ba469a2d-2d04-41c1-8785-1dc2a326f533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1af52ff1cd4432a9bb2b173747d519'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:03.387555 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ba469a2d-2d04-41c1-8785-1dc2a326f533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1af52ff1cd4432a9bb2b173747d519'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:03.394287 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ba469a2d-2d04-41c1-8785-1dc2a326f533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1af52ff1cd4432a9bb2b173747d519'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:03.495228 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-ba469a2d-2d04-41c1-8785-1dc2a326f533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1af52ff1cd4432a9bb2b173747d519'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:03.504390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1355/2689] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:38:02 2021] DELETE /identity/v3/users/7e1af52ff1cd4432a9bb2b173747d519 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:38:03.509023 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aabed5-1b2c-464e-aabc-9c193a49f791 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:03.509547 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aabed5-1b2c-464e-aabc-9c193a49f791 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:03.509547 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aabed5-1b2c-464e-aabc-9c193a49f791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:03.528643 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-a0aabed5-1b2c-464e-aabc-9c193a49f791 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:03.529861 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a0aabed5-1b2c-464e-aabc-9c193a49f791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:03.596359 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1335/2690] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:38:03.606888 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba469a2d-2d04-41c1-8785-1dc2a326f533 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:03.608609 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-ba469a2d-2d04-41c1-8785-1dc2a326f533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:03.668524 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba469a2d-2d04-41c1-8785-1dc2a326f533 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:03.672445 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1c70a-d03d-43b4-a25a-6ada93a1526c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:03.673112 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1c70a-d03d-43b4-a25a-6ada93a1526c service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:03.673392 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1c70a-d03d-43b4-a25a-6ada93a1526c service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:03.673664 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1c70a-d03d-43b4-a25a-6ada93a1526c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:03.684387 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1c70a-d03d-43b4-a25a-6ada93a1526c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:03.694722 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1c70a-d03d-43b4-a25a-6ada93a1526c service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:03.695515 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1356/2691] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:38:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:38:04.202751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aabed5-1b2c-464e-aabc-9c193a49f791 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:04.204300 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a0aabed5-1b2c-464e-aabc-9c193a49f791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:04.217312 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aabed5-1b2c-464e-aabc-9c193a49f791 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:04.222352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:04.223358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:04.223632 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:04.223951 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] PATH_INFO: `/v3/projects/7cc100b68e914fa2a48f3122fd2581fa` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:04.225322 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc100b68e914fa2a48f3122fd2581fa)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:04.227258 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:04.387392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc100b68e914fa2a48f3122fd2581fa', 'request_id': 'req-468d74f6-a3a3-4321-a398-a6720ebfb6b3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:04.458732 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc100b68e914fa2a48f3122fd2581fa', 'request_id': 'req-468d74f6-a3a3-4321-a398-a6720ebfb6b3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:04.464573 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc100b68e914fa2a48f3122fd2581fa', 'request_id': 'req-468d74f6-a3a3-4321-a398-a6720ebfb6b3'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:04.477101 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] The token cache is being invalidate because project 7cc100b68e914fa2a48f3122fd2581fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:38:04.477405 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:04.478022 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:04.479675 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1336/2692] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:38:04 2021] DELETE /identity/v3/projects/7cc100b68e914fa2a48f3122fd2581fa => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:04.483658 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1c70a-d03d-43b4-a25a-6ada93a1526c service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:04.494044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1c70a-d03d-43b4-a25a-6ada93a1526c service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:04.550465 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33705b-1d4a-436d-a698-416ec593bf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:04.551394 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33705b-1d4a-436d-a698-416ec593bf48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:04.551681 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33705b-1d4a-436d-a698-416ec593bf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:04.551994 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33705b-1d4a-436d-a698-416ec593bf48 admin admin] PATH_INFO: `/v3/users/50d7c5b6445b440bb55e686901b3efd6` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:04.553254 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33705b-1d4a-436d-a698-416ec593bf48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d7c5b6445b440bb55e686901b3efd6)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:04.555169 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33705b-1d4a-436d-a698-416ec593bf48 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:04.768141 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9f33705b-1d4a-436d-a698-416ec593bf48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d7c5b6445b440bb55e686901b3efd6'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:04.768874 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9f33705b-1d4a-436d-a698-416ec593bf48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d7c5b6445b440bb55e686901b3efd6'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:04.782140 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9f33705b-1d4a-436d-a698-416ec593bf48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d7c5b6445b440bb55e686901b3efd6'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:04.789422 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9f33705b-1d4a-436d-a698-416ec593bf48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d7c5b6445b440bb55e686901b3efd6'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:04.858092 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9f33705b-1d4a-436d-a698-416ec593bf48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d7c5b6445b440bb55e686901b3efd6'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:04.865931 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1357/2693] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:38:04 2021] DELETE /identity/v3/users/50d7c5b6445b440bb55e686901b3efd6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:38:05.384729 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:05.385474 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:05.400681 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d74f6-a3a3-4321-a398-a6720ebfb6b3 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:05.470964 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:05.472597 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:05.472879 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:05.473150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd admin admin] PATH_INFO: `/v3/projects/6e5f576af38c49bb920afb46c73b9d7d` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:05.474408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5f576af38c49bb920afb46c73b9d7d)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:05.476489 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:05.610278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5f576af38c49bb920afb46c73b9d7d', 'request_id': 'req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:05.698453 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5f576af38c49bb920afb46c73b9d7d', 'request_id': 'req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:05.704394 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5f576af38c49bb920afb46c73b9d7d', 'request_id': 'req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:05.716308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd admin admin] The token cache is being invalidate because project 6e5f576af38c49bb920afb46c73b9d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:38:05.716590 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:05.717232 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-beb7caee-70b9-43b1-97c8-3cebcb48c8cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:05.718748 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1337/2694] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:38:05 2021] DELETE /identity/v3/projects/6e5f576af38c49bb920afb46c73b9d7d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:05.725376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d3095-ed34-4b06-a7bf-29a16c407a46 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:05.725870 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d3095-ed34-4b06-a7bf-29a16c407a46 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:05.728595 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d3095-ed34-4b06-a7bf-29a16c407a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:05.744075 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-456d3095-ed34-4b06-a7bf-29a16c407a46 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:05.745294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-456d3095-ed34-4b06-a7bf-29a16c407a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:05.807487 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1358/2695] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:38:05.816010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b030-1c41-4939-be8c-8dd103fd6260 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:05.816375 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b030-1c41-4939-be8c-8dd103fd6260 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:05.816651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b030-1c41-4939-be8c-8dd103fd6260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:05.835547 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-9e62b030-1c41-4939-be8c-8dd103fd6260 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:05.836808 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-9e62b030-1c41-4939-be8c-8dd103fd6260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:05.844947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1338/2696] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:38:05.849562 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d3095-ed34-4b06-a7bf-29a16c407a46 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:05.859320 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d3095-ed34-4b06-a7bf-29a16c407a46 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:05.863995 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc88f3-ec9d-45a9-8cd9-8fe55f2d6f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:05.864650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc88f3-ec9d-45a9-8cd9-8fe55f2d6f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:05.864928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc88f3-ec9d-45a9-8cd9-8fe55f2d6f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:05.865198 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc88f3-ec9d-45a9-8cd9-8fe55f2d6f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:05.865935 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc88f3-ec9d-45a9-8cd9-8fe55f2d6f30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:38:05.866245 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc88f3-ec9d-45a9-8cd9-8fe55f2d6f30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:05.867861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc88f3-ec9d-45a9-8cd9-8fe55f2d6f30 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:05.881745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1359/2697] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:38:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:38:05.885532 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62b030-1c41-4939-be8c-8dd103fd6260 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:05.902826 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62b030-1c41-4939-be8c-8dd103fd6260 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:05.909280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e12e7-bebd-47ec-a766-17bf6228eacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:05.910040 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e12e7-bebd-47ec-a766-17bf6228eacb admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:05.910391 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e12e7-bebd-47ec-a766-17bf6228eacb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:05.910924 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e12e7-bebd-47ec-a766-17bf6228eacb admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:05.911549 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e12e7-bebd-47ec-a766-17bf6228eacb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:05.913558 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e12e7-bebd-47ec-a766-17bf6228eacb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:05.994933 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1339/2698] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:38:05 2021] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:38:05.998931 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc88f3-ec9d-45a9-8cd9-8fe55f2d6f30 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:06.010247 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc88f3-ec9d-45a9-8cd9-8fe55f2d6f30 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:06.077135 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fc51d-b4bc-4498-98c8-a231e79fc456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:06.078214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fc51d-b4bc-4498-98c8-a231e79fc456 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:06.078679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fc51d-b4bc-4498-98c8-a231e79fc456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:06.079117 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fc51d-b4bc-4498-98c8-a231e79fc456 admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:06.080824 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fc51d-b4bc-4498-98c8-a231e79fc456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:06.084822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fc51d-b4bc-4498-98c8-a231e79fc456 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:06.260449 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1360/2699] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:38:05 2021] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:38:06.265153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e12e7-bebd-47ec-a766-17bf6228eacb admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:06.276746 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e12e7-bebd-47ec-a766-17bf6228eacb admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:06.281868 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dfa7c-d5d6-4410-acc7-c4512b701b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:06.282549 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dfa7c-d5d6-4410-acc7-c4512b701b1c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:06.282827 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dfa7c-d5d6-4410-acc7-c4512b701b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:06.283100 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dfa7c-d5d6-4410-acc7-c4512b701b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:06.284519 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dfa7c-d5d6-4410-acc7-c4512b701b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:06.286170 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dfa7c-d5d6-4410-acc7-c4512b701b1c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:06.297079 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1340/2700] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:38:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:38:06.304401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fc51d-b4bc-4498-98c8-a231e79fc456 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:06.314443 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fc51d-b4bc-4498-98c8-a231e79fc456 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:06.319909 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867ecd1-153a-4001-9a64-195ce35ee462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:06.320569 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ecd1-153a-4001-9a64-195ce35ee462 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:06.333937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ecd1-153a-4001-9a64-195ce35ee462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:06.333937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ecd1-153a-4001-9a64-195ce35ee462 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:06.333937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867ecd1-153a-4001-9a64-195ce35ee462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:06.333937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867ecd1-153a-4001-9a64-195ce35ee462 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:06.334656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1361/2701] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:38:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:38:06.338836 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dfa7c-d5d6-4410-acc7-c4512b701b1c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:06.349954 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dfa7c-d5d6-4410-acc7-c4512b701b1c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:06.354651 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271f670-4574-4491-b5ff-2cf627d56c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:06.355548 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271f670-4574-4491-b5ff-2cf627d56c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:06.355867 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271f670-4574-4491-b5ff-2cf627d56c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:06.356135 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271f670-4574-4491-b5ff-2cf627d56c3f admin admin] PATH_INFO: `/v3/projects/b90d3e2ff25d4e278bae635d92501821/users/4af6614f9877488dbf4bf15dfd184e2d/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:06.372469 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271f670-4574-4491-b5ff-2cf627d56c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90d3e2ff25d4e278bae635d92501821, user_id=4af6614f9877488dbf4bf15dfd184e2d, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:06.375123 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271f670-4574-4491-b5ff-2cf627d56c3f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:06.484009 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1341/2702] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:38:06 2021] PUT /identity/v3/projects/b90d3e2ff25d4e278bae635d92501821/users/4af6614f9877488dbf4bf15dfd184e2d/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:06.496065 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39674586-82d2-42a7-aed8-5a8aae881fa3 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:06.496505 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39674586-82d2-42a7-aed8-5a8aae881fa3 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:06.497984 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39674586-82d2-42a7-aed8-5a8aae881fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:06.537007 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-39674586-82d2-42a7-aed8-5a8aae881fa3 None None] MFA Rules not processed for user `4af6614f9877488dbf4bf15dfd184e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:06.538272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-39674586-82d2-42a7-aed8-5a8aae881fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:06.619861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1362/2703] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:06 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:38:06.631583 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271f670-4574-4491-b5ff-2cf627d56c3f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:06.633465 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6271f670-4574-4491-b5ff-2cf627d56c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:06.700027 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271f670-4574-4491-b5ff-2cf627d56c3f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:06.704182 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe2904-49a9-4b35-9ea0-13013bdcfd3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:06.704833 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe2904-49a9-4b35-9ea0-13013bdcfd3a service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:06.705349 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe2904-49a9-4b35-9ea0-13013bdcfd3a service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:06.705625 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe2904-49a9-4b35-9ea0-13013bdcfd3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:06.715450 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe2904-49a9-4b35-9ea0-13013bdcfd3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:06.716911 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe2904-49a9-4b35-9ea0-13013bdcfd3a service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:06.726195 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1342/2704] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:38:06 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:38:10.562865 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39674586-82d2-42a7-aed8-5a8aae881fa3 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:10.564413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-39674586-82d2-42a7-aed8-5a8aae881fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:10.623656 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39674586-82d2-42a7-aed8-5a8aae881fa3 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:10.627552 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e97ed-3409-46a3-ba02-5b13df3eee2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:10.628680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e97ed-3409-46a3-ba02-5b13df3eee2f service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:10.628928 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e97ed-3409-46a3-ba02-5b13df3eee2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:10.629682 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e97ed-3409-46a3-ba02-5b13df3eee2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:10.631214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-211e97ed-3409-46a3-ba02-5b13df3eee2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:10.691846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e97ed-3409-46a3-ba02-5b13df3eee2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:10.693292 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e97ed-3409-46a3-ba02-5b13df3eee2f service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:10.702915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1363/2705] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:38:10 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:38:14.137752 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe2904-49a9-4b35-9ea0-13013bdcfd3a service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:14.140049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-6efe2904-49a9-4b35-9ea0-13013bdcfd3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:14.222183 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe2904-49a9-4b35-9ea0-13013bdcfd3a service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:14.227772 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b357f-7b28-4854-b2c4-316b5fe687cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:14.228891 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b357f-7b28-4854-b2c4-316b5fe687cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:14.229266 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b357f-7b28-4854-b2c4-316b5fe687cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:14.229715 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b357f-7b28-4854-b2c4-316b5fe687cb admin admin] PATH_INFO: `/v3/users/3c7b600cfde24de9809afe2b55db97cf` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:14.231353 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b357f-7b28-4854-b2c4-316b5fe687cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7b600cfde24de9809afe2b55db97cf)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:14.234037 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b357f-7b28-4854-b2c4-316b5fe687cb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:14.497936 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c4b357f-7b28-4854-b2c4-316b5fe687cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7b600cfde24de9809afe2b55db97cf'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:14.507773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c4b357f-7b28-4854-b2c4-316b5fe687cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7b600cfde24de9809afe2b55db97cf'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:14.515775 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c4b357f-7b28-4854-b2c4-316b5fe687cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7b600cfde24de9809afe2b55db97cf'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:14.530185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c4b357f-7b28-4854-b2c4-316b5fe687cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7b600cfde24de9809afe2b55db97cf'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:14.598480 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3c4b357f-7b28-4854-b2c4-316b5fe687cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7b600cfde24de9809afe2b55db97cf'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:14.605153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1343/2706] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:38:14 2021] DELETE /identity/v3/users/3c7b600cfde24de9809afe2b55db97cf => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:38:14.893941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e97ed-3409-46a3-ba02-5b13df3eee2f service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:14.916352 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e97ed-3409-46a3-ba02-5b13df3eee2f service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:14.988357 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8aed87-ef2b-476f-8721-b27d1858714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:14.989236 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aed87-ef2b-476f-8721-b27d1858714b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:14.989513 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aed87-ef2b-476f-8721-b27d1858714b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:14.990531 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aed87-ef2b-476f-8721-b27d1858714b admin admin] PATH_INFO: `/v3/projects/b8778e689b6e42e2b16d49b3fe762ac6` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:14.991203 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8aed87-ef2b-476f-8721-b27d1858714b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8778e689b6e42e2b16d49b3fe762ac6)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:14.993082 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8aed87-ef2b-476f-8721-b27d1858714b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:15.117546 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9e8aed87-ef2b-476f-8721-b27d1858714b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8778e689b6e42e2b16d49b3fe762ac6', 'request_id': 'req-9e8aed87-ef2b-476f-8721-b27d1858714b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:15.232098 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9e8aed87-ef2b-476f-8721-b27d1858714b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8778e689b6e42e2b16d49b3fe762ac6', 'request_id': 'req-9e8aed87-ef2b-476f-8721-b27d1858714b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:15.238769 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9e8aed87-ef2b-476f-8721-b27d1858714b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8778e689b6e42e2b16d49b3fe762ac6', 'request_id': 'req-9e8aed87-ef2b-476f-8721-b27d1858714b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:15.250190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9e8aed87-ef2b-476f-8721-b27d1858714b admin admin] The token cache is being invalidate because project b8778e689b6e42e2b16d49b3fe762ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:38:15.250500 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9e8aed87-ef2b-476f-8721-b27d1858714b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:15.251143 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-9e8aed87-ef2b-476f-8721-b27d1858714b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:15.253225 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1364/2707] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:38:14 2021] DELETE /identity/v3/projects/b8778e689b6e42e2b16d49b3fe762ac6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:15.259679 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf2f47-4873-4c0e-8c25-a01b9dbfdec1 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:15.260476 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf2f47-4873-4c0e-8c25-a01b9dbfdec1 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:15.260476 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf2f47-4873-4c0e-8c25-a01b9dbfdec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:15.281150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-11cf2f47-4873-4c0e-8c25-a01b9dbfdec1 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:15.282481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-11cf2f47-4873-4c0e-8c25-a01b9dbfdec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:15.347295 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1344/2708] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:38:15.355848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de73f25-3e78-48a1-b7e1-0a193ec0c71d None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:15.356197 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de73f25-3e78-48a1-b7e1-0a193ec0c71d None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:15.356479 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de73f25-3e78-48a1-b7e1-0a193ec0c71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:15.376202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-3de73f25-3e78-48a1-b7e1-0a193ec0c71d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:15.378683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-3de73f25-3e78-48a1-b7e1-0a193ec0c71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:15.387375 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1365/2709] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:38:15.391858 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf2f47-4873-4c0e-8c25-a01b9dbfdec1 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:15.402721 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf2f47-4873-4c0e-8c25-a01b9dbfdec1 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:15.407581 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6c4e4-c284-43f8-a59f-985eba6ad1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:15.408270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6c4e4-c284-43f8-a59f-985eba6ad1ce admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:15.408621 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6c4e4-c284-43f8-a59f-985eba6ad1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:15.409013 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6c4e4-c284-43f8-a59f-985eba6ad1ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:15.409756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6c4e4-c284-43f8-a59f-985eba6ad1ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:38:15.410068 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6c4e4-c284-43f8-a59f-985eba6ad1ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:15.411759 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6c4e4-c284-43f8-a59f-985eba6ad1ce admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:15.423556 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1345/2710] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:38:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 01:38:15.428205 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de73f25-3e78-48a1-b7e1-0a193ec0c71d None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:15.438064 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de73f25-3e78-48a1-b7e1-0a193ec0c71d None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:15.444184 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b1384-b171-4bfb-94a6-be5a0dcb0c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:15.444883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b1384-b171-4bfb-94a6-be5a0dcb0c87 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:15.445160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b1384-b171-4bfb-94a6-be5a0dcb0c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:15.445429 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b1384-b171-4bfb-94a6-be5a0dcb0c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:15.446160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b1384-b171-4bfb-94a6-be5a0dcb0c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:15.448086 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b1384-b171-4bfb-94a6-be5a0dcb0c87 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:15.542745 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1366/2711] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:38:15 2021] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:38:15.548012 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6c4e4-c284-43f8-a59f-985eba6ad1ce admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:15.559722 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6c4e4-c284-43f8-a59f-985eba6ad1ce admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:15.630539 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c53266-3040-4bfb-a3c7-d3781d95dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:15.631224 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c53266-3040-4bfb-a3c7-d3781d95dd64 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:15.631505 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c53266-3040-4bfb-a3c7-d3781d95dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:15.631803 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c53266-3040-4bfb-a3c7-d3781d95dd64 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:15.632535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c53266-3040-4bfb-a3c7-d3781d95dd64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:15.634461 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c53266-3040-4bfb-a3c7-d3781d95dd64 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:15.746966 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1346/2712] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:38:15 2021] POST /identity/v3/users => generated 303 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:38:15.751448 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b1384-b171-4bfb-94a6-be5a0dcb0c87 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:15.762568 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b1384-b171-4bfb-94a6-be5a0dcb0c87 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:15.769391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf1a43-b9dd-478a-a5a6-9963bd889132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:15.769391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1a43-b9dd-478a-a5a6-9963bd889132 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:15.769391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1a43-b9dd-478a-a5a6-9963bd889132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:15.769391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1a43-b9dd-478a-a5a6-9963bd889132 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:15.769943 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf1a43-b9dd-478a-a5a6-9963bd889132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:15.770746 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf1a43-b9dd-478a-a5a6-9963bd889132 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:15.781883 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1367/2713] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:38:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:38:15.786241 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c53266-3040-4bfb-a3c7-d3781d95dd64 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:15.796997 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c53266-3040-4bfb-a3c7-d3781d95dd64 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:15.802970 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaec893-7ed3-4913-abc4-e225471cced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:15.803633 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaec893-7ed3-4913-abc4-e225471cced1 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:15.803960 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaec893-7ed3-4913-abc4-e225471cced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:15.804242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaec893-7ed3-4913-abc4-e225471cced1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:15.805027 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaec893-7ed3-4913-abc4-e225471cced1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:15.806622 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaec893-7ed3-4913-abc4-e225471cced1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:15.818494 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1347/2714] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:38:15 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:38:15.822756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf1a43-b9dd-478a-a5a6-9963bd889132 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:15.833830 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf1a43-b9dd-478a-a5a6-9963bd889132 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:15.838462 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cea22-f66b-4de4-ae2c-8697c905b5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:15.839363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cea22-f66b-4de4-ae2c-8697c905b5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:15.839638 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cea22-f66b-4de4-ae2c-8697c905b5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:15.839939 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cea22-f66b-4de4-ae2c-8697c905b5b8 admin admin] PATH_INFO: `/v3/projects/846e2e7c1f01476c9ac1288c4166f9a3/users/0c56067ca7854eac8caebaf400a8242b/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:15.854728 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cea22-f66b-4de4-ae2c-8697c905b5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=846e2e7c1f01476c9ac1288c4166f9a3, user_id=0c56067ca7854eac8caebaf400a8242b, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:15.857399 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cea22-f66b-4de4-ae2c-8697c905b5b8 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:15.969700 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1368/2715] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:38:15 2021] PUT /identity/v3/projects/846e2e7c1f01476c9ac1288c4166f9a3/users/0c56067ca7854eac8caebaf400a8242b/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:38:15.981317 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb0049-a640-4f5d-917f-f0e47bd934e1 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:15.981599 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb0049-a640-4f5d-917f-f0e47bd934e1 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:15.981869 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb0049-a640-4f5d-917f-f0e47bd934e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:16.012527 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d1fb0049-a640-4f5d-917f-f0e47bd934e1 None None] MFA Rules not processed for user `0c56067ca7854eac8caebaf400a8242b`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:16.013743 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d1fb0049-a640-4f5d-917f-f0e47bd934e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:16.085714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1348/2716] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:15 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:38:16.090209 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cea22-f66b-4de4-ae2c-8697c905b5b8 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:16.156231 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cea22-f66b-4de4-ae2c-8697c905b5b8 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:16.162158 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfb271-bbae-41c9-8272-398051224f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:16.162828 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfb271-bbae-41c9-8272-398051224f0d admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:16.163106 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfb271-bbae-41c9-8272-398051224f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:16.163377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfb271-bbae-41c9-8272-398051224f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:16.164125 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfb271-bbae-41c9-8272-398051224f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:16.166031 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfb271-bbae-41c9-8272-398051224f0d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:16.294571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1369/2717] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:38:16 2021] POST /identity/v3/projects => generated 403 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:38:16.298761 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb0049-a640-4f5d-917f-f0e47bd934e1 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:16.311154 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb0049-a640-4f5d-917f-f0e47bd934e1 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:16.372014 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d47677-fcc9-4d6e-abb3-714cad6eb5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:16.372599 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d47677-fcc9-4d6e-abb3-714cad6eb5cd admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:16.372879 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d47677-fcc9-4d6e-abb3-714cad6eb5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:16.373150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d47677-fcc9-4d6e-abb3-714cad6eb5cd admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:16.373859 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d47677-fcc9-4d6e-abb3-714cad6eb5cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:16.375779 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d47677-fcc9-4d6e-abb3-714cad6eb5cd admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:16.519427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1349/2718] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:38:16 2021] POST /identity/v3/users => generated 308 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:38:16.523787 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfb271-bbae-41c9-8272-398051224f0d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:16.534412 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfb271-bbae-41c9-8272-398051224f0d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:16.539344 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b88f-be0a-4988-baa0-b5dab2fe1591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:16.540213 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b88f-be0a-4988-baa0-b5dab2fe1591 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:16.540496 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b88f-be0a-4988-baa0-b5dab2fe1591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:16.540770 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b88f-be0a-4988-baa0-b5dab2fe1591 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:16.541522 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3b88f-be0a-4988-baa0-b5dab2fe1591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:16.543160 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3b88f-be0a-4988-baa0-b5dab2fe1591 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:16.555599 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1370/2719] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:38:16 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:38:16.559999 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d47677-fcc9-4d6e-abb3-714cad6eb5cd admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:16.574047 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d47677-fcc9-4d6e-abb3-714cad6eb5cd admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:16.579233 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb2c70-bf71-4d48-a315-669c1a399b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:16.580430 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb2c70-bf71-4d48-a315-669c1a399b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:16.580939 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb2c70-bf71-4d48-a315-669c1a399b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:16.581790 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb2c70-bf71-4d48-a315-669c1a399b62 admin admin] PATH_INFO: `/v3/projects/158ef0178062498abad86d1e3de93509/users/3fb889929cfc4393a42731b23721cfc0/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:16.606117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb2c70-bf71-4d48-a315-669c1a399b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=158ef0178062498abad86d1e3de93509, user_id=3fb889929cfc4393a42731b23721cfc0, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:16.609159 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb2c70-bf71-4d48-a315-669c1a399b62 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:16.712265 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1350/2720] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:38:16 2021] PUT /identity/v3/projects/158ef0178062498abad86d1e3de93509/users/3fb889929cfc4393a42731b23721cfc0/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:16.718814 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b88f-be0a-4988-baa0-b5dab2fe1591 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:16.739804 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b88f-be0a-4988-baa0-b5dab2fe1591 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:16.800941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f7a82-dbf7-4f15-8e87-8f113665dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:16.801617 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f7a82-dbf7-4f15-8e87-8f113665dd08 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:16.801897 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f7a82-dbf7-4f15-8e87-8f113665dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:16.802171 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f7a82-dbf7-4f15-8e87-8f113665dd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:16.802913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f7a82-dbf7-4f15-8e87-8f113665dd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:16.804680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f7a82-dbf7-4f15-8e87-8f113665dd08 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:16.816221 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1371/2721] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:38:16 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:38:16.821696 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb2c70-bf71-4d48-a315-669c1a399b62 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:16.838551 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb2c70-bf71-4d48-a315-669c1a399b62 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:16.843681 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4dbeb-6a06-45a9-bbb1-866a0a90636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:16.844644 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4dbeb-6a06-45a9-bbb1-866a0a90636f admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:16.844928 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4dbeb-6a06-45a9-bbb1-866a0a90636f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:16.845222 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4dbeb-6a06-45a9-bbb1-866a0a90636f admin admin] PATH_INFO: `/v3/projects/158ef0178062498abad86d1e3de93509/users/3fb889929cfc4393a42731b23721cfc0/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:16.848671 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4dbeb-6a06-45a9-bbb1-866a0a90636f admin admin] RBAC: Authorizing `identity:create_grant(project_id=158ef0178062498abad86d1e3de93509, user_id=3fb889929cfc4393a42731b23721cfc0, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:16.851334 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4dbeb-6a06-45a9-bbb1-866a0a90636f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:16.864276 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1351/2722] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:38:16 2021] PUT /identity/v3/projects/158ef0178062498abad86d1e3de93509/users/3fb889929cfc4393a42731b23721cfc0/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:16.874760 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ef276-6f58-490d-b5d9-b8885d18e4f6 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:16.875059 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ef276-6f58-490d-b5d9-b8885d18e4f6 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:16.877390 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ef276-6f58-490d-b5d9-b8885d18e4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:16.906126 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-fe7ef276-6f58-490d-b5d9-b8885d18e4f6 None None] MFA Rules not processed for user `3fb889929cfc4393a42731b23721cfc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:16.907355 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-fe7ef276-6f58-490d-b5d9-b8885d18e4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:16.988644 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1372/2723] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:16 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:38:16.998992 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4dbeb-6a06-45a9-bbb1-866a0a90636f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:17.000893 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-ade4dbeb-6a06-45a9-bbb1-866a0a90636f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:17.065371 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4dbeb-6a06-45a9-bbb1-866a0a90636f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:17.069587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7092d5-fddb-4c66-814b-5f2e4470335a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:17.070430 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7092d5-fddb-4c66-814b-5f2e4470335a service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:17.075579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7092d5-fddb-4c66-814b-5f2e4470335a service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:17.075579 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7092d5-fddb-4c66-814b-5f2e4470335a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:17.082413 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7092d5-fddb-4c66-814b-5f2e4470335a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:17.083887 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7092d5-fddb-4c66-814b-5f2e4470335a service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:17.094543 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1352/2724] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:38:16 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:38:17.238090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ef276-6f58-490d-b5d9-b8885d18e4f6 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:17.317020 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ef276-6f58-490d-b5d9-b8885d18e4f6 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:17.322478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fe5b8-465c-4dc8-b78d-020d5d81f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:17.323353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fe5b8-465c-4dc8-b78d-020d5d81f591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:17.323629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fe5b8-465c-4dc8-b78d-020d5d81f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:17.323930 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fe5b8-465c-4dc8-b78d-020d5d81f591 admin admin] PATH_INFO: `/v3/users/0c56067ca7854eac8caebaf400a8242b` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:17.325151 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fe5b8-465c-4dc8-b78d-020d5d81f591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c56067ca7854eac8caebaf400a8242b)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:17.327144 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fe5b8-465c-4dc8-b78d-020d5d81f591 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:17.560619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-078fe5b8-465c-4dc8-b78d-020d5d81f591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c56067ca7854eac8caebaf400a8242b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:17.561281 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-078fe5b8-465c-4dc8-b78d-020d5d81f591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c56067ca7854eac8caebaf400a8242b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:17.574862 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-078fe5b8-465c-4dc8-b78d-020d5d81f591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c56067ca7854eac8caebaf400a8242b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:17.584088 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-078fe5b8-465c-4dc8-b78d-020d5d81f591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c56067ca7854eac8caebaf400a8242b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:17.692482 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-078fe5b8-465c-4dc8-b78d-020d5d81f591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c56067ca7854eac8caebaf400a8242b'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:17.699408 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1373/2725] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:38:17 2021] DELETE /identity/v3/users/0c56067ca7854eac8caebaf400a8242b => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:38:17.704137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f109c92-52b1-4f05-87e3-64375d03a32a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:17.704688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f109c92-52b1-4f05-87e3-64375d03a32a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:17.704688 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f109c92-52b1-4f05-87e3-64375d03a32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:17.728896 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-4f109c92-52b1-4f05-87e3-64375d03a32a None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:17.730192 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4f109c92-52b1-4f05-87e3-64375d03a32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:17.824529 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1353/2726] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:38:17.833276 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fe5b8-465c-4dc8-b78d-020d5d81f591 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:17.834674 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-078fe5b8-465c-4dc8-b78d-020d5d81f591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:17.909819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fe5b8-465c-4dc8-b78d-020d5d81f591 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:17.914074 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab04248-32db-4848-8c46-c979ebfa608c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:17.914744 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab04248-32db-4848-8c46-c979ebfa608c service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:17.915027 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab04248-32db-4848-8c46-c979ebfa608c service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:17.915301 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab04248-32db-4848-8c46-c979ebfa608c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:17.926507 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab04248-32db-4848-8c46-c979ebfa608c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:17.927983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab04248-32db-4848-8c46-c979ebfa608c service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:17.938492 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1374/2727] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:38:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:38:18.493569 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f109c92-52b1-4f05-87e3-64375d03a32a None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:18.495343 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4f109c92-52b1-4f05-87e3-64375d03a32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:18.514593 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f109c92-52b1-4f05-87e3-64375d03a32a None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:18.522408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:18.523866 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:18.524179 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:18.524662 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] PATH_INFO: `/v3/projects/846e2e7c1f01476c9ac1288c4166f9a3` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:18.526289 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=846e2e7c1f01476c9ac1288c4166f9a3)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:18.528652 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:18.652424 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '846e2e7c1f01476c9ac1288c4166f9a3', 'request_id': 'req-a53f6519-b576-4923-9b1e-49ac96ffbde1'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:18.740779 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '846e2e7c1f01476c9ac1288c4166f9a3', 'request_id': 'req-a53f6519-b576-4923-9b1e-49ac96ffbde1'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:18.748199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '846e2e7c1f01476c9ac1288c4166f9a3', 'request_id': 'req-a53f6519-b576-4923-9b1e-49ac96ffbde1'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:18.760836 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] The token cache is being invalidate because project 846e2e7c1f01476c9ac1288c4166f9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:38:18.761117 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:18.761803 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:18.763448 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1354/2728] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:38:18 2021] DELETE /identity/v3/projects/846e2e7c1f01476c9ac1288c4166f9a3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:18.768467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab04248-32db-4848-8c46-c979ebfa608c service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:18.778635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab04248-32db-4848-8c46-c979ebfa608c service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:18.846536 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dcbf3-4b34-46ee-acbf-f0f92adf5ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:18.848078 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dcbf3-4b34-46ee-acbf-f0f92adf5ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:18.848363 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dcbf3-4b34-46ee-acbf-f0f92adf5ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:18.848664 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dcbf3-4b34-46ee-acbf-f0f92adf5ca0 admin admin] PATH_INFO: `/v3/users/3fb889929cfc4393a42731b23721cfc0` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:18.850034 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dcbf3-4b34-46ee-acbf-f0f92adf5ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb889929cfc4393a42731b23721cfc0)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:18.852067 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dcbf3-4b34-46ee-acbf-f0f92adf5ca0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:19.091931 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1c7dcbf3-4b34-46ee-acbf-f0f92adf5ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb889929cfc4393a42731b23721cfc0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:19.092994 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1c7dcbf3-4b34-46ee-acbf-f0f92adf5ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb889929cfc4393a42731b23721cfc0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:19.115924 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1c7dcbf3-4b34-46ee-acbf-f0f92adf5ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb889929cfc4393a42731b23721cfc0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:19.128007 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1c7dcbf3-4b34-46ee-acbf-f0f92adf5ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb889929cfc4393a42731b23721cfc0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:19.261423 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1c7dcbf3-4b34-46ee-acbf-f0f92adf5ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb889929cfc4393a42731b23721cfc0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:19.273887 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1375/2729] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:38:18 2021] DELETE /identity/v3/users/3fb889929cfc4393a42731b23721cfc0 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:19.432310 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:19.434907 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:19.527278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f6519-b576-4923-9b1e-49ac96ffbde1 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:19.602587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4184f-a0a6-482b-a823-9b821cfaf164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:19.602587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4184f-a0a6-482b-a823-9b821cfaf164 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:19.602587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4184f-a0a6-482b-a823-9b821cfaf164 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:19.603255 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4184f-a0a6-482b-a823-9b821cfaf164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:19.606052 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4ea4184f-a0a6-482b-a823-9b821cfaf164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:19.713255 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4184f-a0a6-482b-a823-9b821cfaf164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:19.715817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4184f-a0a6-482b-a823-9b821cfaf164 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:19.732976 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1355/2730] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:38:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:38:19.956746 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dcbf3-4b34-46ee-acbf-f0f92adf5ca0 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:19.958599 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1c7dcbf3-4b34-46ee-acbf-f0f92adf5ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:19.981327 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dcbf3-4b34-46ee-acbf-f0f92adf5ca0 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:19.989119 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f166a-9722-46a3-87d9-c83ec3204513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:19.990060 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f166a-9722-46a3-87d9-c83ec3204513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:19.990410 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f166a-9722-46a3-87d9-c83ec3204513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:19.990851 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f166a-9722-46a3-87d9-c83ec3204513 admin admin] PATH_INFO: `/v3/projects/158ef0178062498abad86d1e3de93509` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:19.992675 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f166a-9722-46a3-87d9-c83ec3204513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=158ef0178062498abad86d1e3de93509)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:19.994934 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f166a-9722-46a3-87d9-c83ec3204513 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:20.162773 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-703f166a-9722-46a3-87d9-c83ec3204513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '158ef0178062498abad86d1e3de93509', 'request_id': 'req-703f166a-9722-46a3-87d9-c83ec3204513'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:20.289304 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-703f166a-9722-46a3-87d9-c83ec3204513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '158ef0178062498abad86d1e3de93509', 'request_id': 'req-703f166a-9722-46a3-87d9-c83ec3204513'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:20.297580 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-703f166a-9722-46a3-87d9-c83ec3204513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '158ef0178062498abad86d1e3de93509', 'request_id': 'req-703f166a-9722-46a3-87d9-c83ec3204513'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:20.311942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-703f166a-9722-46a3-87d9-c83ec3204513 admin admin] The token cache is being invalidate because project 158ef0178062498abad86d1e3de93509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:38:20.312248 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-703f166a-9722-46a3-87d9-c83ec3204513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:20.312927 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-703f166a-9722-46a3-87d9-c83ec3204513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:20.315743 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1376/2731] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:38:19 2021] DELETE /identity/v3/projects/158ef0178062498abad86d1e3de93509 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:20.321979 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ba65-9207-435e-98e0-0ca6668e60ca None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:20.330062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ba65-9207-435e-98e0-0ca6668e60ca None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:20.330062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ba65-9207-435e-98e0-0ca6668e60ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:20.342374 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-64a5ba65-9207-435e-98e0-0ca6668e60ca None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:20.343632 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-64a5ba65-9207-435e-98e0-0ca6668e60ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:20.433779 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1356/2732] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:38:20.445836 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b8503-78a8-4854-bf82-c229c4e317e6 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:20.446230 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b8503-78a8-4854-bf82-c229c4e317e6 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:20.446619 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b8503-78a8-4854-bf82-c229c4e317e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:20.477401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-b89b8503-78a8-4854-bf82-c229c4e317e6 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:20.478667 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b89b8503-78a8-4854-bf82-c229c4e317e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:20.499205 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1377/2733] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:38:20.503602 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5ba65-9207-435e-98e0-0ca6668e60ca None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:20.523433 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5ba65-9207-435e-98e0-0ca6668e60ca None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:20.531323 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62277c3e-73ae-4e0d-9d8d-472a760ebaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:20.532512 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62277c3e-73ae-4e0d-9d8d-472a760ebaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:20.532994 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62277c3e-73ae-4e0d-9d8d-472a760ebaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:20.533665 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62277c3e-73ae-4e0d-9d8d-472a760ebaf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:20.534699 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62277c3e-73ae-4e0d-9d8d-472a760ebaf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:38:20.535230 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62277c3e-73ae-4e0d-9d8d-472a760ebaf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:20.538184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62277c3e-73ae-4e0d-9d8d-472a760ebaf2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:20.565035 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1357/2734] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:38:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:38:20.568083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b8503-78a8-4854-bf82-c229c4e317e6 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:20.587026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b8503-78a8-4854-bf82-c229c4e317e6 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:20.594052 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c575122-3a2b-4622-94e7-a8701982afe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:20.595190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c575122-3a2b-4622-94e7-a8701982afe2 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:20.595650 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c575122-3a2b-4622-94e7-a8701982afe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:20.596706 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c575122-3a2b-4622-94e7-a8701982afe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:20.597997 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c575122-3a2b-4622-94e7-a8701982afe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:20.601876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c575122-3a2b-4622-94e7-a8701982afe2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:20.722404 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1378/2735] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:38:20 2021] POST /identity/v3/projects => generated 401 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:38:20.726962 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62277c3e-73ae-4e0d-9d8d-472a760ebaf2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:20.743090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62277c3e-73ae-4e0d-9d8d-472a760ebaf2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:20.852010 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddc6ba-f41f-4334-bd9d-a3b45e5cd03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:20.853243 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddc6ba-f41f-4334-bd9d-a3b45e5cd03c admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:20.853753 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddc6ba-f41f-4334-bd9d-a3b45e5cd03c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:20.854273 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddc6ba-f41f-4334-bd9d-a3b45e5cd03c admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:20.855703 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddc6ba-f41f-4334-bd9d-a3b45e5cd03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:20.858417 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddc6ba-f41f-4334-bd9d-a3b45e5cd03c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:20.977740 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1358/2736] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:38:20 2021] POST /identity/v3/users => generated 301 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:38:20.982561 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c575122-3a2b-4622-94e7-a8701982afe2 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:21.003065 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c575122-3a2b-4622-94e7-a8701982afe2 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:21.022494 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263124ba-ea26-4dfd-b731-f2c8ba4ad5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:21.023557 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263124ba-ea26-4dfd-b731-f2c8ba4ad5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:21.024019 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263124ba-ea26-4dfd-b731-f2c8ba4ad5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:21.024728 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263124ba-ea26-4dfd-b731-f2c8ba4ad5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:21.026628 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263124ba-ea26-4dfd-b731-f2c8ba4ad5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:21.029684 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263124ba-ea26-4dfd-b731-f2c8ba4ad5e9 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:21.051322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1379/2737] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:38:20 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:38:21.061167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddc6ba-f41f-4334-bd9d-a3b45e5cd03c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:21.082992 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddc6ba-f41f-4334-bd9d-a3b45e5cd03c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:21.090808 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc04317-1df8-492d-87f8-fbb140c23352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:21.091692 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc04317-1df8-492d-87f8-fbb140c23352 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:21.099680 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc04317-1df8-492d-87f8-fbb140c23352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:21.099680 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc04317-1df8-492d-87f8-fbb140c23352 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:21.099680 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc04317-1df8-492d-87f8-fbb140c23352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:21.099680 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc04317-1df8-492d-87f8-fbb140c23352 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:21.113227 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1359/2738] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:38:21 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:38:21.119926 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263124ba-ea26-4dfd-b731-f2c8ba4ad5e9 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:21.141362 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263124ba-ea26-4dfd-b731-f2c8ba4ad5e9 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:21.159464 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1f78d-c0bc-46cb-9949-ee0d480d2bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:21.161407 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1f78d-c0bc-46cb-9949-ee0d480d2bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:21.161993 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1f78d-c0bc-46cb-9949-ee0d480d2bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:21.162547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1f78d-c0bc-46cb-9949-ee0d480d2bbf admin admin] PATH_INFO: `/v3/projects/335a1e1c40d843cdab03245c5c197fa9/users/dc2b613ea9134d358f7a1f7733a5f350/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:21.204981 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1f78d-c0bc-46cb-9949-ee0d480d2bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=335a1e1c40d843cdab03245c5c197fa9, user_id=dc2b613ea9134d358f7a1f7733a5f350, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:21.211707 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1f78d-c0bc-46cb-9949-ee0d480d2bbf admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:21.416513 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1380/2739] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:38:21 2021] PUT /identity/v3/projects/335a1e1c40d843cdab03245c5c197fa9/users/dc2b613ea9134d358f7a1f7733a5f350/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:38:21.418099 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b40f0b-bdde-4f67-9d5a-cf1c9d775c7d None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:21.418766 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b40f0b-bdde-4f67-9d5a-cf1c9d775c7d None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:21.418998 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b40f0b-bdde-4f67-9d5a-cf1c9d775c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:21.450000 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-07b40f0b-bdde-4f67-9d5a-cf1c9d775c7d None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:21.451692 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-07b40f0b-bdde-4f67-9d5a-cf1c9d775c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:21.596011 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1360/2740] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:38:21.605428 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1f78d-c0bc-46cb-9949-ee0d480d2bbf admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:21.609040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c3a1f78d-c0bc-46cb-9949-ee0d480d2bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:21.720280 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1f78d-c0bc-46cb-9949-ee0d480d2bbf admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:21.730772 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920886a0-1144-493e-bd2b-6366a9f5f356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:21.731897 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920886a0-1144-493e-bd2b-6366a9f5f356 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:21.732377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920886a0-1144-493e-bd2b-6366a9f5f356 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:21.732913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920886a0-1144-493e-bd2b-6366a9f5f356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:21.748715 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920886a0-1144-493e-bd2b-6366a9f5f356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:21.753741 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920886a0-1144-493e-bd2b-6366a9f5f356 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:21.771041 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1381/2741] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:38:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:38:23.371474 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c4462-ebab-41db-9de6-b7ac68e7fbc7 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:23.373173 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c4462-ebab-41db-9de6-b7ac68e7fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:23.375245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c4462-ebab-41db-9de6-b7ac68e7fbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:23.431150 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d12c4462-ebab-41db-9de6-b7ac68e7fbc7 None None] MFA Rules not processed for user `dc2b613ea9134d358f7a1f7733a5f350`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:23.433808 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d12c4462-ebab-41db-9de6-b7ac68e7fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:23.571903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1361/2742] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:23 2021] POST /identity/v3/auth/tokens => generated 3421 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:38:23.578802 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920886a0-1144-493e-bd2b-6366a9f5f356 service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:23.599204 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920886a0-1144-493e-bd2b-6366a9f5f356 service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:23.608007 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4955ae-6252-46f5-9ea2-212d1361227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:23.610837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4955ae-6252-46f5-9ea2-212d1361227c admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:23.610837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4955ae-6252-46f5-9ea2-212d1361227c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:23.610837 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4955ae-6252-46f5-9ea2-212d1361227c admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:23.612336 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4955ae-6252-46f5-9ea2-212d1361227c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:23.616253 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4955ae-6252-46f5-9ea2-212d1361227c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:23.751604 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1382/2743] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:38:23 2021] POST /identity/v3/projects => generated 405 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:38:23.758777 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c4462-ebab-41db-9de6-b7ac68e7fbc7 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:23.785587 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c4462-ebab-41db-9de6-b7ac68e7fbc7 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:23.885921 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b13b8-fc41-4f3b-848c-9442da744291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:23.887017 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b13b8-fc41-4f3b-848c-9442da744291 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:23.887511 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b13b8-fc41-4f3b-848c-9442da744291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:23.888071 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b13b8-fc41-4f3b-848c-9442da744291 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:23.889368 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b13b8-fc41-4f3b-848c-9442da744291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:23.892909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b13b8-fc41-4f3b-848c-9442da744291 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:24.002041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1362/2744] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:38:23 2021] POST /identity/v3/users => generated 309 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:38:24.007965 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4955ae-6252-46f5-9ea2-212d1361227c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:24.021105 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4955ae-6252-46f5-9ea2-212d1361227c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:24.029309 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779a765-5de6-44be-a569-80e1b1f13dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:24.030472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779a765-5de6-44be-a569-80e1b1f13dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:24.030860 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779a765-5de6-44be-a569-80e1b1f13dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:24.031868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779a765-5de6-44be-a569-80e1b1f13dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:24.036638 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779a765-5de6-44be-a569-80e1b1f13dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:24.040040 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779a765-5de6-44be-a569-80e1b1f13dc5 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:24.061886 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1383/2745] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:38:24 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:38:24.068617 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b13b8-fc41-4f3b-848c-9442da744291 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:24.089954 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b13b8-fc41-4f3b-848c-9442da744291 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:24.098974 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d287e-23cb-4872-8f25-f632eb6f0d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:24.100709 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d287e-23cb-4872-8f25-f632eb6f0d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:24.101205 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d287e-23cb-4872-8f25-f632eb6f0d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:24.101696 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d287e-23cb-4872-8f25-f632eb6f0d9d admin admin] PATH_INFO: `/v3/projects/719beb3d32574c10970702592c7dcd8a/users/ec191ae0ef864e62bd2cf825a8de7b35/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:24.129925 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d287e-23cb-4872-8f25-f632eb6f0d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=719beb3d32574c10970702592c7dcd8a, user_id=ec191ae0ef864e62bd2cf825a8de7b35, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:24.135531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d287e-23cb-4872-8f25-f632eb6f0d9d admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:24.234576 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1363/2746] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:38:24 2021] PUT /identity/v3/projects/719beb3d32574c10970702592c7dcd8a/users/ec191ae0ef864e62bd2cf825a8de7b35/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:38:24.241659 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779a765-5de6-44be-a569-80e1b1f13dc5 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:24.262677 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779a765-5de6-44be-a569-80e1b1f13dc5 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:24.370421 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0c861-be9f-4450-bfb9-fd21cd05ef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:24.371467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0c861-be9f-4450-bfb9-fd21cd05ef99 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:24.372014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0c861-be9f-4450-bfb9-fd21cd05ef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:24.372516 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0c861-be9f-4450-bfb9-fd21cd05ef99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:24.374165 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0c861-be9f-4450-bfb9-fd21cd05ef99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:24.377192 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0c861-be9f-4450-bfb9-fd21cd05ef99 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:24.395901 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1384/2747] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:38:24 2021] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:38:24.401786 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d287e-23cb-4872-8f25-f632eb6f0d9d admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:24.423022 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d287e-23cb-4872-8f25-f632eb6f0d9d admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:24.431671 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd1ec7-a41b-4526-bcf8-a8d52bdee67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:24.433310 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd1ec7-a41b-4526-bcf8-a8d52bdee67e admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:24.433788 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd1ec7-a41b-4526-bcf8-a8d52bdee67e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:24.434325 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd1ec7-a41b-4526-bcf8-a8d52bdee67e admin admin] PATH_INFO: `/v3/projects/719beb3d32574c10970702592c7dcd8a/users/ec191ae0ef864e62bd2cf825a8de7b35/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:24.436742 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd1ec7-a41b-4526-bcf8-a8d52bdee67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=719beb3d32574c10970702592c7dcd8a, user_id=ec191ae0ef864e62bd2cf825a8de7b35, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:24.440707 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd1ec7-a41b-4526-bcf8-a8d52bdee67e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:24.453183 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1364/2748] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:38:24 2021] PUT /identity/v3/projects/719beb3d32574c10970702592c7dcd8a/users/ec191ae0ef864e62bd2cf825a8de7b35/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:26.298090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1f9f-2e37-4130-a168-90d158b5eb9f None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:26.299467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1f9f-2e37-4130-a168-90d158b5eb9f None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:26.299960 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1f9f-2e37-4130-a168-90d158b5eb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:26.335486 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-762f1f9f-2e37-4130-a168-90d158b5eb9f None None] MFA Rules not processed for user `ec191ae0ef864e62bd2cf825a8de7b35`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:26.337251 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-762f1f9f-2e37-4130-a168-90d158b5eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:26.486799 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1385/2749] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:26 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:38:28.595408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd1ec7-a41b-4526-bcf8-a8d52bdee67e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:28.657698 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd1ec7-a41b-4526-bcf8-a8d52bdee67e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:28.663312 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d211d-afc4-4673-8f67-c6c6024fcdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:28.664202 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d211d-afc4-4673-8f67-c6c6024fcdfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:28.664481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d211d-afc4-4673-8f67-c6c6024fcdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:28.664751 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d211d-afc4-4673-8f67-c6c6024fcdfe admin admin] PATH_INFO: `/v3/users/dc2b613ea9134d358f7a1f7733a5f350` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:28.665947 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d211d-afc4-4673-8f67-c6c6024fcdfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2b613ea9134d358f7a1f7733a5f350)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:28.667915 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d211d-afc4-4673-8f67-c6c6024fcdfe admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:28.907312 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1d9d211d-afc4-4673-8f67-c6c6024fcdfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2b613ea9134d358f7a1f7733a5f350'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:28.916320 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1d9d211d-afc4-4673-8f67-c6c6024fcdfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2b613ea9134d358f7a1f7733a5f350'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:28.917487 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1d9d211d-afc4-4673-8f67-c6c6024fcdfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2b613ea9134d358f7a1f7733a5f350'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:28.941740 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1d9d211d-afc4-4673-8f67-c6c6024fcdfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2b613ea9134d358f7a1f7733a5f350'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:29.060779 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-1d9d211d-afc4-4673-8f67-c6c6024fcdfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2b613ea9134d358f7a1f7733a5f350'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:29.068535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1365/2750] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:38:28 2021] DELETE /identity/v3/users/dc2b613ea9134d358f7a1f7733a5f350 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:29.540127 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f1f9f-2e37-4130-a168-90d158b5eb9f None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:29.552057 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f1f9f-2e37-4130-a168-90d158b5eb9f None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:29.623097 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:29.623991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:29.624270 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:29.624545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] PATH_INFO: `/v3/projects/335a1e1c40d843cdab03245c5c197fa9` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:29.625767 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=335a1e1c40d843cdab03245c5c197fa9)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:29.627704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:29.776469 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335a1e1c40d843cdab03245c5c197fa9', 'request_id': 'req-19573512-88d4-4eb1-be38-d5a78f368a2f'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:29.886635 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335a1e1c40d843cdab03245c5c197fa9', 'request_id': 'req-19573512-88d4-4eb1-be38-d5a78f368a2f'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:29.894694 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335a1e1c40d843cdab03245c5c197fa9', 'request_id': 'req-19573512-88d4-4eb1-be38-d5a78f368a2f'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:29.908775 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] The token cache is being invalidate because project 335a1e1c40d843cdab03245c5c197fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:38:29.915265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:29.915265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:29.915265 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1386/2751] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:38:29 2021] DELETE /identity/v3/projects/335a1e1c40d843cdab03245c5c197fa9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:29.916831 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d211d-afc4-4673-8f67-c6c6024fcdfe admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:29.918378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-1d9d211d-afc4-4673-8f67-c6c6024fcdfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:29.933177 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d211d-afc4-4673-8f67-c6c6024fcdfe admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:29.989510 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7551f-ce2d-4787-838b-b82eeae2d184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:29.990383 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7551f-ce2d-4787-838b-b82eeae2d184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:29.990693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7551f-ce2d-4787-838b-b82eeae2d184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:29.990918 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7551f-ce2d-4787-838b-b82eeae2d184 admin admin] PATH_INFO: `/v3/users/ec191ae0ef864e62bd2cf825a8de7b35` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:29.992160 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7551f-ce2d-4787-838b-b82eeae2d184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec191ae0ef864e62bd2cf825a8de7b35)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:29.994055 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7551f-ce2d-4787-838b-b82eeae2d184 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:30.299352 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-34a7551f-ce2d-4787-838b-b82eeae2d184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec191ae0ef864e62bd2cf825a8de7b35'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:30.304343 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-34a7551f-ce2d-4787-838b-b82eeae2d184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec191ae0ef864e62bd2cf825a8de7b35'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:30.305071 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-34a7551f-ce2d-4787-838b-b82eeae2d184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec191ae0ef864e62bd2cf825a8de7b35'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:30.316852 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-34a7551f-ce2d-4787-838b-b82eeae2d184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec191ae0ef864e62bd2cf825a8de7b35'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:30.402571 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:30.404080 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:30.415001 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-34a7551f-ce2d-4787-838b-b82eeae2d184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec191ae0ef864e62bd2cf825a8de7b35'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:30.420841 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19573512-88d4-4eb1-be38-d5a78f368a2f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:30.423090 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1366/2752] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:38:29 2021] DELETE /identity/v3/users/ec191ae0ef864e62bd2cf825a8de7b35 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:38:30.427673 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1f9aa-fd5f-4845-bf58-18ffc54caa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:30.428278 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1f9aa-fd5f-4845-bf58-18ffc54caa17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:30.428556 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1f9aa-fd5f-4845-bf58-18ffc54caa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:30.428829 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1f9aa-fd5f-4845-bf58-18ffc54caa17 admin admin] PATH_INFO: `/v3/users/7c50a525003e427ba5ff9dea8f4ed47e` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:30.430164 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1f9aa-fd5f-4845-bf58-18ffc54caa17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c50a525003e427ba5ff9dea8f4ed47e)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:30.432131 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1f9aa-fd5f-4845-bf58-18ffc54caa17 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:30.662681 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1ed1f9aa-fd5f-4845-bf58-18ffc54caa17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c50a525003e427ba5ff9dea8f4ed47e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:30.663338 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1ed1f9aa-fd5f-4845-bf58-18ffc54caa17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c50a525003e427ba5ff9dea8f4ed47e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:30.675377 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1ed1f9aa-fd5f-4845-bf58-18ffc54caa17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c50a525003e427ba5ff9dea8f4ed47e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:30.682641 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1ed1f9aa-fd5f-4845-bf58-18ffc54caa17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c50a525003e427ba5ff9dea8f4ed47e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:30.723671 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7551f-ce2d-4787-838b-b82eeae2d184 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:30.725108 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-34a7551f-ce2d-4787-838b-b82eeae2d184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:30.766391 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1ed1f9aa-fd5f-4845-bf58-18ffc54caa17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c50a525003e427ba5ff9dea8f4ed47e'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:30.774679 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1387/2753] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:38:30 2021] DELETE /identity/v3/users/7c50a525003e427ba5ff9dea8f4ed47e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:38:30.813164 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7551f-ce2d-4787-838b-b82eeae2d184 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:30.916109 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fa74f-9ec0-4938-b3ea-ada630d24544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:30.917190 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa74f-9ec0-4938-b3ea-ada630d24544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:30.917755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa74f-9ec0-4938-b3ea-ada630d24544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:30.917858 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa74f-9ec0-4938-b3ea-ada630d24544 admin admin] PATH_INFO: `/v3/projects/719beb3d32574c10970702592c7dcd8a` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:30.919142 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fa74f-9ec0-4938-b3ea-ada630d24544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=719beb3d32574c10970702592c7dcd8a)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:30.921251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fa74f-9ec0-4938-b3ea-ada630d24544 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:31.040921 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-cf3fa74f-9ec0-4938-b3ea-ada630d24544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719beb3d32574c10970702592c7dcd8a', 'request_id': 'req-cf3fa74f-9ec0-4938-b3ea-ada630d24544'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.066355 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1f9aa-fd5f-4845-bf58-18ffc54caa17 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:31.067272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1ed1f9aa-fd5f-4845-bf58-18ffc54caa17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:31.088024 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1f9aa-fd5f-4845-bf58-18ffc54caa17 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:31.121692 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-cf3fa74f-9ec0-4938-b3ea-ada630d24544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719beb3d32574c10970702592c7dcd8a', 'request_id': 'req-cf3fa74f-9ec0-4938-b3ea-ada630d24544'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.135161 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-cf3fa74f-9ec0-4938-b3ea-ada630d24544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719beb3d32574c10970702592c7dcd8a', 'request_id': 'req-cf3fa74f-9ec0-4938-b3ea-ada630d24544'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.146772 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-cf3fa74f-9ec0-4938-b3ea-ada630d24544 admin admin] The token cache is being invalidate because project 719beb3d32574c10970702592c7dcd8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:38:31.147068 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-cf3fa74f-9ec0-4938-b3ea-ada630d24544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.147835 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-cf3fa74f-9ec0-4938-b3ea-ada630d24544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.149462 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1367/2754] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:38:30 2021] DELETE /identity/v3/projects/719beb3d32574c10970702592c7dcd8a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:38:31.160481 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:31.161379 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:31.161819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:31.162068 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] PATH_INFO: `/v3/projects/fea0db42704249b29fba70abbda7991c` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:31.163110 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fb734-b99e-4d3f-8db2-b30af4684704 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:31.163303 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea0db42704249b29fba70abbda7991c)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:31.163408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fb734-b99e-4d3f-8db2-b30af4684704 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:31.163675 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fb734-b99e-4d3f-8db2-b30af4684704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:31.165431 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:31.185049 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-124fb734-b99e-4d3f-8db2-b30af4684704 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:31.186729 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-124fb734-b99e-4d3f-8db2-b30af4684704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:31.196342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1368/2755] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:38:31.205991 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782fb77-d843-4304-8a29-62cc633d494e None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:31.206269 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782fb77-d843-4304-8a29-62cc633d494e None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:31.206585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782fb77-d843-4304-8a29-62cc633d494e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:31.227687 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d782fb77-d843-4304-8a29-62cc633d494e None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:31.227892 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d782fb77-d843-4304-8a29-62cc633d494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:31.236151 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1369/2756] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:38:31.240981 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782fb77-d843-4304-8a29-62cc633d494e None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:31.250122 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782fb77-d843-4304-8a29-62cc633d494e None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:31.255393 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950aebe-ec61-4e9e-abdf-4e73e58daeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:31.256088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950aebe-ec61-4e9e-abdf-4e73e58daeae admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:31.256377 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950aebe-ec61-4e9e-abdf-4e73e58daeae admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:31.256623 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950aebe-ec61-4e9e-abdf-4e73e58daeae admin admin] PATH_INFO: `/v3/domains` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:31.257380 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950aebe-ec61-4e9e-abdf-4e73e58daeae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:38:31.257677 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950aebe-ec61-4e9e-abdf-4e73e58daeae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:31.259240 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950aebe-ec61-4e9e-abdf-4e73e58daeae admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:31.273819 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1370/2757] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:38:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:38:31.278097 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950aebe-ec61-4e9e-abdf-4e73e58daeae admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:31.288447 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950aebe-ec61-4e9e-abdf-4e73e58daeae admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:31.293308 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73b1c9-54f5-4b34-b8d6-3e7695dd990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:31.293895 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73b1c9-54f5-4b34-b8d6-3e7695dd990c admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:31.294210 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73b1c9-54f5-4b34-b8d6-3e7695dd990c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:31.294481 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73b1c9-54f5-4b34-b8d6-3e7695dd990c admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:31.295183 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73b1c9-54f5-4b34-b8d6-3e7695dd990c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:31.297169 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73b1c9-54f5-4b34-b8d6-3e7695dd990c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:31.345383 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea0db42704249b29fba70abbda7991c', 'request_id': 'req-929dd3cd-9263-400c-a029-06c63c0e615f'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.425702 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1371/2758] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:38:31 2021] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:38:31.432867 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73b1c9-54f5-4b34-b8d6-3e7695dd990c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:31.449044 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea0db42704249b29fba70abbda7991c', 'request_id': 'req-929dd3cd-9263-400c-a029-06c63c0e615f'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.456470 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea0db42704249b29fba70abbda7991c', 'request_id': 'req-929dd3cd-9263-400c-a029-06c63c0e615f'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.468968 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] The token cache is being invalidate because project fea0db42704249b29fba70abbda7991c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:38:31.469356 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.470083 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.471811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1388/2759] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:38:31 2021] DELETE /identity/v3/projects/fea0db42704249b29fba70abbda7991c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:38:31.475808 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:31.477331 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:31.502740 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73b1c9-54f5-4b34-b8d6-3e7695dd990c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:31.507821 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2f0dd-96c6-4e5e-b2d9-9b46ed5d20bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:31.508530 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2f0dd-96c6-4e5e-b2d9-9b46ed5d20bb admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:31.508832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2f0dd-96c6-4e5e-b2d9-9b46ed5d20bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:31.509109 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2f0dd-96c6-4e5e-b2d9-9b46ed5d20bb admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:31.509812 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2f0dd-96c6-4e5e-b2d9-9b46ed5d20bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:31.511927 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2f0dd-96c6-4e5e-b2d9-9b46ed5d20bb admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:31.543526 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dd3cd-9263-400c-a029-06c63c0e615f admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:31.548243 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b5180-2574-4df7-8af4-ed8b55f0cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:31.549731 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b5180-2574-4df7-8af4-ed8b55f0cd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:31.549880 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b5180-2574-4df7-8af4-ed8b55f0cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:31.550137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b5180-2574-4df7-8af4-ed8b55f0cd17 admin admin] PATH_INFO: `/v3/users/749bd1b682d74b54b4ee07615feb56bc` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:31.551345 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b5180-2574-4df7-8af4-ed8b55f0cd17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=749bd1b682d74b54b4ee07615feb56bc)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:31.553294 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b5180-2574-4df7-8af4-ed8b55f0cd17 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:31.615949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1372/2760] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:38:31 2021] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:38:31.620215 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2f0dd-96c6-4e5e-b2d9-9b46ed5d20bb admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:31.622089 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-0be2f0dd-96c6-4e5e-b2d9-9b46ed5d20bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:31.640151 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2f0dd-96c6-4e5e-b2d9-9b46ed5d20bb admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:31.645592 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8226cf4-7f9d-453c-9458-290633935afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:31.646283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8226cf4-7f9d-453c-9458-290633935afc admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:31.646677 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8226cf4-7f9d-453c-9458-290633935afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:31.646890 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8226cf4-7f9d-453c-9458-290633935afc admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:31.647634 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8226cf4-7f9d-453c-9458-290633935afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:31.649278 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8226cf4-7f9d-453c-9458-290633935afc admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:31.660541 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1373/2761] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:38:31 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:38:31.664243 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8226cf4-7f9d-453c-9458-290633935afc admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:31.676187 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8226cf4-7f9d-453c-9458-290633935afc admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:31.682414 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5634ebf-1019-48ed-8a6b-4c062797eb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:31.682414 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5634ebf-1019-48ed-8a6b-4c062797eb0c admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:31.682414 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5634ebf-1019-48ed-8a6b-4c062797eb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:31.682414 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5634ebf-1019-48ed-8a6b-4c062797eb0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:31.682894 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5634ebf-1019-48ed-8a6b-4c062797eb0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:31.684434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5634ebf-1019-48ed-8a6b-4c062797eb0c admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:31.694600 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1374/2762] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:38:31 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 01:38:31.698676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5634ebf-1019-48ed-8a6b-4c062797eb0c admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:31.709083 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5634ebf-1019-48ed-8a6b-4c062797eb0c admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:31.713827 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a58fb-9da2-48ef-9734-c09e8347a474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:31.716949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a58fb-9da2-48ef-9734-c09e8347a474 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:31.716949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a58fb-9da2-48ef-9734-c09e8347a474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:31.716949 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a58fb-9da2-48ef-9734-c09e8347a474 admin admin] PATH_INFO: `/v3/projects/2d7869c3e9964b61bd14fefec63d325e/users/1264212bb591425795d4d617c279e145/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:31.731191 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a58fb-9da2-48ef-9734-c09e8347a474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7869c3e9964b61bd14fefec63d325e, user_id=1264212bb591425795d4d617c279e145, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:31.733853 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a58fb-9da2-48ef-9734-c09e8347a474 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:31.753748 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-bd5b5180-2574-4df7-8af4-ed8b55f0cd17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749bd1b682d74b54b4ee07615feb56bc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.754755 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-bd5b5180-2574-4df7-8af4-ed8b55f0cd17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749bd1b682d74b54b4ee07615feb56bc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.767055 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-bd5b5180-2574-4df7-8af4-ed8b55f0cd17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749bd1b682d74b54b4ee07615feb56bc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.774268 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-bd5b5180-2574-4df7-8af4-ed8b55f0cd17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749bd1b682d74b54b4ee07615feb56bc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.858254 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1375/2763] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:38:31 2021] PUT /identity/v3/projects/2d7869c3e9964b61bd14fefec63d325e/users/1264212bb591425795d4d617c279e145/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:38:31.869718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e730fb-64b9-452a-ac79-f6a15d4e821a None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:31.870007 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e730fb-64b9-452a-ac79-f6a15d4e821a None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:31.870283 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e730fb-64b9-452a-ac79-f6a15d4e821a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:31.896445 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-d1e730fb-64b9-452a-ac79-f6a15d4e821a None None] MFA Rules not processed for user `1264212bb591425795d4d617c279e145`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:31.897655 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-d1e730fb-64b9-452a-ac79-f6a15d4e821a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:31.928749 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-bd5b5180-2574-4df7-8af4-ed8b55f0cd17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749bd1b682d74b54b4ee07615feb56bc'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:31.935322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1389/2764] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:38:31 2021] DELETE /identity/v3/users/749bd1b682d74b54b4ee07615feb56bc => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:31.964358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1376/2765] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:31 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:38:31.968983 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b5180-2574-4df7-8af4-ed8b55f0cd17 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:31.972037 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-bd5b5180-2574-4df7-8af4-ed8b55f0cd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:32.043861 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b5180-2574-4df7-8af4-ed8b55f0cd17 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:32.049606 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbf3d8-93e9-44fc-8ac7-9440436d1b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:32.050280 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbf3d8-93e9-44fc-8ac7-9440436d1b29 admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:32.050600 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbf3d8-93e9-44fc-8ac7-9440436d1b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:32.050811 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbf3d8-93e9-44fc-8ac7-9440436d1b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:32.051535 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbf3d8-93e9-44fc-8ac7-9440436d1b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:32.053534 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbf3d8-93e9-44fc-8ac7-9440436d1b29 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:32.165399 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1390/2766] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:38:31 2021] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 01:38:32.168946 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e730fb-64b9-452a-ac79-f6a15d4e821a None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:32.237656 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e730fb-64b9-452a-ac79-f6a15d4e821a None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:32.247885 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbf3d8-93e9-44fc-8ac7-9440436d1b29 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:32.249741 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-7bbbf3d8-93e9-44fc-8ac7-9440436d1b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:32.309492 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc900a30-71be-4dad-aa9d-386c07aa6da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:32.310167 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc900a30-71be-4dad-aa9d-386c07aa6da5 admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:32.310443 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc900a30-71be-4dad-aa9d-386c07aa6da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:32.310717 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc900a30-71be-4dad-aa9d-386c07aa6da5 admin admin] PATH_INFO: `/v3/users` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:32.311425 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc900a30-71be-4dad-aa9d-386c07aa6da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:32.313627 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc900a30-71be-4dad-aa9d-386c07aa6da5 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:32.330991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbf3d8-93e9-44fc-8ac7-9440436d1b29 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:32.336198 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbfac5-5077-4c2f-88cc-381d904efff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:32.337218 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbfac5-5077-4c2f-88cc-381d904efff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:32.339008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbfac5-5077-4c2f-88cc-381d904efff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:32.339008 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbfac5-5077-4c2f-88cc-381d904efff2 admin admin] PATH_INFO: `/v3/users/4af6614f9877488dbf4bf15dfd184e2d` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:32.342298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbfac5-5077-4c2f-88cc-381d904efff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af6614f9877488dbf4bf15dfd184e2d)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:32.342298 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbfac5-5077-4c2f-88cc-381d904efff2 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:32.415574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1377/2767] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:38:32 2021] POST /identity/v3/users => generated 295 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:38:32.415574 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc900a30-71be-4dad-aa9d-386c07aa6da5 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:32.415966 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-bc900a30-71be-4dad-aa9d-386c07aa6da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:32.428594 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc900a30-71be-4dad-aa9d-386c07aa6da5 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:32.433234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:32.434094 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:32.434379 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:32.434655 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] PATH_INFO: `/v3/projects/0ded337b79e04e829dd47a204b4012d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:32.435918 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ded337b79e04e829dd47a204b4012d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:32.442234 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:32.583282 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ded337b79e04e829dd47a204b4012d2', 'request_id': 'req-b94fa942-0cab-47fe-a743-491594a009f6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:32.583529 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eadbfac5-5077-4c2f-88cc-381d904efff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af6614f9877488dbf4bf15dfd184e2d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:32.584237 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eadbfac5-5077-4c2f-88cc-381d904efff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af6614f9877488dbf4bf15dfd184e2d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:32.596177 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eadbfac5-5077-4c2f-88cc-381d904efff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af6614f9877488dbf4bf15dfd184e2d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:32.603238 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eadbfac5-5077-4c2f-88cc-381d904efff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af6614f9877488dbf4bf15dfd184e2d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:32.654809 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ded337b79e04e829dd47a204b4012d2', 'request_id': 'req-b94fa942-0cab-47fe-a743-491594a009f6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:32.661350 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ded337b79e04e829dd47a204b4012d2', 'request_id': 'req-b94fa942-0cab-47fe-a743-491594a009f6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:32.672869 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] The token cache is being invalidate because project 0ded337b79e04e829dd47a204b4012d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:38:32.673081 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:32.673877 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:32.675408 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1378/2768] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:38:32 2021] DELETE /identity/v3/projects/0ded337b79e04e829dd47a204b4012d2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:32.676339 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:32.677626 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:32.728753 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-eadbfac5-5077-4c2f-88cc-381d904efff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af6614f9877488dbf4bf15dfd184e2d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:32.740683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1391/2769] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:38:32 2021] DELETE /identity/v3/users/4af6614f9877488dbf4bf15dfd184e2d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:38:32.742520 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49df67-8339-4e67-925c-e55756349d81 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:32.742810 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49df67-8339-4e67-925c-e55756349d81 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:32.743090 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49df67-8339-4e67-925c-e55756349d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:32.756774 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fa942-0cab-47fe-a743-491594a009f6 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:32.763991 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-1b49df67-8339-4e67-925c-e55756349d81 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:32.765270 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1b49df67-8339-4e67-925c-e55756349d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:32.821948 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685fcb-155d-4561-bc8e-8d00af46fab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:32.822792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685fcb-155d-4561-bc8e-8d00af46fab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:32.823076 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685fcb-155d-4561-bc8e-8d00af46fab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:32.823347 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685fcb-155d-4561-bc8e-8d00af46fab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:32.824142 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c685fcb-155d-4561-bc8e-8d00af46fab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:32.825923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c685fcb-155d-4561-bc8e-8d00af46fab2 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:32.833572 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1392/2770] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:38:32.846187 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1379/2771] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:38:32 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:38:32.846508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49df67-8339-4e67-925c-e55756349d81 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:32.846508 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1b49df67-8339-4e67-925c-e55756349d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:32.848671 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685fcb-155d-4561-bc8e-8d00af46fab2 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:32.859104 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685fcb-155d-4561-bc8e-8d00af46fab2 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:32.864721 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a114d-2992-4fad-9fb5-3d583165d0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:32.869909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a114d-2992-4fad-9fb5-3d583165d0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:32.869909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a114d-2992-4fad-9fb5-3d583165d0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:32.869909 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a114d-2992-4fad-9fb5-3d583165d0b4 admin admin] PATH_INFO: `/v3/projects/4ba695d17f55458ba109ee82e87d3c89/users/8f755392fccc43d29badfdfd28be5e8d/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:32.884376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a114d-2992-4fad-9fb5-3d583165d0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba695d17f55458ba109ee82e87d3c89, user_id=8f755392fccc43d29badfdfd28be5e8d, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:32.887093 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a114d-2992-4fad-9fb5-3d583165d0b4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:32.916786 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49df67-8339-4e67-925c-e55756349d81 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:32.920473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce961d-d4e1-4f67-845c-1ae7fe0aebc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:32.921130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce961d-d4e1-4f67-845c-1ae7fe0aebc7 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:32.921424 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce961d-d4e1-4f67-845c-1ae7fe0aebc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:32.921683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce961d-d4e1-4f67-845c-1ae7fe0aebc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:32.931370 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce961d-d4e1-4f67-845c-1ae7fe0aebc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:32.932904 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce961d-d4e1-4f67-845c-1ae7fe0aebc7 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:32.943056 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1393/2772] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:38:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:38:32.969934 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1380/2773] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:38:32 2021] PUT /identity/v3/projects/4ba695d17f55458ba109ee82e87d3c89/users/8f755392fccc43d29badfdfd28be5e8d/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:32.975359 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce961d-d4e1-4f67-845c-1ae7fe0aebc7 service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:32.984999 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce961d-d4e1-4f67-845c-1ae7fe0aebc7 service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:33.046400 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997c374-bf20-440d-9683-04ab2574e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:33.048478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997c374-bf20-440d-9683-04ab2574e950 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:33.048478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997c374-bf20-440d-9683-04ab2574e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:33.048478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997c374-bf20-440d-9683-04ab2574e950 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:33.048478 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997c374-bf20-440d-9683-04ab2574e950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:33.050027 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997c374-bf20-440d-9683-04ab2574e950 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:33.060473 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1394/2774] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:38:32 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:38:33.065851 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a114d-2992-4fad-9fb5-3d583165d0b4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:33.076607 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a114d-2992-4fad-9fb5-3d583165d0b4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:33.082782 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c898311-3474-420b-8fe8-cc9df990c928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:33.083689 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c898311-3474-420b-8fe8-cc9df990c928 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:33.084004 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c898311-3474-420b-8fe8-cc9df990c928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:33.084296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c898311-3474-420b-8fe8-cc9df990c928 admin admin] PATH_INFO: `/v3/projects/4ba695d17f55458ba109ee82e87d3c89/users/8f755392fccc43d29badfdfd28be5e8d/roles/73614ed1e8e44534990dc6c04e8f9137` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:33.086318 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c898311-3474-420b-8fe8-cc9df990c928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba695d17f55458ba109ee82e87d3c89, user_id=8f755392fccc43d29badfdfd28be5e8d, role_id=73614ed1e8e44534990dc6c04e8f9137)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:33.089046 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c898311-3474-420b-8fe8-cc9df990c928 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:33.101042 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1381/2775] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:38:33 2021] PUT /identity/v3/projects/4ba695d17f55458ba109ee82e87d3c89/users/8f755392fccc43d29badfdfd28be5e8d/roles/73614ed1e8e44534990dc6c04e8f9137 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:33.111642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6651b8-e982-44b6-8b89-a79c79f86713 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:33.111987 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6651b8-e982-44b6-8b89-a79c79f86713 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:33.112130 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6651b8-e982-44b6-8b89-a79c79f86713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:33.139246 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-6a6651b8-e982-44b6-8b89-a79c79f86713 None None] MFA Rules not processed for user `8f755392fccc43d29badfdfd28be5e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:38:33.140515 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6a6651b8-e982-44b6-8b89-a79c79f86713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:33.213979 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1395/2776] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:38:33 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:38:33.224392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c898311-3474-420b-8fe8-cc9df990c928 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:33.226184 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-7c898311-3474-420b-8fe8-cc9df990c928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:33.286724 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c898311-3474-420b-8fe8-cc9df990c928 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:33.292102 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010091b5-3e3c-4137-abc5-4d071a803fea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:33.292745 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010091b5-3e3c-4137-abc5-4d071a803fea service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:33.293034 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010091b5-3e3c-4137-abc5-4d071a803fea service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:33.293310 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010091b5-3e3c-4137-abc5-4d071a803fea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:33.295171 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-010091b5-3e3c-4137-abc5-4d071a803fea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:33.356219 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010091b5-3e3c-4137-abc5-4d071a803fea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:33.357792 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010091b5-3e3c-4137-abc5-4d071a803fea service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:33.367531 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1382/2777] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:38:33 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:38:33.405471 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6651b8-e982-44b6-8b89-a79c79f86713 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:33.407646 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-6a6651b8-e982-44b6-8b89-a79c79f86713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:33.493628 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6651b8-e982-44b6-8b89-a79c79f86713 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:33.498434 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:33.499427 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:33.499563 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:33.500161 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] PATH_INFO: `/v3/projects/b90d3e2ff25d4e278bae635d92501821` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:33.501401 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b90d3e2ff25d4e278bae635d92501821)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:33.504183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:33.637704 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b90d3e2ff25d4e278bae635d92501821', 'request_id': 'req-e9838c29-31e0-415c-bb40-4cf814f16150'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:33.752846 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b90d3e2ff25d4e278bae635d92501821', 'request_id': 'req-e9838c29-31e0-415c-bb40-4cf814f16150'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:33.759021 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b90d3e2ff25d4e278bae635d92501821', 'request_id': 'req-e9838c29-31e0-415c-bb40-4cf814f16150'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:33.770108 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] The token cache is being invalidate because project b90d3e2ff25d4e278bae635d92501821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:38:33.770720 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:33.771079 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:38:33.772696 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1396/2778] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:38:33 2021] DELETE /identity/v3/projects/b90d3e2ff25d4e278bae635d92501821 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:38:39.815062 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010091b5-3e3c-4137-abc5-4d071a803fea service cinder] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:39.816453 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-010091b5-3e3c-4137-abc5-4d071a803fea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:39.827271 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010091b5-3e3c-4137-abc5-4d071a803fea service cinder] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:39.875538 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f7cdd-6d70-474b-a834-2f766136764a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:39.876215 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f7cdd-6d70-474b-a834-2f766136764a service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:39.876518 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f7cdd-6d70-474b-a834-2f766136764a service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:39.876963 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f7cdd-6d70-474b-a834-2f766136764a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:39.879028 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-5f3f7cdd-6d70-474b-a834-2f766136764a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:39.941564 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f7cdd-6d70-474b-a834-2f766136764a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:39.942973 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f7cdd-6d70-474b-a834-2f766136764a service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:39.952804 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1383/2779] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:38:39 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:38:49.959701 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:38:49.961259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:49.974335 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9838c29-31e0-415c-bb40-4cf814f16150 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:38:49.978818 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272a008-71f9-4884-a9c0-6b537ac86d27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:38:49.979696 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a008-71f9-4884-a9c0-6b537ac86d27 service cinder] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:38:49.979908 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a008-71f9-4884-a9c0-6b537ac86d27 service cinder] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:38:49.980187 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a008-71f9-4884-a9c0-6b537ac86d27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:38:49.982293 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b272a008-71f9-4884-a9c0-6b537ac86d27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:38:50.048667 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272a008-71f9-4884-a9c0-6b537ac86d27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:38:50.050137 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272a008-71f9-4884-a9c0-6b537ac86d27 service cinder] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:38:50.060455 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1397/2780] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:38:49 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:39:01.813910 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af740ec1-3708-47f2-bbc7-d3cd17553e43 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:01.814625 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af740ec1-3708-47f2-bbc7-d3cd17553e43 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:01.814625 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af740ec1-3708-47f2-bbc7-d3cd17553e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:01.833311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-af740ec1-3708-47f2-bbc7-d3cd17553e43 None None] MFA Rules not processed for user `bef8571ef39b4efe8f510a28052e2b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:39:01.835235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-af740ec1-3708-47f2-bbc7-d3cd17553e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:01.845208 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1384/2781] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:39:01 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:39:03.049488 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272a008-71f9-4884-a9c0-6b537ac86d27 service cinder] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:03.051102 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-b272a008-71f9-4884-a9c0-6b537ac86d27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:03.111014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272a008-71f9-4884-a9c0-6b537ac86d27 service cinder] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:03.115310 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2436f7-c91d-46e4-91e1-debb85c63033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:03.116014 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2436f7-c91d-46e4-91e1-debb85c63033 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:03.116299 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2436f7-c91d-46e4-91e1-debb85c63033 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:03.116576 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2436f7-c91d-46e4-91e1-debb85c63033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:03.118517 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-ea2436f7-c91d-46e4-91e1-debb85c63033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:03.192653 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2436f7-c91d-46e4-91e1-debb85c63033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:03.194128 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2436f7-c91d-46e4-91e1-debb85c63033 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:03.205547 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1398/2782] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:39:03 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:39:04.319689 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af740ec1-3708-47f2-bbc7-d3cd17553e43 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:04.329924 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af740ec1-3708-47f2-bbc7-d3cd17553e43 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:04.334127 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f82d7-c968-448a-8327-5478e0497008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:04.334773 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f82d7-c968-448a-8327-5478e0497008 service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:04.335087 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f82d7-c968-448a-8327-5478e0497008 service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:04.335393 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f82d7-c968-448a-8327-5478e0497008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:04.337357 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-441f82d7-c968-448a-8327-5478e0497008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:04.353311 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f82d7-c968-448a-8327-5478e0497008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:04.354769 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f82d7-c968-448a-8327-5478e0497008 service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:04.372936 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1385/2783] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:39:04 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:39:12.747240 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2436f7-c91d-46e4-91e1-debb85c63033 service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:12.748726 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-ea2436f7-c91d-46e4-91e1-debb85c63033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:12.813156 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2436f7-c91d-46e4-91e1-debb85c63033 service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:12.818756 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fbac0-6869-4a1d-8126-e810ac56a64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:12.819631 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fbac0-6869-4a1d-8126-e810ac56a64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:12.819937 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fbac0-6869-4a1d-8126-e810ac56a64c admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:12.820206 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fbac0-6869-4a1d-8126-e810ac56a64c admin admin] PATH_INFO: `/v3/users/1264212bb591425795d4d617c279e145` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:12.821414 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fbac0-6869-4a1d-8126-e810ac56a64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1264212bb591425795d4d617c279e145)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:12.823848 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fbac0-6869-4a1d-8126-e810ac56a64c admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:12.982361 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-219fbac0-6869-4a1d-8126-e810ac56a64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1264212bb591425795d4d617c279e145'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:12.982910 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-219fbac0-6869-4a1d-8126-e810ac56a64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1264212bb591425795d4d617c279e145'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:12.994817 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-219fbac0-6869-4a1d-8126-e810ac56a64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1264212bb591425795d4d617c279e145'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:13.001632 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-219fbac0-6869-4a1d-8126-e810ac56a64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1264212bb591425795d4d617c279e145'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:13.071376 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-219fbac0-6869-4a1d-8126-e810ac56a64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1264212bb591425795d4d617c279e145'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:13.077913 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1399/2784] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:39:12 2021] DELETE /identity/v3/users/1264212bb591425795d4d617c279e145 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:39:13.082797 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14156eb-f175-45e7-8d7f-70239f61cff6 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:13.083342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14156eb-f175-45e7-8d7f-70239f61cff6 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:13.083342 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14156eb-f175-45e7-8d7f-70239f61cff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:13.101400 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-e14156eb-f175-45e7-8d7f-70239f61cff6 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:39:13.102608 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e14156eb-f175-45e7-8d7f-70239f61cff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:13.160832 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1386/2785] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:39:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:39:13.170755 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fbac0-6869-4a1d-8126-e810ac56a64c admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:13.172190 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-219fbac0-6869-4a1d-8126-e810ac56a64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:13.232784 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fbac0-6869-4a1d-8126-e810ac56a64c admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:13.237288 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d71e3-56e6-4791-99d1-0a06bddf879b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:13.237938 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d71e3-56e6-4791-99d1-0a06bddf879b service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:13.238214 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d71e3-56e6-4791-99d1-0a06bddf879b service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:13.238503 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d71e3-56e6-4791-99d1-0a06bddf879b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:13.248180 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d71e3-56e6-4791-99d1-0a06bddf879b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:13.249598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d71e3-56e6-4791-99d1-0a06bddf879b service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:13.259636 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1400/2786] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:39:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:39:13.663585 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14156eb-f175-45e7-8d7f-70239f61cff6 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:13.665875 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-e14156eb-f175-45e7-8d7f-70239f61cff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:13.685106 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14156eb-f175-45e7-8d7f-70239f61cff6 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:13.690415 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:13.691275 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:13.691555 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:13.691848 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] PATH_INFO: `/v3/projects/2d7869c3e9964b61bd14fefec63d325e` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:13.693390 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7869c3e9964b61bd14fefec63d325e)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:13.695296 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:13.805889 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7869c3e9964b61bd14fefec63d325e', 'request_id': 'req-10c2271f-dcbc-4aec-9199-f3c52184e3c0'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:13.882223 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7869c3e9964b61bd14fefec63d325e', 'request_id': 'req-10c2271f-dcbc-4aec-9199-f3c52184e3c0'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:13.888033 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7869c3e9964b61bd14fefec63d325e', 'request_id': 'req-10c2271f-dcbc-4aec-9199-f3c52184e3c0'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:13.899078 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] The token cache is being invalidate because project 2d7869c3e9964b61bd14fefec63d325e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:39:13.899363 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:13.900030 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:13.901609 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1387/2787] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:39:13 2021] DELETE /identity/v3/projects/2d7869c3e9964b61bd14fefec63d325e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:39:13.905605 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d71e3-56e6-4791-99d1-0a06bddf879b service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:13.915810 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d71e3-56e6-4791-99d1-0a06bddf879b service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:13.973591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbbe5e-b32f-4d83-a473-5e3d1f80d95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:13.974472 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbbe5e-b32f-4d83-a473-5e3d1f80d95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:13.974755 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbbe5e-b32f-4d83-a473-5e3d1f80d95b admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:13.975026 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbbe5e-b32f-4d83-a473-5e3d1f80d95b admin admin] PATH_INFO: `/v3/users/8f755392fccc43d29badfdfd28be5e8d` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:13.976573 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbbe5e-b32f-4d83-a473-5e3d1f80d95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f755392fccc43d29badfdfd28be5e8d)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:13.978545 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbbe5e-b32f-4d83-a473-5e3d1f80d95b admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:14.172004 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a7bbbe5e-b32f-4d83-a473-5e3d1f80d95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f755392fccc43d29badfdfd28be5e8d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:14.172622 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a7bbbe5e-b32f-4d83-a473-5e3d1f80d95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f755392fccc43d29badfdfd28be5e8d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:14.185071 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a7bbbe5e-b32f-4d83-a473-5e3d1f80d95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f755392fccc43d29badfdfd28be5e8d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:14.192541 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a7bbbe5e-b32f-4d83-a473-5e3d1f80d95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f755392fccc43d29badfdfd28be5e8d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:14.260043 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a7bbbe5e-b32f-4d83-a473-5e3d1f80d95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f755392fccc43d29badfdfd28be5e8d'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:14.266950 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1401/2788] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:39:13 2021] DELETE /identity/v3/users/8f755392fccc43d29badfdfd28be5e8d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:39:14.732836 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:14.737430 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:14.750407 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2271f-dcbc-4aec-9199-f3c52184e3c0 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:14.812693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99780e-83cc-49e2-a048-e6f607a244ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:14.813544 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99780e-83cc-49e2-a048-e6f607a244ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:14.813817 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99780e-83cc-49e2-a048-e6f607a244ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:14.814139 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99780e-83cc-49e2-a048-e6f607a244ec admin admin] PATH_INFO: `/v3/projects/4ba695d17f55458ba109ee82e87d3c89` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:14.815479 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99780e-83cc-49e2-a048-e6f607a244ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba695d17f55458ba109ee82e87d3c89)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:14.817255 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99780e-83cc-49e2-a048-e6f607a244ec admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:14.926793 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f99780e-83cc-49e2-a048-e6f607a244ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba695d17f55458ba109ee82e87d3c89', 'request_id': 'req-6f99780e-83cc-49e2-a048-e6f607a244ec'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:15.007955 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f99780e-83cc-49e2-a048-e6f607a244ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba695d17f55458ba109ee82e87d3c89', 'request_id': 'req-6f99780e-83cc-49e2-a048-e6f607a244ec'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:15.013839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f99780e-83cc-49e2-a048-e6f607a244ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba695d17f55458ba109ee82e87d3c89', 'request_id': 'req-6f99780e-83cc-49e2-a048-e6f607a244ec'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:15.025806 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f99780e-83cc-49e2-a048-e6f607a244ec admin admin] The token cache is being invalidate because project 4ba695d17f55458ba109ee82e87d3c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:39:15.028756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f99780e-83cc-49e2-a048-e6f607a244ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:15.028756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-6f99780e-83cc-49e2-a048-e6f607a244ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:15.028756 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1388/2789] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:39:14 2021] DELETE /identity/v3/projects/4ba695d17f55458ba109ee82e87d3c89 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:39:15.036942 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58b14-2277-4bfa-91af-f844286f7574 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:15.037493 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58b14-2277-4bfa-91af-f844286f7574 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:15.037598 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58b14-2277-4bfa-91af-f844286f7574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:15.055199 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-dfd58b14-2277-4bfa-91af-f844286f7574 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:39:15.056480 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-dfd58b14-2277-4bfa-91af-f844286f7574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:15.116395 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1402/2790] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:39:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:39:15.124956 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706896c0-183e-4ccd-b5d1-c90ba794d1e2 None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:15.125242 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706896c0-183e-4ccd-b5d1-c90ba794d1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:15.125519 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706896c0-183e-4ccd-b5d1-c90ba794d1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:15.147450 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-706896c0-183e-4ccd-b5d1-c90ba794d1e2 None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:39:15.148728 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-706896c0-183e-4ccd-b5d1-c90ba794d1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:15.156866 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1389/2791] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:39:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 01:39:15.161182 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd58b14-2277-4bfa-91af-f844286f7574 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:15.171591 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd58b14-2277-4bfa-91af-f844286f7574 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:15.177024 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c36b61-6296-4289-a1dc-038794f9bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:15.177702 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c36b61-6296-4289-a1dc-038794f9bab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:15.177980 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c36b61-6296-4289-a1dc-038794f9bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:15.178338 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c36b61-6296-4289-a1dc-038794f9bab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:15.179048 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c36b61-6296-4289-a1dc-038794f9bab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 01:39:15.179351 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c36b61-6296-4289-a1dc-038794f9bab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:15.180984 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c36b61-6296-4289-a1dc-038794f9bab1 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:15.196634 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1403/2792] 10.222.0.87 () {58 vars in 1152 bytes} [Fri Oct 29 01:39:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 01:39:15.197714 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706896c0-183e-4ccd-b5d1-c90ba794d1e2 None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:15.208008 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706896c0-183e-4ccd-b5d1-c90ba794d1e2 None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:15.212945 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f328469-6ae5-464e-9593-7506deedf93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:15.213679 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328469-6ae5-464e-9593-7506deedf93f admin admin] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:15.214033 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328469-6ae5-464e-9593-7506deedf93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:15.214399 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328469-6ae5-464e-9593-7506deedf93f admin admin] PATH_INFO: `/v3/projects` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:15.215185 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f328469-6ae5-464e-9593-7506deedf93f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:15.217199 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f328469-6ae5-464e-9593-7506deedf93f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:15.390358 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1390/2793] 10.222.0.87 () {60 vars in 1152 bytes} [Fri Oct 29 01:39:15 2021] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:39:15.391560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c36b61-6296-4289-a1dc-038794f9bab1 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:15.402364 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c36b61-6296-4289-a1dc-038794f9bab1 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:15.466977 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e8204-1692-4997-ac4f-0b1b280b0b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:15.467642 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e8204-1692-4997-ac4f-0b1b280b0b9d admin admin] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:15.467945 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e8204-1692-4997-ac4f-0b1b280b0b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:15.468395 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e8204-1692-4997-ac4f-0b1b280b0b9d admin admin] PATH_INFO: `/v3/users` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:15.468915 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e8204-1692-4997-ac4f-0b1b280b0b9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:15.470935 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e8204-1692-4997-ac4f-0b1b280b0b9d admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:15.552353 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1404/2794] 10.222.0.87 () {60 vars in 1143 bytes} [Fri Oct 29 01:39:15 2021] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 01:39:15.556402 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f328469-6ae5-464e-9593-7506deedf93f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:15.568180 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f328469-6ae5-464e-9593-7506deedf93f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:15.573670 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3f0b4-e73c-4830-a9cd-6bb876fd4444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:15.574344 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3f0b4-e73c-4830-a9cd-6bb876fd4444 admin admin] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:15.574647 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3f0b4-e73c-4830-a9cd-6bb876fd4444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:15.574923 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3f0b4-e73c-4830-a9cd-6bb876fd4444 admin admin] PATH_INFO: `/v3/roles` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:15.575671 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3f0b4-e73c-4830-a9cd-6bb876fd4444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:15.577302 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3f0b4-e73c-4830-a9cd-6bb876fd4444 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:15.589678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1391/2795] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:39:15 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:39:15.593864 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e8204-1692-4997-ac4f-0b1b280b0b9d admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:15.604213 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e8204-1692-4997-ac4f-0b1b280b0b9d admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:15.608807 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d291c-5061-484b-8a56-c4b0b6fbae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:15.609467 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d291c-5061-484b-8a56-c4b0b6fbae59 admin admin] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:15.609771 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d291c-5061-484b-8a56-c4b0b6fbae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:15.610145 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d291c-5061-484b-8a56-c4b0b6fbae59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:15.611270 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d291c-5061-484b-8a56-c4b0b6fbae59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:15.612899 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d291c-5061-484b-8a56-c4b0b6fbae59 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:15.623051 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1405/2796] 10.222.0.87 () {58 vars in 1121 bytes} [Fri Oct 29 01:39:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 01:39:15.628164 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3f0b4-e73c-4830-a9cd-6bb876fd4444 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:15.637967 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3f0b4-e73c-4830-a9cd-6bb876fd4444 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:15.642879 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842182e0-757f-4497-827a-9017b5666fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:15.643827 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842182e0-757f-4497-827a-9017b5666fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:15.644045 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842182e0-757f-4497-827a-9017b5666fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:15.644309 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842182e0-757f-4497-827a-9017b5666fe4 admin admin] PATH_INFO: `/v3/projects/5bd48fef3c9246a7a2f7d091f7ca4a7f/users/647c891c5205415bb16e11c924c7be90/roles/999d570f97da49269327a60c1acf21d2` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:15.660559 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842182e0-757f-4497-827a-9017b5666fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd48fef3c9246a7a2f7d091f7ca4a7f, user_id=647c891c5205415bb16e11c924c7be90, role_id=999d570f97da49269327a60c1acf21d2)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:15.663186 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842182e0-757f-4497-827a-9017b5666fe4 admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:15.752387 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1392/2797] 10.222.0.87 () {60 vars in 1482 bytes} [Fri Oct 29 01:39:15 2021] PUT /identity/v3/projects/5bd48fef3c9246a7a2f7d091f7ca4a7f/users/647c891c5205415bb16e11c924c7be90/roles/999d570f97da49269327a60c1acf21d2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 01:39:15.765073 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea79fd-8d0b-4e22-9580-d57424cc5155 None None] REQUEST_METHOD: `POST` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:15.765073 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea79fd-8d0b-4e22-9580-d57424cc5155 None None] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:15.765073 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea79fd-8d0b-4e22-9580-d57424cc5155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:15.791614 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.auth.core [None req-c2ea79fd-8d0b-4e22-9580-d57424cc5155 None None] MFA Rules not processed for user `647c891c5205415bb16e11c924c7be90`. Rule list: `[]` (Enabled: `True`). {{(pid=79704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:39:15.792855 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-c2ea79fd-8d0b-4e22-9580-d57424cc5155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:15.855876 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1406/2798] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:39:15 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:39:15.867434 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842182e0-757f-4497-827a-9017b5666fe4 admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:15.869099 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-842182e0-757f-4497-827a-9017b5666fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:15.927691 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842182e0-757f-4497-827a-9017b5666fe4 admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:15.931378 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca3b28-b4fd-400c-b8b7-405bc57fed8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6be4b7bef21492bad49e6b5a284f4f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:15.932041 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca3b28-b4fd-400c-b8b7-405bc57fed8b service cinder] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:15.932319 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca3b28-b4fd-400c-b8b7-405bc57fed8b service cinder] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:15.932590 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca3b28-b4fd-400c-b8b7-405bc57fed8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:15.942128 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca3b28-b4fd-400c-b8b7-405bc57fed8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:15.943534 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca3b28-b4fd-400c-b8b7-405bc57fed8b service cinder] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:15.952956 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1393/2799] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:39:15 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:39:18.952290 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea79fd-8d0b-4e22-9580-d57424cc5155 None None] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:19.016511 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea79fd-8d0b-4e22-9580-d57424cc5155 None None] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:19.022079 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ba83a-1689-4a89-9529-44ca526d8440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:19.022941 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ba83a-1689-4a89-9529-44ca526d8440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:19.023286 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ba83a-1689-4a89-9529-44ca526d8440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:19.023498 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ba83a-1689-4a89-9529-44ca526d8440 admin admin] PATH_INFO: `/v3/users/647c891c5205415bb16e11c924c7be90` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:19.024736 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ba83a-1689-4a89-9529-44ca526d8440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=647c891c5205415bb16e11c924c7be90)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:19.026649 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ba83a-1689-4a89-9529-44ca526d8440 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:19.266529 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1b7ba83a-1689-4a89-9529-44ca526d8440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647c891c5205415bb16e11c924c7be90'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:19.266529 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1b7ba83a-1689-4a89-9529-44ca526d8440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647c891c5205415bb16e11c924c7be90'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:19.280560 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1b7ba83a-1689-4a89-9529-44ca526d8440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647c891c5205415bb16e11c924c7be90'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:19.290270 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1b7ba83a-1689-4a89-9529-44ca526d8440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647c891c5205415bb16e11c924c7be90'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:19.416849 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-1b7ba83a-1689-4a89-9529-44ca526d8440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647c891c5205415bb16e11c924c7be90'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:19.424168 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1407/2800] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:39:18 2021] DELETE /identity/v3/users/647c891c5205415bb16e11c924c7be90 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:39:19.430235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68688bac-40db-4d42-be4d-ff8112e01dab None None] REQUEST_METHOD: `POST` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:19.430235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68688bac-40db-4d42-be4d-ff8112e01dab None None] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:19.430235 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68688bac-40db-4d42-be4d-ff8112e01dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:19.450213 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.auth.core [None req-68688bac-40db-4d42-be4d-ff8112e01dab None None] MFA Rules not processed for user `5644d459227e4d61a1311eb719e23975`. Rule list: `[]` (Enabled: `True`). {{(pid=79703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 01:39:19.450213 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-68688bac-40db-4d42-be4d-ff8112e01dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:19.514259 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1394/2801] 10.222.0.87 () {58 vars in 957 bytes} [Fri Oct 29 01:39:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 01:39:19.524535 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ba83a-1689-4a89-9529-44ca526d8440 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:19.525962 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-1b7ba83a-1689-4a89-9529-44ca526d8440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:19.586302 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ba83a-1689-4a89-9529-44ca526d8440 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:19.597765 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04dd56-73f8-4048-884a-9eb6836befcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:19.597765 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04dd56-73f8-4048-884a-9eb6836befcb service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:19.597765 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04dd56-73f8-4048-884a-9eb6836befcb service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:19.597765 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04dd56-73f8-4048-884a-9eb6836befcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:19.604449 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04dd56-73f8-4048-884a-9eb6836befcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:19.605956 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04dd56-73f8-4048-884a-9eb6836befcb service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:19.616346 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1408/2802] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:39:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:39:20.056299 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68688bac-40db-4d42-be4d-ff8112e01dab None None] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:20.062637 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-68688bac-40db-4d42-be4d-ff8112e01dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:20.074004 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68688bac-40db-4d42-be4d-ff8112e01dab None None] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:20.079245 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:20.081045 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:20.081327 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:20.081601 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] PATH_INFO: `/v3/projects/5bd48fef3c9246a7a2f7d091f7ca4a7f` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:20.082866 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd48fef3c9246a7a2f7d091f7ca4a7f)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:20.084813 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:20.214528 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd48fef3c9246a7a2f7d091f7ca4a7f', 'request_id': 'req-4418c32c-6f5f-4187-9838-8b36c7ab451e'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:20.282102 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd48fef3c9246a7a2f7d091f7ca4a7f', 'request_id': 'req-4418c32c-6f5f-4187-9838-8b36c7ab451e'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:20.288697 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd48fef3c9246a7a2f7d091f7ca4a7f', 'request_id': 'req-4418c32c-6f5f-4187-9838-8b36c7ab451e'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:20.300525 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] The token cache is being invalidate because project 5bd48fef3c9246a7a2f7d091f7ca4a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:39:20.300767 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:20.301427 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:39:20.302941 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1395/2803] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:39:20 2021] DELETE /identity/v3/projects/5bd48fef3c9246a7a2f7d091f7ca4a7f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:39:22.014426 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04dd56-73f8-4048-884a-9eb6836befcb service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:22.015868 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-dd04dd56-73f8-4048-884a-9eb6836befcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:22.028259 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04dd56-73f8-4048-884a-9eb6836befcb service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:22.075906 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a31e1-449c-486a-bdc4-4606758e4714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:22.076553 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a31e1-449c-486a-bdc4-4606758e4714 service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:22.076834 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a31e1-449c-486a-bdc4-4606758e4714 service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:22.077109 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a31e1-449c-486a-bdc4-4606758e4714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:22.078863 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-2a7a31e1-449c-486a-bdc4-4606758e4714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:22.088822 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a31e1-449c-486a-bdc4-4606758e4714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:22.090245 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a31e1-449c-486a-bdc4-4606758e4714 service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:22.099111 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1409/2804] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:39:22 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:39:24.435153 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:24.436693 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:24.449428 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418c32c-6f5f-4187-9838-8b36c7ab451e admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:24.453042 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22199f3-e836-4932-8eb0-63df4632745b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:24.453679 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22199f3-e836-4932-8eb0-63df4632745b service neutron] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:24.453958 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22199f3-e836-4932-8eb0-63df4632745b service neutron] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:24.454270 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22199f3-e836-4932-8eb0-63df4632745b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:24.456280 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-c22199f3-e836-4932-8eb0-63df4632745b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:24.520624 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22199f3-e836-4932-8eb0-63df4632745b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:24.522038 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22199f3-e836-4932-8eb0-63df4632745b service neutron] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:24.531505 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1396/2805] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:39:24 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:39:26.483182 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a31e1-449c-486a-bdc4-4606758e4714 service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:39:26.484680 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-2a7a31e1-449c-486a-bdc4-4606758e4714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:26.569202 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a31e1-449c-486a-bdc4-4606758e4714 service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:39:26.575233 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6bdaf-b257-42c7-aeb9-ff8578ad5d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:39:26.576103 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6bdaf-b257-42c7-aeb9-ff8578ad5d1e service nova] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:39:26.576291 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6bdaf-b257-42c7-aeb9-ff8578ad5d1e service nova] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:39:26.576643 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6bdaf-b257-42c7-aeb9-ff8578ad5d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:39:26.578512 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-51e6bdaf-b257-42c7-aeb9-ff8578ad5d1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:39:26.593470 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6bdaf-b257-42c7-aeb9-ff8578ad5d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:39:26.595384 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6bdaf-b257-42c7-aeb9-ff8578ad5d1e service nova] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:39:26.607125 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1410/2806] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:39:26 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:41:02.384900 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22199f3-e836-4932-8eb0-63df4632745b service neutron] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:41:02.398604 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22199f3-e836-4932-8eb0-63df4632745b service neutron] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:41:02.404893 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d8ab6-6e83-4198-bbb0-f19e5871922d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28d331f2997547968c51fec87598420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:41:02.405474 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d8ab6-6e83-4198-bbb0-f19e5871922d service nova] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:41:02.405755 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d8ab6-6e83-4198-bbb0-f19e5871922d service nova] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:41:02.406137 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d8ab6-6e83-4198-bbb0-f19e5871922d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:41:02.408125 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-190d8ab6-6e83-4198-bbb0-f19e5871922d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:41:02.422088 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d8ab6-6e83-4198-bbb0-f19e5871922d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:41:02.423664 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d8ab6-6e83-4198-bbb0-f19e5871922d service nova] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:41:02.437795 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1397/2807] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:41:02 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 01:41:08.607313 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6bdaf-b257-42c7-aeb9-ff8578ad5d1e service nova] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:41:08.608801 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-51e6bdaf-b257-42c7-aeb9-ff8578ad5d1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:41:08.670244 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6bdaf-b257-42c7-aeb9-ff8578ad5d1e service nova] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:41:08.674411 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2d16f-dff5-467a-8d36-8d332f6339ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b92ce8a3bd4d1ebfd94249d525addb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:41:08.675066 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2d16f-dff5-467a-8d36-8d332f6339ae service neutron] REQUEST_METHOD: `GET` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:41:08.675347 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2d16f-dff5-467a-8d36-8d332f6339ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:41:08.675621 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2d16f-dff5-467a-8d36-8d332f6339ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:41:08.677460 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-73b2d16f-dff5-467a-8d36-8d332f6339ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:41:08.782698 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2d16f-dff5-467a-8d36-8d332f6339ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:41:08.784173 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2d16f-dff5-467a-8d36-8d332f6339ae service neutron] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:41:08.804035 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1411/2808] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:41:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 01:41:16.264676 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d8ab6-6e83-4198-bbb0-f19e5871922d service nova] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:41:16.266380 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-190d8ab6-6e83-4198-bbb0-f19e5871922d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:41:16.315561 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d8ab6-6e83-4198-bbb0-f19e5871922d service nova] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:41:16.320236 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf8288-f52b-43db-88c2-4afd337ee01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:41:16.321134 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf8288-f52b-43db-88c2-4afd337ee01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:41:16.321415 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf8288-f52b-43db-88c2-4afd337ee01f admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:41:16.321678 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf8288-f52b-43db-88c2-4afd337ee01f admin admin] PATH_INFO: `/v3/users/bef8571ef39b4efe8f510a28052e2b6f` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:41:16.322879 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf8288-f52b-43db-88c2-4afd337ee01f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef8571ef39b4efe8f510a28052e2b6f)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:41:16.324795 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf8288-f52b-43db-88c2-4afd337ee01f admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:41:16.483493 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4acf8288-f52b-43db-88c2-4afd337ee01f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef8571ef39b4efe8f510a28052e2b6f'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:16.490640 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4acf8288-f52b-43db-88c2-4afd337ee01f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef8571ef39b4efe8f510a28052e2b6f'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:16.491376 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4acf8288-f52b-43db-88c2-4afd337ee01f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef8571ef39b4efe8f510a28052e2b6f'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:16.503839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4acf8288-f52b-43db-88c2-4afd337ee01f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef8571ef39b4efe8f510a28052e2b6f'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:16.589535 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-4acf8288-f52b-43db-88c2-4afd337ee01f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef8571ef39b4efe8f510a28052e2b6f'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:16.597102 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1398/2809] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:41:16 2021] DELETE /identity/v3/users/bef8571ef39b4efe8f510a28052e2b6f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:41:16.843129 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2d16f-dff5-467a-8d36-8d332f6339ae service neutron] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:41:16.853587 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2d16f-dff5-467a-8d36-8d332f6339ae service neutron] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:41:16.914607 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:41:16.915468 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:41:16.915772 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:41:16.916061 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] PATH_INFO: `/v3/projects/84bceeeb4f67456a90779360ffc620aa` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:41:16.917325 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84bceeeb4f67456a90779360ffc620aa)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:41:16.919228 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:41:17.042730 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84bceeeb4f67456a90779360ffc620aa', 'request_id': 'req-a30a9118-195d-4c9a-8504-91ca3860dca6'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.114995 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84bceeeb4f67456a90779360ffc620aa', 'request_id': 'req-a30a9118-195d-4c9a-8504-91ca3860dca6'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.121183 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84bceeeb4f67456a90779360ffc620aa', 'request_id': 'req-a30a9118-195d-4c9a-8504-91ca3860dca6'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.133313 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] The token cache is being invalidate because project 84bceeeb4f67456a90779360ffc620aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:41:17.133629 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.134322 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.135919 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1412/2810] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:41:16 2021] DELETE /identity/v3/projects/84bceeeb4f67456a90779360ffc620aa => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:41:17.140526 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf8288-f52b-43db-88c2-4afd337ee01f admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:41:17.141940 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-4acf8288-f52b-43db-88c2-4afd337ee01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:41:17.156099 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf8288-f52b-43db-88c2-4afd337ee01f admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:41:17.215345 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db28d8e-63b9-4063-bdca-f628b02471fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:41:17.216932 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db28d8e-63b9-4063-bdca-f628b02471fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:41:17.217214 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db28d8e-63b9-4063-bdca-f628b02471fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:41:17.217482 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db28d8e-63b9-4063-bdca-f628b02471fe admin admin] PATH_INFO: `/v3/users/c8041d5029ae4ceabb1aa9dc761f0dd6` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:41:17.218718 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db28d8e-63b9-4063-bdca-f628b02471fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8041d5029ae4ceabb1aa9dc761f0dd6)` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:41:17.220661 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db28d8e-63b9-4063-bdca-f628b02471fe admin admin] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:41:17.394016 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3db28d8e-63b9-4063-bdca-f628b02471fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8041d5029ae4ceabb1aa9dc761f0dd6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.400943 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3db28d8e-63b9-4063-bdca-f628b02471fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8041d5029ae4ceabb1aa9dc761f0dd6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.401642 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3db28d8e-63b9-4063-bdca-f628b02471fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8041d5029ae4ceabb1aa9dc761f0dd6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.413747 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3db28d8e-63b9-4063-bdca-f628b02471fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8041d5029ae4ceabb1aa9dc761f0dd6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.488392 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.notifications [None req-3db28d8e-63b9-4063-bdca-f628b02471fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8041d5029ae4ceabb1aa9dc761f0dd6'} {{(pid=79703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.494839 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1399/2811] 10.222.0.87 () {58 vars in 1223 bytes} [Fri Oct 29 01:41:17 2021] DELETE /identity/v3/users/c8041d5029ae4ceabb1aa9dc761f0dd6 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:41:17.724455 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] Authenticating user token {{(pid=79704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:41:17.726024 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.fernet_utils [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:41:17.739519 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a9118-195d-4c9a-8504-91ca3860dca6 admin admin] Validating token access rules against request {{(pid=79704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:41:17.797413 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5644d459227e4d61a1311eb719e23975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ac3fe6c70e94b5294a05c397d1a0fce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:41:17.798272 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:41:17.798551 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:41:17.798819 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0 admin admin] PATH_INFO: `/v3/projects/48c40f6100194f228f40303a3fad55f2` {{(pid=79704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:41:17.800062 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c40f6100194f228f40303a3fad55f2)` {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:41:17.801955 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0 admin admin] RBAC: Authorization granted {{(pid=79704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:41:17.909623 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c40f6100194f228f40303a3fad55f2', 'request_id': 'req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.972096 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c40f6100194f228f40303a3fad55f2', 'request_id': 'req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.978683 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c40f6100194f228f40303a3fad55f2', 'request_id': 'req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0'} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.990976 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0 admin admin] The token cache is being invalidate because project 48c40f6100194f228f40303a3fad55f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 01:41:17.991269 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.991967 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: DEBUG keystone.notifications [None req-6e57a5d2-2160-4df0-ae97-fdf3ee5865a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 01:41:17.993692 dv-cinder-813984-5-iscsi devstack@keystone.service[79704]: [pid: 79704|app: 0|req: 1413/2812] 10.222.0.87 () {58 vars in 1232 bytes} [Fri Oct 29 01:41:17 2021] DELETE /identity/v3/projects/48c40f6100194f228f40303a3fad55f2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 01:42:25.813726 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db28d8e-63b9-4063-bdca-f628b02471fe admin admin] Authenticating user token {{(pid=79703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 01:42:25.815251 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-3db28d8e-63b9-4063-bdca-f628b02471fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:42:25.904390 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db28d8e-63b9-4063-bdca-f628b02471fe admin admin] Validating token access rules against request {{(pid=79703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 01:42:25.960903 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17315196-7ecc-4547-8687-286435e92a1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa303a60fec4ac5aaeb96c6618b387e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6579ca0c9e3d480ab7b4f64d199c403b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 01:42:25.961548 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17315196-7ecc-4547-8687-286435e92a1c service placement] REQUEST_METHOD: `GET` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 01:42:25.961828 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17315196-7ecc-4547-8687-286435e92a1c service placement] SCRIPT_NAME: `/identity` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 01:42:25.962103 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17315196-7ecc-4547-8687-286435e92a1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 01:42:25.963980 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.fernet_utils [None req-17315196-7ecc-4547-8687-286435e92a1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 01:42:25.975124 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17315196-7ecc-4547-8687-286435e92a1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 01:42:25.976719 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17315196-7ecc-4547-8687-286435e92a1c service placement] RBAC: Authorization granted {{(pid=79703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 01:42:25.987012 dv-cinder-813984-5-iscsi devstack@keystone.service[79703]: [pid: 79703|app: 0|req: 1400/2813] 10.222.0.87 () {60 vars in 1365 bytes} [Fri Oct 29 01:42:25 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)